00000400:00080000:0.0F:1788361524.168043:0:83594:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1788361524.83196 00010000:02000000:1.0F:1788361524.168182:0:83196:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:07, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:1.0:1788361524.182366:0:83196:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa0887b4be10 00100000:10000000:1.0:1788361524.182382:0:83196:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0F:1788361524.184640:0:83182:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:2.0:1788361524.184696:0:83182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83182:1875230429717760:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361524.184763:0:83182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0F:1788361524.184971:0:83184:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:3.0:1788361524.184999:0:83184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d139f3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83184:1875230429717888:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788361524.185119:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429717760 00000100:00100000:0.0:1788361524.185129:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429717760 00000100:00100000:2.0:1788361524.185155:0:83182:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5d80 going to sleep for 20 seconds 00000100:00100000:3.0:1788361524.185170:0:83184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361524.185185:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429717888 00000100:00100000:0.0:1788361524.185190:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429717888 00000100:00100000:2.0:1788361524.185200:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4853 00000100:00100000:2.0:1788361524.185213:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83182:x1875230429717760:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:2.0:1788361524.185219:0:26161:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788361524.185223:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4854 00000100:00100000:0.0:1788361524.185234:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83184:x1875230429717888:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1788361524.185239:0:15123:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1788361524.185247:0:26161:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -529 00002000:02000040:2.0:1788361524.185253:0:26161:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1729) 00002000:00080000:0.0:1788361524.185258:0:15123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -31 00002000:02000040:0.0:1788361524.185263:0:15123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1729) 00000100:00100000:1.0:1788361524.185364:0:83184:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1398c7840 going to sleep for 20 seconds 00002000:00010000:2.0:1788361524.191739:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.191751:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.191768:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.191773:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.191779:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.191796:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.191807:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.191815:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192701:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361524.192839:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.192846:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192855:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.192859:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.192864:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192875:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192882:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192890:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192905:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361524.192947:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.192953:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192960:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.192969:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.192974:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192984:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.192993:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193001:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193024:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788361524.193068:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.193074:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193081:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.193084:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.193088:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193096:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193104:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193117:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193132:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788361524.193144:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788361524.193149:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193157:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361524.193162:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193171:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193188:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193197:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe1d8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193216:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788361524.193219:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193237:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361524.193240:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193248:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193258:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193264:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe1d94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193275:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361524.193278:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193283:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361524.193286:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193292:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193300:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193379:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361524.193386:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe1d9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193387:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193409:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fee00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.193413:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193417:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193421:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193424:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.193426:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193438:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193444:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe1da2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193459:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.193461:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.193463:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361524.193474:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.193482:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193490:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.193494:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.193498:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.193501:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193508:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.193523:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193528:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193536:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193552:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.193569:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.193573:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193578:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.193588:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193594:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193602:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.193606:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361524.193607:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe1da9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193617:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193623:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.193625:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193627:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:3.0:1788361524.193628:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193633:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.193637:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193646:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193653:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193659:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193674:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.193692:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.193696:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193702:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577ee00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.193704:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193710:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.193716:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361524.193719:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193724:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193740:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17dfc53/0x1b69fa8920fe1db0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193743:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.193748:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361524.193752:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193753:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.193754:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.193757:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.193780:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193789:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193795:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193819:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361524.193882:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.193887:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193894:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.193896:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.193900:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193908:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193915:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.193934:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194001:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361524.194044:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.194049:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194057:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.194060:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.194064:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194072:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194080:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194087:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194489:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361524.194517:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194526:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577e800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.194530:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194539:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194551:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194558:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824a12f5/0x1b69fa8920fe1db7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194574:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361524.194578:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194585:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577f600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.194588:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194603:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194613:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194620:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005355babb/0x1b69fa8920fe1dbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194657:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.194658:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.194675:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.194685:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577e600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.194689:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.194707:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.194713:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194727:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.194730:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.194734:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194743:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194751:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194758:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194769:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.194798:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.194810:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361524.194813:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.194817:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.194841:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000040ff38d/0x1b69fa8920fe1dc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.194858:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.194863:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.194876:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577f400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.194879:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.194910:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.194913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.194915:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.194934:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.194943:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.194995:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.194997:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.195001:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195011:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195030:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195036:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195068:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195079:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195082:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.195091:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a68e90c9/0x1b69fa8920fe1dcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.195129:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361524.195130:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361524.195135:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195136:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195158:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577ea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361524.195159:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:3.0:1788361524.195161:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195164:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.195174:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195176:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195196:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195199:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195206:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195229:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195230:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de3a26a9/0x1b69fa8920fe1dd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195255:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.195258:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.195868:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.195871:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.195874:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195874:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361524.195878:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.195894:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577fc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.195898:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195907:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.195919:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.195921:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361524.195934:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a8760f/0x1b69fa8920fe1dda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195935:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195955:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.195959:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.195963:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195974:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195982:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.195989:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196008:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.196042:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.196048:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.196050:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.196062:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196063:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577f200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.196069:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196077:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.196083:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196091:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.196097:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196120:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196124:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196138:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196139:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052d54aa9/0x1b69fa8920fe1de1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196159:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196169:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.196174:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361524.196175:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361524.196178:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196185:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577fa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.196190:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196197:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196206:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2d911f/0x1b69fa8920fe1de8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.196221:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.196224:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196228:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196233:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.196236:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196242:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.196242:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196248:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.196252:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196261:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196269:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.196275:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196285:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196330:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.196331:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.196346:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196353:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577e000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.196356:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196364:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196374:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196380:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fbf3c79/0x1b69fa8920fe1def lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.196381:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.196392:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196399:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196403:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.196403:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.196404:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196410:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.196414:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196424:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196432:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196439:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196453:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.196464:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.196469:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196477:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577e200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.196488:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.196491:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.196499:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196502:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196523:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.196525:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196526:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.196532:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196542:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7393543/0x1b69fa8920fe1df6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196545:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196563:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196567:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.196570:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196574:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196574:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196591:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.196600:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.196605:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196615:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577f000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.196618:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196626:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.196627:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.196635:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196644:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.196644:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196646:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.196649:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196670:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196672:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ff1f1a9/0x1b69fa8920fe1dfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196690:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.196695:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.196698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.196701:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196758:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361524.196789:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.196792:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196797:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.196799:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.196802:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196807:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196812:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.196816:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.196905:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361524.196909:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.196918:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577f800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.196920:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.196926:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.196933:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.196939:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1d1ff2/0x1b69fa8920fe1e04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196975:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.196980:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196987:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577ec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.196990:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.196997:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197006:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197013:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197014:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197016:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.197140:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361524.197156:0:26161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008132213d/0x1b69fa8920fe1e0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197158:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361524.197210:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.197216:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197223:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.197227:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.197231:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197240:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197248:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197255:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197268:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.197276:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.197281:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197296:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577e400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.197299:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197308:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197318:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.197319:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.197327:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b16b1a/0x1b69fa8920fe1e12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197352:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197354:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197355:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.197478:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197492:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.197495:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.197500:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197510:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197519:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197526:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197542:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.197562:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.197567:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197574:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00577fe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.197578:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197586:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.197602:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.197603:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197613:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197615:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5803fb0/0x1b69fa8920fe1e19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197631:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.197635:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.197639:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.197640:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197642:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197646:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.197655:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197676:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197683:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197706:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.197715:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.197721:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197728:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142044e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.197732:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197741:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.197747:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.197752:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197754:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197771:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ecf2/0x1b69fa8920fe1e20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197774:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.197781:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.197786:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197806:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.197809:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197813:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.197816:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.197817:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197857:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197886:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361524.197926:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.197931:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197951:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.197954:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.197958:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197967:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197976:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.197984:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198003:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361524.198022:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361524.198027:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198035:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142044800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.198039:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.198040:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.198045:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198047:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198053:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:3.0:1788361524.198059:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198062:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.198066:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198071:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e211c60/0x1b69fa8920fe1e27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198075:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198083:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198084:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.198088:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198090:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198095:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142044000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.198098:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198104:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.198106:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198107:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.198115:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198120:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198125:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142044a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.198130:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007881ddbd/0x1b69fa8920fe1e2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.198138:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.198145:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198153:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.198156:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198158:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198159:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198159:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198178:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c2ce140/0x1b69fa8920fe1e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198180:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.198188:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.198195:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198199:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198202:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198205:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198207:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198210:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198218:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198233:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198250:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361524.198289:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.198306:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198315:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.198318:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.198327:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.198344:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198356:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142045000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.198359:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198367:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198378:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198385:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dd03a6f/0x1b69fa8920fe1e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198397:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198399:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198401:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198578:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198592:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198602:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198609:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198629:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361524.198667:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.198672:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198686:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:3.0:1788361524.198688:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361524.198689:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361524.198693:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198694:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198703:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198704:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142045200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.198708:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198711:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198716:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198719:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198727:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198734:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001266648/0x1b69fa8920fe1e43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198734:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.198747:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.198751:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198757:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142045600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.198760:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198767:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.198770:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.198775:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198777:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198782:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.198785:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.198790:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198791:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc8d6cf0/0x1b69fa8920fe1e4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198798:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198801:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.198805:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.198807:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.198809:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198819:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198844:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.198859:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.198868:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.198875:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198890:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142044200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.198895:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.198902:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361524.198909:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198933:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198946:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198954:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066cc7e18/0x1b69fa8920fe1e51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.198968:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198970:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.198972:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.198989:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.198995:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.199000:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199010:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199019:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199026:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199053:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.199072:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.199083:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199091:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d142045c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199096:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199105:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.199111:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.199116:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199118:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199135:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.199149:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0f172b5/0x1b69fa8920fe1e58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199162:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.199163:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.199165:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361524.199202:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.199209:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199219:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199227:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199235:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199252:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.199270:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.199278:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199285:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199289:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199297:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199307:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199314:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe1e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199374:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.199376:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361524.199377:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.199385:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.199386:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199396:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.199399:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.199404:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199416:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361524.199419:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.199425:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199426:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199433:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199434:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:2.0:1788361524.199442:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361524.199447:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199455:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199464:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361524.199471:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199493:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361524.199501:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361524.199539:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361524.199548:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.199551:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.199561:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199563:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005308600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199570:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199574:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.199582:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.199586:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199588:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199611:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199613:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199629:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199631:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c7f8bc/0x1b69fa8920fe1e6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199649:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199661:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361524.199666:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199666:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.199676:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715cc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199681:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199689:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.199704:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.199707:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199710:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199726:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe1e66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199728:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.199738:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.199744:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361524.199744:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199750:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199761:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199762:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005309400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199769:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199773:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199785:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199788:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199803:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199807:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.199817:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000789dbc0/0x1b69fa8920fe1e74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199850:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.199855:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199870:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005308200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199874:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.199881:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.199883:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199889:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199899:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199900:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.199908:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.199916:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199917:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f117b06c/0x1b69fa8920fe1e7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199934:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199940:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.199944:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.199944:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199946:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.199959:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.199974:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.199980:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.199985:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.199994:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005308400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.199997:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200004:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.200015:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.200022:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200023:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200042:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fe78a32/0x1b69fa8920fe1e82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200043:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.200052:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.200058:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200062:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200065:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200070:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200071:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200076:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200081:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200082:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200092:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200110:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361524.200145:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.200151:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200163:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.200167:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.200171:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200180:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200189:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200195:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200206:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361524.200246:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.200251:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200258:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.200260:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.200264:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200271:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200278:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361524.200286:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200291:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200297:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005308000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.200302:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200310:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200319:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200326:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200343:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0744306/0x1b69fa8920fe1e89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200345:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361524.200366:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361524.200371:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200377:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.200381:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.200389:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.200390:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200398:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200403:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200409:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.200413:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe1e90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200414:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.200423:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200430:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.200434:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200436:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200446:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.200449:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200466:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200474:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200480:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe1e97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200491:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200493:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200495:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200500:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200503:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200517:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200524:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200550:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.200559:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.200564:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200574:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.200578:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200587:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.200591:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.200603:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200606:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200612:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.200620:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.200628:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200631:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe1e9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200647:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200657:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200658:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200662:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200666:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200669:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200684:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.200694:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.200699:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200708:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.200711:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.200717:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.200722:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200724:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200744:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.200747:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200756:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.200762:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe1ea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200764:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200788:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200791:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.200796:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200799:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200807:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.200809:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200869:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361524.200909:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.200914:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200922:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.200924:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361524.200926:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.200932:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200933:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200955:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361524.200958:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200961:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.200975:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.200979:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201001:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201006:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201015:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.201017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe1eac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201033:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.201038:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201046:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201050:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.201057:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.201059:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201064:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201084:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.201088:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.201090:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201093:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201111:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe1eb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201115:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201129:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201131:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201136:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201139:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.201141:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201147:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.201153:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.201159:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.201163:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201172:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201176:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201185:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.201188:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.201200:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201203:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201219:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe1eba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201223:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.201228:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.201233:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201245:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201257:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201259:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201263:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201268:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.201269:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201285:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.201291:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.201296:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201303:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201308:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201317:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201328:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201344:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe1ec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201357:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201364:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361524.201399:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.201405:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201414:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.201417:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.201421:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201430:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201450:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201458:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201472:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.201489:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.201495:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.201507:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.201517:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201522:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201528:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201530:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.201538:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.201547:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201548:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201569:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201574:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201581:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201587:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe1ec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201595:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201608:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201612:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201617:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.201631:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.201637:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.201643:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201651:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201656:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201666:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.201668:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.201674:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201693:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.201697:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.201698:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201702:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201716:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe1ecf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201720:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201732:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201735:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201739:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.201742:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201743:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.201759:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.201767:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.201773:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201781:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201785:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201794:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.201794:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.201804:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201811:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201814:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.201841:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe1ed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201842:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.201852:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201869:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201878:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201887:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201899:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361524.201935:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.201940:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201949:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.201952:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.201956:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201961:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.201966:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361524.201966:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201971:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.201983:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.201984:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.201988:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202011:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202012:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202038:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202038:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.202049:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe1edd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202068:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.202072:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.202078:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.202079:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.202085:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202087:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202104:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.202110:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.202119:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202124:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202133:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202139:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202143:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202154:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe1ee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202158:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202175:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.202180:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.202185:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202193:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.202197:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202204:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.202207:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.202217:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202219:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202237:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe1eeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202241:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.202248:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.202253:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202272:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202275:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202279:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.202283:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202285:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202294:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.202294:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202303:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.202401:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.202444:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.202458:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.202464:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202472:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.202477:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.202483:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.202487:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202489:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202510:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.202513:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202514:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.202521:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202532:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe1ef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202537:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202550:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202554:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202558:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.202561:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202570:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202584:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.202591:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.202605:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202612:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.202617:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.202622:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.202629:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202630:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202650:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.202653:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202653:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.202661:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202664:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe1ef9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202678:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202684:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202688:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.202688:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202690:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.202698:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202724:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.202731:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.202736:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202744:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.202750:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.202762:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.202773:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202776:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202794:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.202799:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.202800:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202804:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202811:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e39f701b/0x1b69fa8920fe1f00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202882:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202892:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202901:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202910:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202914:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.202919:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202926:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.202929:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202937:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202947:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.202949:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361524.202958:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dda7cb6e/0x1b69fa8920fe1f07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.202980:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.202983:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361524.202995:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.203007:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.203016:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.203025:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.203030:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.203040:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.203048:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.203055:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788361524.203311:0:26161:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:2.0:1788361524.203453:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83182:x1875230429717760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18240us (18687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361524.203461:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4853 00000100:00100000:2.0:1788361524.203509:0:83182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83182:1875230429717760:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361524.203523:0:83182:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:2.0:1788361524.203585:0:83182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83182:1875230429718144:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361524.203613:0:83182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361524.203632:0:83182:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104d72e40 going to sleep for 20 seconds 00000100:00100000:2.0:1788361524.203648:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718144 00000100:00100000:2.0:1788361524.203653:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718144 00000100:00100000:2.0:1788361524.203683:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4855 00000100:00100000:2.0:1788361524.203696:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:83182:x1875230429718144:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:2.0:1788361524.203702:0:26172:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1788361524.203735:0:26172:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00010000:00010000:3.0:1788361524.203912:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.203918:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.203927:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.203931:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.203939:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.203949:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.203954:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.203955:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361524.203966:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000220a741f/0x1b69fa8920fe1f0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.203970:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361524.203976:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429718016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361524.203988:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.203997:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.204000:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361524.204015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361524.204047:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718016 00000100:00100000:1.0:1788361524.204054:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718016 00000100:00100000:1.0:1788361524.204087:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1788361524.204096:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429718016:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:1.0:1788361524.204101:0:26156:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00010000:0.0:1788361524.204109:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00000024:1.0:1788361524.204114:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00010000:00010000:0.0:1788361524.204115:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204127:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.204132:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.204137:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204148:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361524.204169:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429718016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361524.204179:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00010000:00010000:0.0:1788361524.204185:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361524.204199:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429718016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361524.204200:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204218:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361524.204253:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.204257:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204265:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.204268:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.204272:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204278:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361524.204283:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204285:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204304:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204305:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.204311:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204322:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204326:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204361:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204388:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe1f15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204390:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.204410:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.204414:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204422:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.204425:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204433:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.204441:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.204444:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204447:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204463:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9692bd7/0x1b69fa8920fe1f1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204464:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:0.0:1788361524.204471:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.204478:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204487:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204487:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204491:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.204495:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204497:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204502:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204513:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.204521:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.204527:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204541:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.204544:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.204549:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361524.204555:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204555:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204568:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.204576:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204577:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.204585:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204590:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4a390f/0x1b69fa8920fe1f23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204595:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204603:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204609:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204609:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204614:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.204619:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361524.204621:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361524.204624:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204633:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.204637:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204645:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.204659:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.204665:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204666:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204681:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.204684:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc88401/0x1b69fa8920fe1f2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204687:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.204697:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204707:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204709:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204711:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.204715:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204724:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204739:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204755:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361524.204757:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361524.204762:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204766:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.204772:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361524.204776:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.204785:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.204796:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.204804:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fdb5d3c/0x1b69fa8920fe1f31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.204807:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.204812:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204820:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:3.0:1788361524.204838:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.204841:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361524.204843:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204849:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361524.204850:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361524.204854:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204864:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204873:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204882:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204899:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.204930:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.204937:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361524.204939:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361524.204948:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204949:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.204954:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204966:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=2564s v=(0 0) 00010000:00010000:1.0:1788361524.204970:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204970:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361524.204976:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204989:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.204991:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.204996:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.205005:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f48dad9/0x1b69fa8920fe1f38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.205007:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.205037:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361524.205052:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361524.205057:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.205058:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.205066:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361524.205071:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.205078:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788361524.205079:0:15123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00010000:00010000:1.0:1788361524.205093:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.205100:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a47346d1/0x1b69fa8920fe1f3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.205117:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.205120:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361524.205122:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361524.205136:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83184:x1875230429717888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19903us (19965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361524.205145:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4854 00000100:00100000:3.0:1788361524.205172:0:83184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d139f3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83184:1875230429717888:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361524.205186:0:83184:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:0.0:1788361524.205258:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d139f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429718272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361524.205273:0:83184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83184:1875230429718400:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788361524.205291:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361524.205305:0:83184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361524.205317:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718272 00000100:00100000:1.0:1788361524.205323:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718272 00000100:00100000:3.0:1788361524.205324:0:83184:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1398c7840 going to sleep for 20 seconds 00000100:00100000:1.0:1788361524.205362:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1788361524.205371:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429718272:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1788361524.205376:0:10106:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788361524.205402:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361524.205447:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429718272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361524.205455:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1788361524.205466:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d139f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429718272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361524.205494:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718400 00000100:00100000:0.0:1788361524.205497:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718400 00000100:00100000:0.0:1788361524.205523:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4856 00000100:00100000:0.0:1788361524.205536:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83184:x1875230429718400:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1788361524.205539:0:26164:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1788361524.205559:0:26164:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00000100:00100000:2.0:1788361524.205789:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:83182:x1875230429718144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2093us (2175us total) trans 4294968745 rc 0/0 00000100:00100000:2.0:1788361524.205794:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4855 00000100:00100000:3.0:1788361524.205847:0:83182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83182:1875230429718144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788361524.205859:0:83182:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00000100:00100000:0.0:1788361524.206608:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:83184:x1875230429718400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1074us (1301us total) trans 4294968745 rc 0/0 00000100:00100000:0.0:1788361524.206613:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4856 00000100:00100000:3.0:1788361524.207286:0:83184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83184:1875230429718400:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361524.207309:0:83184:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00010000:00010000:3.0:1788361524.310078:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788361525.077955:0:8448:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d120e88e00 x1875230429716480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788361534 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361525.078142:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429716480:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1015378us (1016475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361525.078150:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00080000:3.0:1788361525.078245:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788361525.078254:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d120e89180 x1875230429716480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361554 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361525.078263:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d120e89180 x1875230429716480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361554 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361525.078270:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361525.078287:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788361525.078384:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429718528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361525.078434:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361525.078469:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718528 00000100:00100000:2.0:1788361525.078480:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718528 00000100:00100000:2.0:1788361525.078523:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:2.0:1788361525.078532:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429718528:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1788361525.078540:0:23938:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788361525.078568:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444986880 avail 1298747392 00000100:00100000:0.0:1788361525.080975:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361525.081054:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429633664 00000100:00100000:0.0:1788361525.081061:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429633664 00000100:00100000:0.0:1788361525.081099:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1788361525.081108:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429633664:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1788361525.081114:0:23939:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788361525.081136:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444986880 avail 1298747392 00000100:00100000:0.0:1788361525.081188:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429633664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361525.081195:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1788361525.081237:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11e7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429633664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361525.082402:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429718528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3866us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361525.082414:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:1.0:1788361525.082433:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429718528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361525.083550:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429716480:0@lo:400:ptlrpcd_rcv.0 00010000:00010000:3.0:1788361525.334012:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361526.102006:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429718656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361526.102082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361526.102099:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361526.102114:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429718784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361526.102122:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718656 00000100:00100000:3.0:1788361526.102132:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718656 00000100:00100000:2.0:1788361526.102144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361526.102185:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718784 00000100:00100000:3.0:1788361526.102190:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718784 00000100:00100000:2.0:1788361526.102194:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1788361526.102205:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429718656:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:2.0:1788361526.102210:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788361526.102216:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1788361526.102228:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429718784:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1788361526.102235:0:8442:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788361526.102247:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788361526.102261:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361526.102329:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429718784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361526.102340:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1788361526.102340:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429718656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361526.102350:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1788361526.102350:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429718656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361526.102385:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429718784:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788361526.102733:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361526.102737:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788361526.358088:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361527.127152:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429718912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361527.127231:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361527.127329:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429718912 00000100:00100000:2.0:1788361527.127337:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429718912 00000100:00100000:2.0:1788361527.127383:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:2.0:1788361527.127390:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429718912:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:2.0:1788361527.127396:0:8449:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788361527.127426:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:2.0:1788361527.127479:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429718912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361527.127485:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:3.0:1788361527.127534:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429718912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788361527.382141:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361528.406037:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361529.174310:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429719296:0@lo:400:kworker.0 00000100:00100000:3.0:1788361529.174358:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429719424:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.174407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361529.174410:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429719168:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.174500:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429719040:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.174511:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11e7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429719808:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.174543:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361529.174550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361529.174580:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429719552:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.174581:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429720320:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.174617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361529.174624:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361529.174662:0:83171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719040 00000100:00100000:3.0:1788361529.174671:0:83171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719040 00000100:00100000:1.0:1788361529.174684:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719808 00000100:00100000:1.0:1788361529.174690:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719808 00000100:00100000:3.0:1788361529.174719:0:83171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788361529.174730:0:83171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429719040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.174735:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720320 00000020:02000000:3.0:1788361529.174737:0:83171:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788361529.174740:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720320 00000100:00100000:1.0:1788361529.174769:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:1.0:1788361529.174779:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429719808:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788361529.174785:0:26162:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788361529.174791:0:83171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429719040:12345-0@lo:400:kworker.0 Request processed in 63us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361529.174799:0:83171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788361529.174853:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429719808:12345-0@lo:400:kworker.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361529.174861:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1788361529.174872:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429720320:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788361529.174880:0:26171:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788361529.174880:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00080000:1.0:1788361529.174908:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361529.174918:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429720320:12345-0@lo:400:kworker.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361529.174925:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:1.0:1788361529.174945:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11e7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429719808:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.174960:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429720320:0@lo:400:kworker.0 00000100:00100000:0.0:1788361529.177292:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719296 00000100:00100000:0.0:1788361529.177310:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719296 00000100:00100000:1.0:1788361529.177330:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719552 00000100:00100000:1.0:1788361529.177337:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719552 00000100:00100000:2.0:1788361529.177355:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429720064:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.177385:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1788361529.177395:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429719552:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788361529.177402:0:67579:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788361529.177408:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361529.177432:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429720576:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.177459:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429719552:12345-0@lo:400:kworker.0 Request processed in 64us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.177471:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1788361529.177476:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361529.177519:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429719040:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.177533:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429719552:0@lo:400:kworker.0 00000100:00100000:3.0:1788361529.177606:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361529.177956:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720064 00000100:00100000:0.0:1788361529.177962:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720064 00000100:00100000:1.0:1788361529.177963:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720576 00000100:00100000:1.0:1788361529.177969:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720576 00000100:00100000:0.0:1788361529.177993:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1788361529.178006:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1788361529.178007:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429719296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.178019:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429720064:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788361529.178024:0:67579:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:0.0:1788361529.178032:0:66126:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788361529.178066:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429720064:12345-0@lo:400:kworker.0 Request processed in 50us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.178073:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1788361529.178087:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1788361529.178092:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429720576:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788361529.178097:0:67579:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788361529.178127:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429720576:12345-0@lo:400:kworker.0 Request processed in 33us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.178133:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1788361529.178148:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429719680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.178154:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719168 00000100:00100000:1.0:1788361529.178159:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719168 00000100:00100000:1.0:1788361529.178181:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1788361529.178187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361529.178193:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429719168:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788361529.178199:0:67579:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788361529.178233:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429719296:12345-0@lo:400:kworker.0 Request processed in 232us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361529.178252:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1788361529.178296:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429720192:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.178309:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429719168:12345-0@lo:400:kworker.0 Request processed in 117us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.178317:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1788361529.178321:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429719296:0@lo:400:kworker.0 00000100:00080000:1.0:1788361529.178356:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361529.178360:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361529.178385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361529.178426:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429719168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.178437:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719680 00000100:00100000:1.0:1788361529.178443:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719680 00000100:00100000:3.0:1788361529.178455:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720192 00000100:00100000:3.0:1788361529.178460:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720192 00000100:00100000:1.0:1788361529.178478:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:1.0:1788361529.178488:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429719680:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788361529.178492:0:23938:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788361529.178513:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429720064:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.178516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361529.178533:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429720576:0@lo:400:kworker.0 00000100:00100000:1.0:1788361529.178542:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429719680:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.178558:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11e7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429719936:0@lo:400:kworker.0 00000100:00100000:0.0:1788361529.178573:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719424 00000100:00100000:0.0:1788361529.178578:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719424 00000100:00100000:2.0:1788361529.178603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361529.178611:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1788361529.178620:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429719424:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788361529.178626:0:66126:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788361529.178628:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429720448:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.178657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361529.178678:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429719424:12345-0@lo:400:kworker.0 Request processed in 58us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.178694:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429719424:0@lo:400:kworker.0 00000100:00100000:0.0:1788361529.178695:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00080000:0.0:1788361529.178735:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361529.178742:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429719936 00000100:00100000:2.0:1788361529.178747:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429719936 00000100:00100000:0.0:1788361529.178766:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429719680:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.178787:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720448 00000100:00100000:2.0:1788361529.178791:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720448 00000100:00100000:0.0:1788361529.178806:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:2.0:1788361529.178820:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1788361529.178842:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429719936:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788361529.178851:0:26163:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788361529.178856:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429720448:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788361529.178862:0:26170:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788361529.178904:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429720448:12345-0@lo:400:kworker.0 Request processed in 51us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.178913:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1788361529.178914:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429719936:12345-0@lo:400:kworker.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361529.178925:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00080000:2.0:1788361529.178931:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361529.178952:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11e7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429719936:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.178963:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429720448:0@lo:400:kworker.0 00000100:00100000:3.0:1788361529.179855:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:3.0:1788361529.179868:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429720192:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788361529.179873:0:8448:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788361529.179921:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429720192:12345-0@lo:400:kworker.0 Request processed in 58us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361529.179928:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:1.0:1788361529.179978:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1788361529.180022:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429720192:0@lo:400:kworker.0 00000100:00100000:2.0:1788361529.225011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361529.225182:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956032 00000100:00100000:0.0:1788361529.225193:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956032 00000100:00100000:0.0:1788361529.225319:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1002 00000100:00100000:0.0:1788361529.225328:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230406956032:12345-192.168.204.35@tcp:38:kworker.0 00000020:02000000:0.0:1788361529.225337:0:66127:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788361529.225371:0:66127:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t94489280515 exp 0000000000000000 cur 2569 last 0 00000020:00000080:0.0:1788361529.225426:0:66127:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe1f46 00000100:00100000:3.0:1788361529.225441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000004:00100000:0.0:1788361529.225451:0:66127:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788361529.225479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361529.225508:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361529.225553:0:83169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406955904 00000100:00100000:2.0:1788361529.225559:0:83169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406955904 00000100:00080000:0.0:1788361529.225569:0:66127:0:(import.c:65:import_set_state_nolock()) ffff99d002091800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361529.225592:0:83169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:2.0:1788361529.225600:0:83169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406955904:12345-192.168.204.35@tcp:400:kworker.0 00000020:02000000:2.0:1788361529.225605:0:83169:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788361529.225642:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406956032:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 312us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.225648:0:83169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406955904:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361529.225656:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1002 00000100:00100000:2.0:1788361529.225661:0:83169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:2.0:1788361529.225795:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956288 00000100:00100000:2.0:1788361529.225800:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956288 00000100:00100000:2.0:1788361529.225860:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1759 00000100:00100000:2.0:1788361529.225867:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406956288:12345-192.168.204.35@tcp:400:kworker.0 00000020:02000000:2.0:1788361529.225872:0:26159:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788361529.225900:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406956288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.225907:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1759 00000100:00080000:2.0:1788361529.225928:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361529.227210:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956160 00000100:00100000:1.0:1788361529.227220:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956160 00000100:00080000:3.0:1788361529.227294:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361529.227299:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 749 00000100:00100000:1.0:1788361529.227311:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406956160:12345-192.168.204.35@tcp:400:kworker.0 00000020:02000000:1.0:1788361529.227316:0:67579:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788361529.227366:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406956160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 58us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.227374:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 749 00000100:00100000:2.0:1788361529.244608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361529.244673:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956416 00000100:00100000:0.0:1788361529.244684:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956416 00000100:00100000:0.0:1788361529.244754:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1003 00000100:00100000:0.0:1788361529.244765:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:63988:x1875230406956416:12345-192.168.204.35@tcp:41:lfs.0 00000020:02000000:0.0:1788361529.244772:0:66126:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788361529.244809:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361529.244922:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:63988:x1875230406956416:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 158us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361529.244929:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1003 00000100:00100000:2.0:1788361529.248187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361529.248426:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956544 00000100:00100000:0.0:1788361529.248436:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956544 00000100:00100000:0.0:1788361529.248488:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4857 00000100:00100000:0.0:1788361529.248498:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2408:x1875230406956544:12345-192.168.204.35@tcp:8:lfs.0 00000020:02000000:0.0:1788361529.248506:0:26168:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788361529.248540:0:26168:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2569 last 0 00000020:00000080:0.0:1788361529.248576:0:26168:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe1f4d 00002000:00100000:0.0:1788361529.248600:0:26168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d002095000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361529.248617:0:26168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788361529.248691:0:26168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788361529.248722:0:26168:0:(import.c:65:import_set_state_nolock()) ffff99d002092800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361529.248802:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406956544:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 304us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361529.248810:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4857 00000001:00100000:2.0:1788361529.250984:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00080000:2.0:1788361529.251000:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968745 is committed 00000100:00100000:3.0:1788361529.253226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361529.253309:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956672 00000100:00100000:1.0:1788361529.253320:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956672 00000100:00100000:1.0:1788361529.253520:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1406 00000100:00100000:1.0:1788361529.253530:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:63988:x1875230406956672:12345-192.168.204.35@tcp:13:lfs.0 00000020:02000000:1.0:1788361529.253538:0:8442:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788361529.253559:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361529.254059:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:63988:x1875230406956672:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 157us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.254068:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1406 00000100:00100000:3.0:1788361529.256565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361529.257814:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956800 00000100:00100000:1.0:1788361529.257851:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956800 00000100:00100000:1.0:1788361529.257914:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1407 00000100:00100000:1.0:1788361529.257925:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:63988:x1875230406956800:12345-192.168.204.35@tcp:13:lfs.0 00000020:02000000:1.0:1788361529.257933:0:26156:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788361529.257965:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361529.258078:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:63988:x1875230406956800:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 155us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361529.258086:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1407 00010000:00010000:3.0:1788361529.430173:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361529.686307:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361529.686328:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429720832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361529.686397:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361529.686435:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720832 00000100:00100000:2.0:1788361529.686441:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720832 00000100:00100000:2.0:1788361529.686473:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1788361529.686480:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429720832:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:2.0:1788361529.686486:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788361529.686505:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361529.686540:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429720832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.686562:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1788361529.686598:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968745 gen 2 00000100:00100000:2.0:1788361529.686616:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429720832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361529.686672:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429720704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361529.686698:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361529.686747:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720704 00000100:00100000:2.0:1788361529.686751:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720704 00000100:00100000:2.0:1788361529.686772:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1788361529.686777:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429720704:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1788361529.686781:0:26156:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788361529.686789:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361529.687799:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429720704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1019us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.687808:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1788361529.687939:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429720704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361530.200931:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361530.200956:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429720960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361530.201029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361530.201437:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429720960 00000100:00100000:0.0:1788361530.201445:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429720960 00000100:00100000:0.0:1788361530.201539:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:0.0:1788361530.201550:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429720960:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1788361530.201558:0:8449:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788361530.201588:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:0.0:1788361530.201644:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429720960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361530.201651:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1788361530.201724:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429720960:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788361530.203912:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968745 is committed 00010000:00010000:2.0:1788361530.454324:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788361530.712492:0:83164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000100:00100000:2.0:1788361530.746792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361530.746934:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406956928 00000100:00100000:0.0:1788361530.746944:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406956928 00000100:00100000:0.0:1788361530.746996:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1004 00000100:00100000:0.0:1788361530.747006:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+5:64080:x1875230406956928:12345-192.168.204.35@tcp:101:lfs.0 00000020:02000000:0.0:1788361530.747012:0:66127:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1788361530.747040:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361530.747063:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2200/0x1b69fa8920fe1f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cbe expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361530.750888:0:66127:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3760us 00010000:00010000:2.0:1788361530.759690:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.759714:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.759728:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361530.759778:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361530.759782:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788361530.759842:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.759877:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2200/0x1b69fa8920fe1f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cbe expref: 7 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.759894:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cbe expref: 6 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.759903:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:2.0:1788361530.759906:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361530.759909:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c800, rc 0) 00000100:00100000:2.0:1788361530.759987:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406956928:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 12981us (13203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361530.759995:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1004 00000100:00100000:3.0:1788361530.765632:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361530.765806:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957056 00000100:00100000:1.0:1788361530.765815:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957056 00000100:00100000:1.0:1788361530.765896:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1005 00000100:00100000:1.0:1788361530.765906:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406957056:12345-192.168.204.35@tcp:41:lfs.0 00000020:02000000:1.0:1788361530.765913:0:67579:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788361530.765938:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:1.0:1788361530.766008:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406957056:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361530.766015:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1005 00000100:00100000:1.0:1788361530.768036:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361530.768102:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957184 00000100:00100000:0.0:1788361530.768111:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957184 00000100:00100000:0.0:1788361530.768161:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1006 00000100:00100000:0.0:1788361530.768171:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406957184:12345-192.168.204.35@tcp:41:lfs.0 00000020:02000000:0.0:1788361530.768179:0:66126:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788361530.768218:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361530.768277:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406957184:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361530.768285:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1006 00000100:00100000:2.0:1788361530.770709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361530.770810:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957312 00000100:00100000:0.0:1788361530.770818:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957312 00000100:00100000:0.0:1788361530.770878:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1410 00000100:00100000:0.0:1788361530.770888:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:64080:x1875230406957312:12345-192.168.204.35@tcp:13:lfs.0 00000020:02000000:0.0:1788361530.770894:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788361530.770912:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361530.770962:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:64080:x1875230406957312:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361530.770968:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1410 00000100:00100000:3.0:1788361530.774571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361530.774658:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957440 00000100:00100000:2.0:1788361530.774669:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957440 00000100:00100000:2.0:1788361530.774726:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1411 00000100:00100000:2.0:1788361530.774736:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406957440:12345-192.168.204.35@tcp:13:lfs.0 00000020:02000000:2.0:1788361530.774743:0:10106:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788361530.774766:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361530.774874:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:64080:x1875230406957440:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361530.774881:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1411 00000100:00100000:1.0:1788361530.797662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361530.797750:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957568 00000100:00100000:2.0:1788361530.797760:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957568 00000100:00100000:2.0:1788361530.797818:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1007 00000100:00100000:2.0:1788361530.797875:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:63597:x1875230406957568:12345-192.168.204.35@tcp:101:multiop.0 00000020:02000000:2.0:1788361530.797883:0:80345:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1788361530.797902:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361530.797924:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d600/0x1b69fa8920fe1f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cc5 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.797992:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798005:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798016:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798031:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798038:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798044:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798219:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798227:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798237:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361530.798274:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:2.0:1788361530.798279:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788361530.798328:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798340:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798348:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798358:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798365:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798371:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361530.798377:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798383:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798396:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:2.0:1788361530.798398:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361530.798402:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798408:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe1f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798427:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798432:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798438:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798442:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361530.798444:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798449:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798454:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff99d12172dd00) 00010000:00010000:2.0:1788361530.798457:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361530.798459:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798463:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1f70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798488:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d600/0x1b69fa8920fe1f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cc5 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798499:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cc5 expref: 7 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361530.798514:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99d12172d200) 00010000:00010000:2.0:1788361530.798516:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361530.798518:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d000, rc 0) 00000100:00100000:2.0:1788361530.798641:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:63597:x1875230406957568:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 769us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361530.798647:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1007 00000100:00100000:0.0:1788361531.222314:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429721088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361531.222410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361531.222669:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721088 00000100:00100000:3.0:1788361531.222682:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721088 00000100:00080000:2.0:1788361531.222736:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361531.222759:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1788361531.222772:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429721088:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1788361531.222780:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788361531.222816:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361531.222925:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429721088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361531.222940:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788361531.223408:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429721216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361531.223441:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429721088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361531.223458:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361531.223602:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721216 00000100:00100000:0.0:1788361531.223608:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721216 00000100:00080000:2.0:1788361531.223661:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361531.223687:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1788361531.223697:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429721216:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1788361531.223705:0:10106:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788361531.223729:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361531.223782:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429721216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361531.223789:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1788361531.223901:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429721216:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788361531.478031:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361532.248103:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429721344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361532.248172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361532.249962:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721344 00000100:00100000:2.0:1788361532.249974:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721344 00000100:00100000:2.0:1788361532.250032:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1788361532.250042:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429721344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361532.250076:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:2.0:1788361532.250145:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429721344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361532.250153:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:1.0:1788361532.250249:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429721344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361532.371314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361532.371565:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957824 00000100:00100000:1.0:1788361532.371576:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957824 00000100:00100000:1.0:1788361532.371644:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1008 00000100:00100000:1.0:1788361532.371654:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:64199:x1875230406957824:12345-192.168.204.35@tcp:36:rm.0 00000100:00080000:0.0:1788361532.371656:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361532.371709:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361532.371739:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe1f77 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cc5 expref: 7 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371759:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99d12172d200) 00010000:00010000:1.0:1788361532.371776:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cbe expref: 6 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371785:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:1.0:1788361532.371791:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361532.371892:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371906:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371922:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371935:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371942:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.371949:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372024:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372031:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372037:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361532.372404:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].2, 64 off8320 00000004:00080000:1.0:1788361532.372414:0:67579:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2572381590301ns, next at 2573381588353ns, rc = 0 00010000:00010000:1.0:1788361532.372467:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372476:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372483:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372499:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372506:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372512:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372568:0:67579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361532.372599:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372605:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372612:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372618:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361532.372622:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372629:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372638:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99d10a2fba00) 00010000:00010000:1.0:1788361532.372640:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788361532.372643:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372658:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1f8c lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372673:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372679:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372684:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372690:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372695:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361532.372698:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372704:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372712:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10a2fb100) 00010000:00010000:1.0:1788361532.372714:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361532.372717:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372723:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1f7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361532.372734:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e84c258d reply state 000000001474ff6c transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372752:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.372758:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff99d10a2fb000) 00010000:00010000:1.0:1788361532.372760:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361532.372763:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361532.372868:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:64199:x1875230406957824:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1214us (1561us total) trans 98784247809 rc 0/0 00000100:00100000:1.0:1788361532.372877:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1008 00010000:00010000:2.0:1788361532.373290:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361532.373297:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.373304:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aace00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361532.373307:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.373322:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.373332:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99d10a2fba00) 00010000:00010000:2.0:1788361532.373334:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361532.373337:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.373343:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1f93 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.373357:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361532.373359:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361532.373361:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361532.503368:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361533.525941:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361534.294348:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429721472:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361534.294516:0:83171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721472 00000100:00100000:0.0:1788361534.294523:0:83171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721472 00000100:00100000:1.0:1788361534.294567:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361534.294573:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429721856:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294604:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.294637:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721856 00000100:00100000:1.0:1788361534.294641:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721856 00000100:00100000:1.0:1788361534.294684:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1788361534.294693:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429721856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294744:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429721856:12345-0@lo:400:kworker.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.294751:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00080000:1.0:1788361534.294770:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361534.294798:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429721856:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294860:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875230429721600:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294890:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.294925:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429722112:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361534.294966:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429721728:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.294971:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429722624:0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.294997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.294997:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361534.295013:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429722240:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295023:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722112 00000100:00100000:1.0:1788361534.295028:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722624 00000100:00100000:3.0:1788361534.295029:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722112 00000100:00100000:1.0:1788361534.295034:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722624 00000100:00100000:2.0:1788361534.295036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361534.295056:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429722752:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295074:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1788361534.295079:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.295083:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1788361534.295087:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429722112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.295094:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429722624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.295108:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721600 00000100:00100000:2.0:1788361534.295111:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721600 00000100:00100000:2.0:1788361534.295154:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721728 00000100:00100000:2.0:1788361534.295158:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721728 00000100:00100000:3.0:1788361534.295166:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429722112:12345-0@lo:400:kworker.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.295168:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429722624:12345-0@lo:400:kworker.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.295177:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:2.0:1788361534.295178:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1788361534.295183:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875230429721600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295194:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:1.0:1788361534.295197:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722240 00000100:00100000:1.0:1788361534.295201:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722240 00000100:00100000:1.0:1788361534.295232:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722752 00000100:00100000:1.0:1788361534.295235:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722752 00000100:00100000:2.0:1788361534.295244:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875230429721600:12345-0@lo:400:kworker.0 Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361534.295256:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1788361534.295268:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1788361534.295273:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429721728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.295300:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429721728:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361534.295305:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1788361534.295321:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:1.0:1788361534.295329:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:2.0:1788361534.295332:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429721728:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295335:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429722240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.295340:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429722752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.295382:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429722624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295393:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429722240:12345-0@lo:400:kworker.0 Request processed in 61us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.295394:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429722752:12345-0@lo:400:kworker.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361534.295401:0:83171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788361534.295404:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429722112:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295409:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1788361534.295414:0:83171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429721472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.295417:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:2.0:1788361534.295421:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875230429721600:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.295455:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429722368:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295461:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429722240:0@lo:400:kworker.0 00000100:00100000:0.0:1788361534.295464:0:83171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429721472:12345-0@lo:400:kworker.0 Request processed in 53us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361534.295470:0:83171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788361534.295490:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788361534.295998:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429722752:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296018:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.296039:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429722880:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.296086:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722368 00000100:00100000:1.0:1788361534.296089:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722368 00000100:00100000:1.0:1788361534.296114:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722880 00000100:00100000:1.0:1788361534.296123:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722880 00000100:00100000:1.0:1788361534.296160:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:1.0:1788361534.296167:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429722368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296196:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429722368:12345-0@lo:400:kworker.0 Request processed in 32us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.296202:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:1.0:1788361534.296213:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:1.0:1788361534.296218:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429722880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296242:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429722880:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.296248:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00080000:1.0:1788361534.296265:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361534.296268:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361534.296271:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361534.296273:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361534.296289:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429722368:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296298:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968745 gen 2 00000100:00100000:1.0:1788361534.296309:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429722880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.296611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361534.296632:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296647:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429721984 00000100:00100000:1.0:1788361534.296651:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429721984 00000100:00100000:2.0:1788361534.296653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361534.296680:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429723008:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296686:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429722496 00000100:00100000:1.0:1788361534.296688:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429722496 00000100:00100000:2.0:1788361534.296702:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361534.296800:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723008 00000100:00100000:1.0:1788361534.296804:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723008 00000100:00100000:3.0:1788361534.296812:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1788361534.296820:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429721472:0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296844:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1788361534.296849:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429721984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296854:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429722496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.296863:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1788361534.296869:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429723008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361534.296897:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429722496:12345-0@lo:400:kworker.0 Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.296910:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1788361534.296914:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429721984:12345-0@lo:400:kworker.0 Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361534.296916:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429723008:12345-0@lo:400:kworker.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361534.296931:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1788361534.296937:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1788361534.296976:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429721984:0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.296992:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429722496:0@lo:400:kworker.0 00000100:00100000:2.0:1788361534.297002:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429723008:0@lo:400:kworker.0 00000100:00080000:2.0:1788361534.297030:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361534.345279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361534.345316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361534.345340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361534.345369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361534.345391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361534.345419:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958464 00000100:00100000:3.0:1788361534.345430:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958464 00000100:00100000:3.0:1788361534.345585:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958336 00000100:00100000:3.0:1788361534.345589:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958336 00000100:00100000:3.0:1788361534.345615:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1764 00000100:00100000:3.0:1788361534.345624:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406958464:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361534.345693:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406958464:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361534.345701:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1764 00000100:00100000:3.0:1788361534.345715:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1765 00000100:00100000:3.0:1788361534.345721:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406958336:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361534.345744:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406958336:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361534.345750:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1765 00000100:00100000:1.0:1788361534.346204:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958208 00000100:00100000:1.0:1788361534.346209:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958208 00000100:00100000:1.0:1788361534.346248:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958080 00000100:00100000:1.0:1788361534.346251:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958080 00000100:00100000:1.0:1788361534.346291:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 756 00000100:00100000:1.0:1788361534.346300:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406958208:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361534.346322:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 757 00000100:00100000:3.0:1788361534.346334:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230406958080:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361534.346339:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406958208:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361534.346349:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 756 00000100:00100000:3.0:1788361534.346374:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230406958080:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 42us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361534.346382:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 757 00000100:00100000:2.0:1788361534.346468:0:83169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406957952 00000100:00100000:2.0:1788361534.346473:0:83169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406957952 00000100:00100000:2.0:1788361534.346509:0:83169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00100000:2.0:1788361534.346517:0:83169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2411:x1875230406957952:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361534.346545:0:83169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2411:x1875230406957952:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361534.346551:0:83169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00080000:3.0:1788361534.346601:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361534.346606:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361534.346609:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361534.346611:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788361534.550236:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361534.805992:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361534.806019:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429723136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361534.806089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361534.806139:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723136 00000100:00100000:3.0:1788361534.806161:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723136 00000100:00100000:3.0:1788361534.806317:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1788361534.806327:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429723136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361534.806355:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361534.806411:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429723136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361534.806419:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788361534.806524:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429723136:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788361534.806998:0:83184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2574816173597ns, next at 2575816171027ns, rc = 0 00000100:00100000:2.0:1788361534.807006:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361534.807017:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361534.807044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361534.807154:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723264 00000100:00100000:3.0:1788361534.807158:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723264 00000100:00100000:3.0:1788361534.807191:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1788361534.807199:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429723264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361534.807217:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361534.807287:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429723264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361534.807293:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788361534.807313:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361535.319240:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429723392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361535.319369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361535.319454:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723392 00000100:00100000:0.0:1788361535.319462:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723392 00000100:00100000:0.0:1788361535.319514:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1788361535.319524:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429723392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788361535.319558:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:0.0:1788361535.319699:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429723392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361535.319707:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:2.0:1788361535.319776:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429723392:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788361535.501437:0:83894:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 11:05:34 (1788361534) 00010000:00010000:3.0:1788361535.576798:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788361535.919626:0:83164:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788361535.919762:0:83164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:2.0:1788361535.919771:0:83164:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788361535.919779:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361535.919802:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429723520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788361535.919887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361535.919912:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.919926:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.919934:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.919940:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361535.919952:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.919960:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.919978:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff99d10a2fb000) 00010000:00010000:3.0:1788361535.919982:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361535.919987:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.919993:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1f85 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361535.920093:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723520 00000100:00100000:2.0:1788361535.920102:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723520 00000100:00100000:2.0:1788361535.920166:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4858 00000100:00100000:2.0:1788361535.920177:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429723520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788361535.920214:0:26163:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1698 count 1 00010000:00010000:2.0:1788361535.920238:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.920258:0:26163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 5 pid: 26171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.920264:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=205s v=(0 0) 00010000:00010000:2.0:1788361535.920267:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361535.920271:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.920293:0:26163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 5 pid: 26171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.920303:0:26163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 5 pid: 26171 timeout: 2675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361535.920313:0:26163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:26163:1875230429723648:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361535.920389:0:26163:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1039296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361535.924162:0:26163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:26163:1875230429723648:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361535.924192:0:26163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361535.925865:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361535.926697:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958592 00000100:00100000:3.0:1788361535.926707:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958592 00010000:00010000:3.0:1788361535.926747:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 6 pid: 26171 timeout: 2675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361535.926798:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2578 00000100:00100000:3.0:1788361535.926809:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406958592:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361535.926852:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361535.926860:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 6 pid: 26171 timeout: 2675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.926876:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 6 pid: 26171 timeout: 2675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.926903:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe1b3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c8d expref: 6 pid: 26171 timeout: 2675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.926926:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361535.926944:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361535.926952:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.926963:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.926993:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361535.927022:0:26163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.927035:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.927046:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361535.927054:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406958592:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 244us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361535.927069:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2578 00010000:00010000:2.0:1788361535.927277:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361535.927300:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361535.927325:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361535.927389:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.927400:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715da00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361535.927404:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.927415:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.927428:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.927448:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079cf8b21/0x1b69fa8920fe1f9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361535.927470:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361535.927473:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361535.927475:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361535.928258:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429723520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8079us (8368us total) trans 4294968746 rc 0/0 00000004:00080000:0.0:1788361535.928262:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d1170dfb80/2, rc 0, transno 4294968746 00000100:00100000:2.0:1788361535.928269:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4858 00000100:00100000:0.0:1788361535.928283:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429723520:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788361535.929916:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968746 is committed 00000100:00100000:3.0:1788361535.946084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361535.946141:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958720 00000100:00100000:1.0:1788361535.946152:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958720 00000100:00100000:1.0:1788361535.946210:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1009 00000100:00100000:1.0:1788361535.946223:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+5:64786:x1875230406958720:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361535.946246:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361535.946269:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ccc expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361535.946341:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361535.946356:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361535.946376:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361535.946422:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361535.946426:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1788361535.946445:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361535.946470:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ccc expref: 7 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361535.946486:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ccc expref: 6 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361535.946494:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d108901200) 00010000:00010000:1.0:1788361535.946497:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361535.946500:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aadc00, rc 0) 00000100:00100000:1.0:1788361535.946553:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:64786:x1875230406958720:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 334us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361535.946561:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1009 00000100:00100000:0.0:1788361535.950727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361535.950915:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958848 00000100:00100000:1.0:1788361535.950925:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958848 00000100:00100000:1.0:1788361535.950989:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1010 00000100:00100000:1.0:1788361535.951000:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:64786:x1875230406958848:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361535.951031:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:1.0:1788361535.951102:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:64786:x1875230406958848:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 104us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361535.951129:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1010 00000100:00100000:3.0:1788361535.952754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361535.952877:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406958976 00000100:00100000:1.0:1788361535.952886:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406958976 00000100:00100000:1.0:1788361535.952936:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1011 00000100:00100000:1.0:1788361535.952949:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:64786:x1875230406958976:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361535.952983:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361535.953050:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:64786:x1875230406958976:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361535.953057:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1011 00000100:00100000:3.0:1788361535.956456:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361535.956518:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959104 00000100:00100000:0.0:1788361535.956528:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959104 00000100:00100000:0.0:1788361535.956582:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1416 00000100:00100000:0.0:1788361535.956595:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:64786:x1875230406959104:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361535.956689:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361535.956800:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:64786:x1875230406959104:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 209us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361535.956808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1416 00000100:00100000:0.0:1788361535.961178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361535.961288:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959232 00000100:00100000:1.0:1788361535.961303:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959232 00000100:00100000:1.0:1788361535.961359:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1417 00000100:00100000:1.0:1788361535.961370:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:64786:x1875230406959232:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361535.961396:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361535.961475:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:64786:x1875230406959232:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361535.961483:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1417 00000100:00100000:3.0:1788361535.987616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361535.987875:0:66136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959360 00000100:00100000:0.0:1788361535.987885:0:66136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959360 00000100:00100000:0.0:1788361535.987939:0:66136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:0.0:1788361535.987950:0:66136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fe6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ec302d84-8f96-49d3-8682-aefc474f8448+6:64793:x1875230406959360:12345-192.168.204.35@tcp:700:mcreate.0 00000100:00100000:0.0:1788361535.988027:0:66136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fe6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ec302d84-8f96-49d3-8682-aefc474f8448+6:64793:x1875230406959360:12345-192.168.204.35@tcp:700:mcreate.0 Request processed in 79us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361535.988035:0:66136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788361535.990573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361535.990907:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959616 00000100:00100000:0.0:1788361535.990917:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959616 00000100:00100000:0.0:1788361535.990977:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1012 00000100:00100000:0.0:1788361535.990987:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:64793:x1875230406959616:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00010000:0.0:1788361535.991041:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361535.991069:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ccc expref: 6 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.991123:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d108901200) 00010000:00010000:0.0:1788361535.991135:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361535.991201:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.991213:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.991223:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.991239:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.991247:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.991254:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992235:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992247:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992254:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992261:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361535.992266:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992282:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992298:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:0.0:1788361535.992302:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361535.992306:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992313:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2400/0x1b69fa8920fe1faf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361535.992330:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052687126 reply state 00000000708f2d4e transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992341:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361535.992348:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d103a4c000) 00010000:00010000:0.0:1788361535.992351:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361535.992354:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361535.992526:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:64793:x1875230406959616:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 1536us (1957us total) trans 98784247810 rc 0/0 00000100:00100000:0.0:1788361535.992536:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1012 00000100:00100000:1.0:1788361536.018341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361536.018730:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959744 00000100:00100000:2.0:1788361536.018740:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959744 00000100:00080000:3.0:1788361536.018791:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361536.018839:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1013 00000100:00100000:2.0:1788361536.018851:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:64796:x1875230406959744:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788361536.018875:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361536.018897:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cd3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.018959:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.018973:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.018996:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361536.019054:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361536.019058:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788361536.019079:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.019099:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe1fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cd3 expref: 9 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.019126:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cd3 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.019135:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d136ce8e00) 00010000:00010000:2.0:1788361536.019138:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361536.019141:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c800, rc 0) 00000100:00100000:2.0:1788361536.019857:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:64796:x1875230406959744:12345-192.168.204.35@tcp:101:rm.0 Request processed in 1005us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361536.019866:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1013 00000100:00100000:3.0:1788361536.021987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361536.022674:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959872 00000100:00100000:1.0:1788361536.022684:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959872 00000100:00100000:1.0:1788361536.022748:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1014 00000100:00100000:1.0:1788361536.022759:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:64796:x1875230406959872:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:1.0:1788361536.022780:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361536.022799:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cda expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.022897:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.022910:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.022920:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.022930:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.022937:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.022943:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023024:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023032:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023037:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361536.023077:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:1.0:1788361536.023081:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1788361536.023098:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023136:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023146:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023152:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023158:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023164:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023170:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361536.023173:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023179:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023191:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d136ce8e00) 00010000:00010000:1.0:1788361536.023193:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361536.023197:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023203:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac400/0x1b69fa8920fe1fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023229:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023242:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023248:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023252:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361536.023256:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023263:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023271:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d103a4c000) 00010000:00010000:1.0:1788361536.023274:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361536.023277:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023282:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe1fd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023307:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe1fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cda expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023320:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cda expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.023326:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99d108901000) 00010000:00010000:1.0:1788361536.023329:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361536.023337:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aadc00, rc 0) 00000100:00100000:1.0:1788361536.023409:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+9:64796:x1875230406959872:12345-192.168.204.35@tcp:101:rm.0 Request processed in 651us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361536.023417:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1014 00000100:00100000:3.0:1788361536.027585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361536.027637:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960128 00000100:00100000:1.0:1788361536.027647:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960128 00000100:00100000:1.0:1788361536.027724:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1015 00000100:00100000:1.0:1788361536.027736:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+9:64796:x1875230406960128:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:1.0:1788361536.027792:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361536.027925:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe1fe0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cda expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.027954:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99d108901000) 00010000:00010000:1.0:1788361536.027970:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe1fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cd3 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.027977:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d136ce8e00) 00010000:00010000:1.0:1788361536.027982:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361536.028010:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028019:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028026:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028032:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028059:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028064:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028146:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028155:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028163:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028403:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028410:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028415:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028420:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028425:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028428:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028477:0:66128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361536.028494:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028498:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028502:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028505:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361536.028508:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028513:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028518:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99d108901900) 00010000:00010000:1.0:1788361536.028520:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788361536.028522:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028526:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe1ff5 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028539:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028544:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028549:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028561:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028566:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361536.028569:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028575:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028583:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d108901600) 00010000:00010000:1.0:1788361536.028585:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361536.028588:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028594:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe1fe7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361536.028606:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021ff0657 reply state 00000000407a3040 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028617:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361536.028623:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d103a4c000) 00010000:00010000:1.0:1788361536.028625:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361536.028628:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361536.028644:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361536.028651:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.028657:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361536.028660:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.028666:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361536.028729:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99d108901900) 00010000:00010000:2.0:1788361536.028788:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361536.028793:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361536.028794:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+9:64796:x1875230406960128:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1061us (1217us total) trans 98784247811 rc 0/0 00010000:00010000:2.0:1788361536.028800:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe1ffc lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361536.028802:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1015 00010000:00010000:2.0:1788361536.028816:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361536.028818:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361536.028851:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361536.342998:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429723776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361536.342998:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429723904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361536.343082:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361536.343170:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723776 00000100:00100000:3.0:1788361536.343178:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723776 00000100:00100000:3.0:1788361536.343239:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1788361536.343249:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429723776:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361536.343257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788361536.343280:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788361536.343303:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361536.343323:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429723904 00000100:00100000:2.0:1788361536.343328:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429723904 00000100:00080000:2.0:1788361536.343366:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361536.343388:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1788361536.343396:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429723904:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361536.343401:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429723776:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361536.343410:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361536.343592:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429723776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 344us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361536.343601:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788361536.343616:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429723904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 219us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361536.343624:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:2.0:1788361536.343637:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429723904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788361536.597928:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361537.367336:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429724032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361537.367412:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361537.367456:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724032 00000100:00100000:2.0:1788361537.367463:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724032 00000100:00100000:2.0:1788361537.367555:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1788361537.367565:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429724032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361537.367598:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:2.0:1788361537.367646:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429724032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361537.367654:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1788361537.367756:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429724032:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788361537.623037:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361538.645981:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361539.319207:0:84289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788361539.353276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361539.354800:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960256 00000100:00100000:2.0:1788361539.354813:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960256 00000100:00100000:2.0:1788361539.354913:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1016 00000100:00100000:2.0:1788361539.354923:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+9:64863:x1875230406960256:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361539.354947:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.354977:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe2003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ce1 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.355056:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c000/0x1b69fa8920fe200a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.355070:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c000/0x1b69fa8920fe200a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.355084:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c000/0x1b69fa8920fe200a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788361539.355087:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788361539.355129:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361539.355135:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788361539.355154:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c000/0x1b69fa8920fe200a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.355179:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe2003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ce1 expref: 11 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.355195:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c000/0x1b69fa8920fe200a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ce1 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.355203:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d12172d700) 00010000:00010000:2.0:1788361539.355213:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361539.355218:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c000, rc 0) 00010000:00000080:2.0:1788361539.355225:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10778ce00 x1875230406960256/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:600/0 lens 576/688 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361539.355301:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+10:64863:x1875230406960256:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 380us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.355309:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1016 00000100:00100000:3.0:1788361539.357776:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361539.357877:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960384 00000100:00100000:0.0:1788361539.357888:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960384 00000100:00100000:0.0:1788361539.357939:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1017 00000100:00100000:0.0:1788361539.357950:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:64863:x1875230406960384:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788361539.357969:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.357989:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2600/0x1b69fa8920fe2011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ce8 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358057:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358070:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358080:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358094:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358102:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358109:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358150:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358157:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358174:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358180:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358185:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361539.358190:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358197:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358208:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d12172d700) 00010000:00010000:0.0:1788361539.358211:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.358215:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358221:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3200/0x1b69fa8920fe2018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358232:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358237:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358243:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358248:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361539.358258:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358264:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358273:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d103a4c700) 00010000:00010000:0.0:1788361539.358276:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.358278:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358284:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d3400/0x1b69fa8920fe201f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358314:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2600/0x1b69fa8920fe2011 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ce8 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358323:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d12172d700) 00010000:00010000:0.0:1788361539.358325:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.358329:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2600/0x1b69fa8920fe2011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ce8 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.358337:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d2600, rc 0) 00010000:00000080:0.0:1788361539.358344:0:66127:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d118594a80 x1875230406960384/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:600/0 lens 592/584 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361539.358409:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:64863:x1875230406960384:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 461us (643us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361539.358416:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1017 00000100:00100000:0.0:1788361539.362404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361539.362491:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960640 00000100:00100000:2.0:1788361539.362506:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960640 00000100:00100000:2.0:1788361539.362572:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1018 00000100:00100000:2.0:1788361539.362582:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:64863:x1875230406960640:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361539.362602:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.362606:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361539.362633:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c000/0x1b69fa8920fe200a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ce1 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362652:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d12172d700) 00010000:00010000:2.0:1788361539.362663:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361539.362677:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d600/0x1b69fa8920fe2026 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cef expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362780:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362794:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362804:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362852:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362861:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.362869:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363264:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363274:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363281:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.363290:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361539.363315:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363322:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363329:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363335:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361539.363339:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363358:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363367:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d12172de00) 00010000:00010000:2.0:1788361539.363370:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.363374:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363380:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c800/0x1b69fa8920fe202d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361539.363390:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006077b3da reply state 00000000154fcfea transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363400:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363407:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d12172d300) 00010000:00010000:2.0:1788361539.363409:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361539.363412:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361539.363435:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d600/0x1b69fa8920fe2026 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 12 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363453:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.363460:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99d12172db00) 00010000:00010000:2.0:1788361539.363463:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361539.363465:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d200, rc 0) 00010000:00000080:2.0:1788361539.363480:0:80345:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1172a4e00 x1875230406960640/t98784247812(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:600/0 lens 536/608 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361539.363555:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+12:64863:x1875230406960640:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 974us (1161us total) trans 98784247812 rc 0/0 00000100:00100000:2.0:1788361539.363563:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1018 00000100:00100000:0.0:1788361539.367566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361539.367652:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960896 00000100:00100000:1.0:1788361539.367665:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960896 00000100:00100000:1.0:1788361539.367725:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1019 00000100:00100000:1.0:1788361539.367735:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+12:64863:x1875230406960896:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361539.367760:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361539.367783:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe2049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cf6 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361539.367908:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361539.367921:0:66901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 13 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361539.367930:0:66901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361539.367962:0:66901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 13 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361539.367975:0:66901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 13 pid: 80345 timeout: 2679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361539.368003:0:66901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137404700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66901:1875230429724160:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788361539.368101:0:66901:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361539.373447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361539.373481:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961024 00000100:00100000:3.0:1788361539.373487:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961024 00010000:00010000:3.0:1788361539.373555:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 14 pid: 80345 timeout: 2679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361539.373587:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2579 00000100:00100000:3.0:1788361539.373601:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec302d84-8f96-49d3-8682-aefc474f8448+14:2410:x1875230406961024:12345-192.168.204.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788361539.373601:0:66901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137404700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66901:1875230429724160:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788361539.373617:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361539.373624:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 14 pid: 80345 timeout: 2679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.373640:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 14 pid: 80345 timeout: 2679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.374165:0:66901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374221:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d200/0x1b69fa8920fe203b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 14 pid: 80345 timeout: 2679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374239:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99d12172db00) 00010000:00010000:3.0:1788361539.374244:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374254:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374261:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.374437:0:66901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374438:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361539.374448:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.374469:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000100:00100000:3.0:1788361539.374540:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec302d84-8f96-49d3-8682-aefc474f8448+13:2410:x1875230406961024:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 943us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361539.374549:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2579 00010000:00010000:3.0:1788361539.374784:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374793:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374800:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374806:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aadc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361539.374811:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374959:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374973:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99d12172db00) 00010000:00010000:3.0:1788361539.374976:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361539.374982:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.374988:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe2050 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.375075:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe2049 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cf6 expref: 13 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.375098:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d108901400) 00010000:00010000:3.0:1788361539.375101:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361539.375105:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe2049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cf6 expref: 13 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361539.375118:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aace00, rc 0) 00010000:00000080:3.0:1788361539.375127:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed5c00 x1875230406960896/t98784247813(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:600/0 lens 712/824 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361539.375179:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+12:64863:x1875230406960896:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 7445us (7629us total) trans 98784247813 rc 301/301 00000100:00100000:3.0:1788361539.375187:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1019 00000100:00100000:3.0:1788361539.377030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361539.377143:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961280 00000100:00100000:1.0:1788361539.377151:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961280 00000100:00100000:1.0:1788361539.377204:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:1.0:1788361539.377215:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+12:64863:x1875230406961280:12345-192.168.204.35@tcp:35:lfs.0 00010000:00000080:1.0:1788361539.377462:0:66130:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d118595f80 x1875230406961280/t98784247814(0) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:600/0 lens 392/456 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361539.377528:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+13:64863:x1875230406961280:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 316us (504us total) trans 98784247814 rc 0/0 00000100:00100000:1.0:1788361539.377537:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:1.0:1788361539.378714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361539.378914:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961536 00000100:00100000:2.0:1788361539.378922:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961536 00000100:00100000:2.0:1788361539.379013:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 214 00000100:00100000:2.0:1788361539.379024:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+13:64863:x1875230406961536:12345-192.168.204.35@tcp:35:lfs.0 00010000:00000080:2.0:1788361539.379191:0:66129:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d108a2bc50 x1875230406961536/t98784247815(0) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:600/0 lens 392/456 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361539.379239:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+14:64863:x1875230406961536:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 218us (530us total) trans 98784247815 rc 0/0 00000100:00100000:2.0:1788361539.379247:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 214 00000100:00100000:0.0:1788361539.415585:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361539.415627:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.415629:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.415697:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875230429724416:0@lo:400:kworker.0 00000100:00100000:1.0:1788361539.415743:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429724800:0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.415879:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361539.415887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361539.415928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361539.415966:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429725056:0@lo:400:kworker.0 00000100:00100000:0.0:1788361539.415983:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.415984:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361539.416011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361539.416017:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429724928:0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.416057:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429725568:0@lo:400:kworker.0 00000100:00100000:0.0:1788361539.416069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361539.416094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361539.416110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361539.416112:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429725184:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416124:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429725440:0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.416171:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725056 00000100:00100000:3.0:1788361539.416181:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361539.416181:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725056 00000100:00100000:0.0:1788361539.416190:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361539.416229:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429725696:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416243:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724544 00000100:00100000:3.0:1788361539.416250:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724544 00000100:00100000:2.0:1788361539.416254:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725568 00000100:00100000:2.0:1788361539.416260:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725568 00000100:00100000:0.0:1788361539.416269:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361539.416349:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724800 00000100:00100000:3.0:1788361539.416354:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724800 00000100:00100000:2.0:1788361539.416365:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725184 00000100:00100000:2.0:1788361539.416370:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725184 00000100:00100000:3.0:1788361539.416382:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724416 00000100:00100000:3.0:1788361539.416387:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724416 00000100:00100000:2.0:1788361539.416411:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725696 00000100:00100000:2.0:1788361539.416415:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725696 00000100:00100000:3.0:1788361539.416417:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724672 00000100:00100000:3.0:1788361539.416428:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724672 00000100:00100000:0.0:1788361539.416442:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1788361539.416453:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1788361539.416454:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429725312:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416469:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1788361539.416479:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429725056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361539.416485:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416487:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429724800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361539.416499:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361539.416521:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429725824:0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.416551:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429725056:12345-0@lo:400:kworker.0 Request processed in 90us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.416559:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1788361539.416576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361539.416584:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429724800:12345-0@lo:400:kworker.0 Request processed in 104us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.416586:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:0.0:1788361539.416596:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429724544:12345-0@lo:400:kworker.0 Request processed in 126us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.416605:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429725568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416608:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1788361539.416618:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429724800:0@lo:400:kworker.0 00000100:00100000:0.0:1788361539.416629:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1788361539.416632:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725312 00000100:00100000:3.0:1788361539.416639:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725312 00000100:00100000:2.0:1788361539.416659:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429725568:12345-0@lo:400:kworker.0 Request processed in 58us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361539.416664:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725824 00000100:00100000:3.0:1788361539.416673:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1788361539.416673:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:0.0:1788361539.416676:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725824 00000100:00100000:1.0:1788361539.416683:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1788361539.416686:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875230429724416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.416694:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:1.0:1788361539.416696:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429724672:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788361539.416703:0:80345:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d110606300 x1875230429724416/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1788361550 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361539.416706:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429725184:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788361539.416712:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d005585500 x1875230429724672/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1788361550 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361539.416727:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1788361539.416740:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429725312:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788361539.416760:0:66127:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d137405500 x1875230429725312/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1788361550 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361539.416762:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875230429724416:12345-0@lo:400:kworker.0 Request processed in 77us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.416773:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429725184:12345-0@lo:400:kworker.0 Request processed in 66us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361539.416775:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429724672:12345-0@lo:400:kworker.0 Request processed in 79us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361539.416783:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1788361539.416787:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:1.0:1788361539.416788:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1788361539.416801:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1788361539.416810:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:3.0:1788361539.416812:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429725824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.416818:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429725696:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788361539.416845:0:80345:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d137404700 x1875230429725824/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1788361550 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361539.416879:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429725696:12345-0@lo:400:kworker.0 Request processed in 62us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.416888:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:3.0:1788361539.416890:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429725824:12345-0@lo:400:kworker.0 Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361539.416899:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:1.0:1788361539.416916:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429725824:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416923:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724928 00000100:00100000:3.0:1788361539.416928:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724928 00000100:00100000:2.0:1788361539.416928:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429725056:0@lo:400:kworker.0 00000100:00100000:2.0:1788361539.416945:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429725568:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416957:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725440 00000100:00100000:2.0:1788361539.416958:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.416962:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725440 00000100:00100000:1.0:1788361539.416967:0:83174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429724288 00000100:00100000:1.0:1788361539.416970:0:83174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429724288 00000100:00100000:3.0:1788361539.416986:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:1.0:1788361539.416994:0:83174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788361539.416997:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429724928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361539.416999:0:83174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429724288:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788361539.417009:0:8448:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1365cb100 x1875230429724928/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1788361550 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361539.417031:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429724928:12345-0@lo:400:kworker.0 Request processed in 34us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361539.417034:0:83174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429724288:12345-0@lo:400:kworker.0 Request processed in 35us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361539.417047:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:1.0:1788361539.417052:0:83174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788361539.417059:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1788361539.417065:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429725440:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361539.417096:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361539.417101:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429725440:12345-0@lo:400:kworker.0 Request processed in 32us (932us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361539.417104:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361539.417107:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361539.417108:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00080000:1.0:1788361539.417112:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361539.417150:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429725312:12345-0@lo:400:kworker.0 Request processed in 412us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361539.417152:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429724672:0@lo:400:kworker.0 00000100:00100000:1.0:1788361539.417176:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429725184:0@lo:400:kworker.0 00000100:00100000:0.0:1788361539.417179:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1788361539.417267:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875230429724416:0@lo:400:kworker.0 00000100:00100000:0.0:1788361539.417379:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429725312:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.417440:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429724928:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.417455:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429725440:0@lo:400:kworker.0 00000100:00100000:1.0:1788361539.417704:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968746 gen 2 00000004:00080000:1.0:1788361539.417711:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d1170dfb80, transno 4294968746 00000100:00100000:1.0:1788361539.417731:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429725696:0@lo:400:kworker.0 00000100:00100000:1.0:1788361539.417744:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429724288:0@lo:400:kworker.0 00000100:00100000:3.0:1788361539.463728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361539.463781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361539.463817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361539.463886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361539.463899:0:83169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961664 00000100:00100000:0.0:1788361539.463910:0:83169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961664 00000100:00100000:3.0:1788361539.463921:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406962048 00000100:00100000:3.0:1788361539.463927:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406962048 00000100:00100000:1.0:1788361539.463948:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961792 00000100:00100000:1.0:1788361539.463954:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961792 00000100:00100000:2.0:1788361539.463957:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961920 00000100:00100000:2.0:1788361539.463963:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961920 00000100:00100000:0.0:1788361539.463980:0:83169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 156 00000100:00100000:3.0:1788361539.463984:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1770 00000100:00100000:0.0:1788361539.463997:0:83169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406961664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361539.463999:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406962048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361539.464013:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1771 00000100:00100000:1.0:1788361539.464014:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 764 00000100:00100000:2.0:1788361539.464021:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406961920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361539.464053:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406961792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361539.464091:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406962048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.464092:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406961920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361539.464093:0:83169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406961664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361539.464096:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406961792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 56us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.464115:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1771 00000100:00100000:1.0:1788361539.464117:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 764 00000100:00100000:0.0:1788361539.464117:0:83169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 156 00000100:00100000:3.0:1788361539.464126:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1770 00000100:00080000:1.0:1788361539.464166:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361539.464172:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361539.464175:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788361539.669941:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361539.926158:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361539.926193:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429725952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361539.926295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361539.926358:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429725952 00000100:00100000:0.0:1788361539.926368:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429725952 00000100:00100000:0.0:1788361539.926436:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1788361539.926450:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429725952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361539.926500:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361539.926573:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429725952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361539.926581:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1788361539.926875:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429725952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361539.926902:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429726080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361539.926931:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361539.927012:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726080 00000100:00100000:3.0:1788361539.927018:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726080 00000100:00100000:3.0:1788361539.927100:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1788361539.927109:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429726080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361539.927128:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361539.927189:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429726080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361539.927196:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788361539.927270:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429726080:0@lo:13:osp-pre-0-0.0 00000020:01000004:3.0:1788361540.278090:0:84386:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788361540.278230:0:84386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361540.278248:0:84386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361540.278257:0:84386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361540.278265:0:84386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361540.278290:0:84386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788361540.278296:0:84386:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788361540.278300:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361540.278309:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.278319:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe600 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361540.278323:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361540.278325:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361540.278331:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788361540.278335:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361540.278338:0:84386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:1.0:1788361540.278347:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361540.278364:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d002de9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:1.0:1788361540.278366:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361540.278369:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788361540.278372:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788361540.278404:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429726208:0@lo:39:umount.0 00010000:00010000:1.0:1788361540.278404:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.278417:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361540.278437:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.278445:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fe600/0x1b69fa8920fe1c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c60 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.278464:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361540.278467:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361540.278469:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361540.278477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361540.278484:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429726336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361540.278522:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361540.278576:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726208 00000100:00100000:1.0:1788361540.278583:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726208 00000100:00100000:1.0:1788361540.278679:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1788361540.278689:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429726208:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788361540.278713:0:66128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1d78 00000100:00080000:1.0:1788361540.278721:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d137f10800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788361540.278751:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1365c8700 x1875230429726208/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:601/0 lens 224/224 e 0 to 0 dl 1788361551 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361540.278801:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875230429726208:12345-0@lo:39:umount.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361540.278817:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000020:00000080:1.0:1788361540.278848:0:66128:0:(genops.c:906:class_export_put()) final put ffff99d137f15000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788361540.278950:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361540.278965:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726336 00000100:00100000:3.0:1788361540.278969:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726336 00000100:00100000:3.0:1788361540.279006:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1788361540.279014:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429726336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361540.279035:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361540.279049:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d005309000/0x1b69fa8920fe1c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1c59 expref: 24 pid: 83171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361540.279061:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361540.279091:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429726336:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361540.279097:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1788361540.279515:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429726336:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788361540.279545:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002de9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361540.279553:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429726208:0@lo:39:umount.0 00000020:00000080:1.0:1788361540.279571:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f15000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361540.279612:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137f10800 for lustre-MDT0000 00000100:00080000:0.0:1788361540.281001:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361540.281011:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361540.281030:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788361540.283934:0:84386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.283956:0:84386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.283966:0:84386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.283975:0:84386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284035:0:84386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361540.284044:0:84386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284054:0:84386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284062:0:84386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284068:0:84386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284135:0:84386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361540.284146:0:84386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284155:0:84386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284163:0:84386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284170:0:84386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284232:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361540.284241:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284250:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005309800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361540.284254:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284264:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361540.284272:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361540.284278:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361540.284281:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788361540.284325:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284332:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361540.284364:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284379:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d005309800/0x1b69fa8920fe1b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1b87 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284398:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361540.284402:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284408:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361540.284412:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284420:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361540.284427:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361540.284432:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361540.284435:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788361540.284440:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788361540.284463:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284469:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361540.284493:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284500:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aac800/0x1b69fa8920fe1c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284528:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361540.284532:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284609:0:84386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361540.284618:0:84386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284632:0:84386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284638:0:84386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284645:0:84386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.284661:0:84386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361540.284665:0:84386:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788361540.284669:0:84386:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788361540.284704:0:84386:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788361540.284709:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788361540.284715:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788361540.284722:0:84386:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788361540.284801:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361540.284813:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.284855:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361540.284861:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.284872:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284877:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361540.284885:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284894:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361540.284917:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361540.284921:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361540.284930:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361540.284939:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788361540.284940:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361540.284944:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788361540.284946:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788361540.284953:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788361540.284970:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284979:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361540.284987:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.284993:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe1c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1c52 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.284995:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.285017:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361540.285031:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361540.285036:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.285046:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361540.285048:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.285057:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371ff800/0x1b69fa8920fe1b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe1b79 expref: -99 pid: 83163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.285073:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361540.285074:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429726592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361540.285077:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.285082:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361540.285167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361540.285228:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726592 00000100:00100000:2.0:1788361540.285236:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726592 00000100:00100000:1.0:1788361540.285245:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361540.285255:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429726720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361540.285286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361540.285304:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726720 00000100:00100000:2.0:1788361540.285310:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726720 00000100:00100000:2.0:1788361540.285347:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1788361540.285364:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429726592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361540.285377:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361540.285395:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d005308c00/0x1b69fa8920fe1c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1c83 expref: 24 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.285427:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361540.285519:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3650:x1875230429726592:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361540.285532:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1788361540.285552:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1788361540.285558:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429726720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361540.285565:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361540.285574:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ee00/0x1b69fa8920fe1c52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1c4b expref: 22 pid: 83171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.285583:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361540.285605:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3650:x1875230429726720:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361540.285611:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00010000:00010000:3.0:1788361540.285671:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361540.286170:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429726464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361540.286230:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361540.286321:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361540.286332:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429726848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361540.286369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361540.286426:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726464 00000100:00100000:3.0:1788361540.286434:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726464 00000100:00100000:3.0:1788361540.286490:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726848 00000100:00100000:3.0:1788361540.286495:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726848 00000100:00100000:3.0:1788361540.287091:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1788361540.287115:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3653:x1875230429726464:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361540.287128:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00010000:00010000:3.0:1788361540.287131:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361540.287159:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3653:x1875230429726848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361540.287169:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f600/0x1b69fa8920fe1b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1b80 expref: 22 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.287177:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361540.287188:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361540.287201:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1371fe400/0x1b69fa8920fe1b79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1b6b expref: 21 pid: 83169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361540.287212:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429726720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361540.287218:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361540.287236:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429726592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361540.287247:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3653:x1875230429726464:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361540.287261:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1788361540.287281:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3653:x1875230429726848:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361540.287292:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1788361540.287312:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429726848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361540.287324:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429726464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361540.287372:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1788361540.288615:0:84386:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788361540.290380:0:83164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:0.0:1788361540.290475:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290492:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290501:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290508:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361540.290514:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290549:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290574:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d103a4c000) 00010000:00010000:0.0:1788361540.290577:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361540.290584:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290591:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1364d2e00/0x1b69fa8920fe1fb6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290612:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290619:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290625:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290631:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361540.290634:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290640:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290648:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d103a4c000) 00010000:00010000:0.0:1788361540.290651:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361540.290654:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290667:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe1fee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290707:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290714:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290720:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290725:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361540.290728:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290735:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290744:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d12172d300) 00010000:00010000:0.0:1788361540.290746:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361540.290750:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361540.290756:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe2034 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361540.291113:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788361540.291124:0:84386:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d002096000 ec302d84-8f96-49d3-8682-aefc474f8448 192.168.204.35@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 98784247815 stale:0 00000020:00080000:3.0:1788361540.291132:0:84386:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d137f16800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361540.291136:0:84386:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d00541b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361540.291141:0:84386:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d12c4e5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361540.291147:0:84386:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d002ff9000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361540.291152:0:84386:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99d136cb19c0) has exports, disconnecting them 00000020:00080000:3.0:1788361540.291158:0:84386:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.35@tcp (ffff99d002096000), last request at 1788361539 00000020:00000080:3.0:1788361540.291167:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1f46 00000100:00080000:3.0:1788361540.291184:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d002091800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788361540.291214:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d002096000): rc 0 00000020:00000080:3.0:1788361540.291218:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d002096000/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00080000:3.0:1788361540.291237:0:84386:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d137f16800), last request at 1788361342 00000020:00000080:3.0:1788361540.291240:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1d71 00000100:00080000:3.0:1788361540.291245:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d137f14000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788361540.291257:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d137f16800): rc 0 00000020:00000080:3.0:1788361540.291268:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d137f16800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788361540.291275:0:84386:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d00541b800), last request at 1788361539 00000020:00000080:3.0:1788361540.291280:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1d6a 00000020:00000080:2.0:1788361540.291281:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002096000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-MDT0000 00000100:00080000:3.0:1788361540.291285:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d136ec7800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788361540.291312:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788361540.291326:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d00541b800): rc 0 00000020:00000080:3.0:1788361540.291329:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d00541b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788361540.291336:0:84386:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d12c4e5800), last request at 1788361539 00000020:00000080:3.0:1788361540.291341:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1d63 00000020:00000080:2.0:1788361540.291354:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f16800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1788361540.291359:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d12c4e6000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788361540.291395:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002091800 for lustre-MDT0000 00000020:00000080:2.0:1788361540.291403:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1788361540.291413:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d12c4e5800): rc 0 00000020:00000080:3.0:1788361540.291417:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d12c4e5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788361540.291427:0:84386:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d002ff9000), last request at 1788361337 00000020:00000080:3.0:1788361540.291430:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bcd 00000100:00080000:3.0:1788361540.291442:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d12c4e7000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788361540.291448:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137f14000 for lustre-MDT0000 00010000:00010000:3.0:1788361540.291455:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361540.291457:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136ec7800 for lustre-MDT0000 00000020:00080000:3.0:1788361540.291466:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d002ff9000): rc 0 00000020:00000080:2.0:1788361540.291466:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361540.291470:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d002ff9000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1788361540.291483:0:84386:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa0881d73ae0 00000020:00000080:2.0:1788361540.291498:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d12c4e6000 for lustre-MDT0000 00000020:00000080:2.0:1788361540.291504:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002ff9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:3.0:1788361540.291508:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788361540.291514:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411435 gen 3 00000020:00000080:2.0:1788361540.291523:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d12c4e7000 for lustre-MDT0000 00010000:00010000:2.0:1788361540.291534:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.291539:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361540.291629:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361540.292445:0:84386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788361540.292481:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d10f773800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361540.292669:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429726976:0@lo:39:umount.0 00000100:00100000:1.0:1788361540.293478:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361540.293557:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429726976 00000100:00100000:2.0:1788361540.293566:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429726976 00000100:00100000:2.0:1788361540.293627:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:2.0:1788361540.293638:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429726976:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788361540.293668:0:8448:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c0c 00000100:00080000:2.0:1788361540.293675:0:8448:0:(import.c:65:import_set_state_nolock()) ffff99d006aae800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361540.293700:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411435 00010000:00010000:0.0:1788361540.293723:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361540.293784:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361540.293790:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968745 gen 3 00000004:00080000:3.0:1788361540.293807:0:84386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788361540.293913:0:84386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788361540.293934:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d1055ae800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788361540.293947:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788361540.293954:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3649:x1875230429726976:12345-0@lo:39:umount.0 Request processed in 316us (477us total) trans 77309411436 rc 0/0 00000100:00100000:2.0:1788361540.293965:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1788361540.293967:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968746 gen 3 00000004:00080000:3.0:1788361540.293987:0:84386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788361540.294067:0:84386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788361540.294079:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d13fd9f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788361540.294125:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d136cb19c0) has no exports 00000100:00100000:1.0:1788361540.294249:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429727104:0@lo:9:umount.0 00000020:00080000:3.0:1788361540.294536:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d136cb19c0) has no exports 00000100:00100000:1.0:1788361540.294543:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361540.294578:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429727232:0@lo:9:umount.0 00000100:00100000:1.0:1788361540.294599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361540.294650:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f773800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361540.294657:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429726976:0@lo:39:umount.0 00000100:00100000:0.0:1788361540.294660:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727104 00000100:00100000:0.0:1788361540.294668:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727104 00000100:00100000:0.0:1788361540.294723:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727232 00000100:00100000:0.0:1788361540.294726:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727232 00000100:00100000:0.0:1788361540.294746:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4859 00000100:00100000:0.0:1788361540.294753:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429727104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788361540.294777:0:26171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c1a 00000100:00080000:0.0:1788361540.294785:0:26171:0:(import.c:65:import_set_state_nolock()) ffff99d006aa8800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788361540.294857:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4860 00000100:00100000:2.0:1788361540.294872:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429727232:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788361540.294895:0:26172:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c36 00000100:00080000:2.0:1788361540.294903:0:26172:0:(import.c:65:import_set_state_nolock()) ffff99d00541e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361540.294936:0:26171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968745 00000001:00000004:2.0:1788361540.294971:0:26172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968746 00000100:00100000:2.0:1788361540.295129:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429727232:12345-0@lo:9:umount.0 Request processed in 263us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361540.295137:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4860 00010000:00010000:1.0:1788361540.295171:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361540.295201:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd9f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788361540.295231:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788361540.295234:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361540.295238:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429727232:0@lo:9:umount.0 00010000:00010000:2.0:1788361540.295247:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361540.295364:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429727104:12345-0@lo:9:umount.0 Request processed in 610us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361540.295374:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4859 00000100:00080000:1.0:1788361540.295388:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1055ae800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788361540.295404:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788361540.295406:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361540.295418:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429727104:0@lo:9:umount.0 00000020:00000080:3.0:1788361540.329223:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1be2 00000020:00000080:3.0:1788361540.329238:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d11729f800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788361540.329263:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788361540.329329:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361540.329348:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11729f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788361540.329936:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361540.329940:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d006a019c0) has no exports 00000020:00000080:2.0:1788361540.330180:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bdb 00000020:00000080:2.0:1788361540.330186:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d005033800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.330234:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005033800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361540.330259:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361540.330269:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788361540.330272:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d005035800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788361540.330274:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005035800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788361540.330283:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788361540.330483:0:84386:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d004597cc0 - data ffff99d12c9eeca8/ffff99d11df4c800 00000020:01000000:2.0:1788361540.330691:0:84386:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d002f59360 - data ffff99d0018e2000/ffff99d005539000 00000100:00080000:1.0:1788361540.373061:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788361540.373076:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411435 gen 4 00000100:00100000:1.0:1788361540.373100:0:84386:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d1365caa00 x1875230429726976/t77309411436(77309411436) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361550 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361540.373133:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788361540.374568:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361540.374574:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968745 gen 4 00000004:00080000:1.0:1788361540.374625:0:84386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361540.374628:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361540.374950:0:83181:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361540.374957:0:83181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:2.0:1788361540.374970:0:83181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:1.0:1788361540.375791:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361540.375796:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968746 gen 4 00000004:00080000:1.0:1788361540.375812:0:84386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361540.375815:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788361540.376174:0:83183:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788361540.376184:0:83183:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:3.0:1788361540.376203:0:83183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:1.0:1788361540.377721:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1b9c 00000020:00000080:1.0:1788361540.377735:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136445800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.378344:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136445800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361540.378948:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bb1 00000020:00000080:1.0:1788361540.378957:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d13fd10800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361540.378968:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788361540.378974:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361540.378988:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361540.378993:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99d136cb4d40) has no exports 00000004:01000000:1.0:1788361540.379215:0:84386:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788361540.379226:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c2f 00000020:00000080:1.0:1788361540.379232:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d00541d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361540.379238:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361540.379242:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361540.379252:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361540.379255:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d104010000) has no exports 00000020:00000080:1.0:1788361540.379261:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c28 00000020:00000080:1.0:1788361540.379278:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d13fd9a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.379428:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd10800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788361540.379436:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361540.379441:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361540.380240:0:84386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361540.380247:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361540.380253:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968746 gen 5 00000004:00080000:1.0:1788361540.380260:0:84386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361540.380263:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361540.380353:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361540.380364:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361540.380372:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c13 00000020:00000080:1.0:1788361540.380379:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d00541d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361540.380421:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd9f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361540.380429:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d00541b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361540.380431:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788361540.380438:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361540.380592:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361540.380598:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361540.380604:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361540.380607:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99d006a00000) has no exports 00000020:00000080:1.0:1788361540.380612:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c05 00000020:00000080:1.0:1788361540.380616:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d1055ab000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.380640:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788361540.380711:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1055ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361540.381615:0:84386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361540.381621:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361540.381625:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968745 gen 5 00000004:00080000:1.0:1788361540.381630:0:84386:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361540.381633:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361540.381711:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361540.381747:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788361540.381763:0:84386:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788361540.381771:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bf7 00000020:00000080:1.0:1788361540.381778:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d005031800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361540.381809:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1055ae800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788361540.381815:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d005037800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361540.381818:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005037800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788361540.381848:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361540.382015:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788361540.382033:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361540.382050:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361540.382054:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99d006a04d40) has no exports 00000020:00000080:1.0:1788361540.382059:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bf0 00000020:00000080:1.0:1788361540.382063:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136442000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.382423:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005031800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788361540.386926:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136442000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788361540.387062:0:84386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788361540.387069:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788361540.387075:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411435 gen 5 00000100:00100000:2.0:1788361540.387085:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361540.387144:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d10f773800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788361540.387207:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361540.387226:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361540.387233:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d005036800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361540.387236:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005036800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788361540.387243:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361540.387390:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361540.387396:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361540.387411:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136440000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361540.387414:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136440000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788361540.387419:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361540.387494:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bb8 00000020:00000080:2.0:1788361540.387502:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d13fd15000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788361540.387548:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788361540.387554:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361540.387561:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788361540.387565:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99d001c60000) has no exports 00000020:00000080:2.0:1788361540.387593:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361540.387597:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788361540.387603:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1bbf 00000020:00000080:2.0:1788361540.387609:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d13fd12800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.387640:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd15000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788361540.387645:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d139ff4800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788361540.387648:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d139ff4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788361540.387652:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788361540.387745:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd12800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788361540.387783:0:84386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d001c6a000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788361540.387793:0:84386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d001c6a000 3 00000020:01000004:2.0:1788361540.387797:0:84386:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d001c6a000 from lustre-MDT0000 00000020:00000080:2.0:1788361540.387867:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361540.387880:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788361540.387885:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136442800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788361540.387888:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136442800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788361540.387898:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788361540.387973:0:84386:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788361540.387976:0:84386:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788361540.387981:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788361540.387984:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361540.387988:0:84386:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788361540.387996:0:84386:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d13fd11800 1f5c0251-1795-40ef-8392-cb147010b7b5 192.168.204.35@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361540.388008:0:84386:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d006c8b800 c8a6f36d-efb9-41cf-af98-5917323f2b0d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361540.388013:0:84386:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff99d136cb0000) has exports, disconnecting them 00000020:00080000:2.0:1788361540.388030:0:84386:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.35@tcp (ffff99d13fd11800), last request at 1788361337 00000020:00000080:2.0:1788361540.388052:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c7c 00000020:00010000:2.0:1788361540.388068:0:84386:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d13fd11800: total 0 00000100:00080000:2.0:1788361540.388072:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d13fd17000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361540.388093:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d13fd11800): rc 0 00000020:00080000:2.0:1788361540.388097:0:84386:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d006c8b800), last request at 1788361337 00000020:00010000:3.0:1788361540.388123:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d13fd11800: total 0 00000020:00000080:2.0:1788361540.388163:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1b5d 00010000:00010000:3.0:1788361540.388168:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d13fd11800, canceled 0 locks, left on hash table 4. 00000020:00010000:2.0:1788361540.388170:0:84386:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d006c8b800: total 0 00000100:00080000:2.0:1788361540.388176:0:84386:0:(import.c:65:import_set_state_nolock()) ffff99d140d5a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361540.388195:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d006c8b800): rc 0 00000020:00080000:2.0:1788361540.388201:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99d136cb0000) has no exports 00010000:00010000:3.0:1788361540.388214:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f800/0x1b69fa8920fe1d47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c94 expref: 5 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361540.388243:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aad200/0x1b69fa8920fe1d55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ca2 expref: 4 pid: 83174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361540.388301:0:83171:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d117122800:83171] 2 exiting: rc = 0 00000020:00010000:2.0:1788361540.388383:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d006c8b800: total 0 00010000:00010000:2.0:1788361540.388410:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d006c8b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788361540.388439:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0e200/0x1b69fa8920fe1cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1cd7 expref: 14 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388454:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1371ff600/0x1b69fa8920fe1cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1ce5 expref: 13 pid: 83171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388464:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aad400/0x1b69fa8920fe1d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1d01 expref: 12 pid: 83169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388490:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d005309c00/0x1b69fa8920fe1c98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1c91 expref: 11 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388504:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f200/0x1b69fa8920fe1cfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1cf3 expref: 10 pid: 83169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388520:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f400/0x1b69fa8920fe1cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1cad expref: 9 pid: 83174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388530:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ea00/0x1b69fa8920fe1d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1d0f expref: 8 pid: 83174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388559:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe1ca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1c9f expref: 7 pid: 83174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361540.388564:0:83169:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d117123a00:83169] 0 exiting: rc = 1 00010000:00010000:2.0:1788361540.388592:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fa00/0x1b69fa8920fe1d24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1d1d expref: 6 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388608:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d005308800/0x1b69fa8920fe1d32 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1d2b expref: 5 pid: 83174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388626:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aade00/0x1b69fa8920fe1cc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1cbb expref: 4 pid: 83171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388649:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d005309600/0x1b69fa8920fe1d40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1d39 expref: 3 pid: 83169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388671:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe1cd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe1cc9 expref: 2 pid: 83169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361540.388693:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d006c8b800, canceled 13 locks, left on hash table 0. 00000100:00100000:0.0:1788361540.388700:0:83170:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d117122600:83170] 1 exiting: rc = 0 00000020:00000080:2.0:1788361540.388751:0:6512:0:(genops.c:906:class_export_put()) final put ffff99d006c8b800/c8a6f36d-efb9-41cf-af98-5917323f2b0d 00010000:00010000:2.0:1788361540.388765:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.388769:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.388770:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.388788:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d005308e00/0x1b69fa8920fe1d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710c9b expref: 3 pid: 83169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361540.388791:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8b800/c8a6f36d-efb9-41cf-af98-5917323f2b0d for MGS 00010000:00010000:2.0:1788361540.388814:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f000/0x1b69fa8920fe1d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ca9 expref: 2 pid: 83170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361540.388867:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d140d5a800 for MGS 00010000:00010000:2.0:1788361540.388893:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d13fd11800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788361540.388938:0:8455:0:(genops.c:906:class_export_put()) final put ffff99d13fd11800/1f5c0251-1795-40ef-8392-cb147010b7b5 00010000:00010000:2.0:1788361540.388959:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.388962:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361540.388970:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361540.388999:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd11800/1f5c0251-1795-40ef-8392-cb147010b7b5 for MGS 00000020:00000080:3.0:1788361540.389050:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd17000 for MGS 00000100:00100000:1.0:1788361540.394892:0:83174:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99d136d00a00:83174] 3 exiting: rc = 0 00000100:00100000:2.0:1788361540.395108:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395117:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395123:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395128:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395135:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395141:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395147:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395153:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395158:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395165:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395171:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395177:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395185:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395190:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395197:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395207:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395215:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395222:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395227:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395234:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395241:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395247:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395254:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395260:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395265:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395271:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395277:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395284:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395296:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395303:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395321:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395326:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395332:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395337:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395343:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395348:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395355:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395360:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395366:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395372:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395377:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395383:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395389:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395396:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395407:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395413:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395421:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395428:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395434:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395439:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395446:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395451:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395457:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395462:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395468:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395508:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395514:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395519:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395524:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395530:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395535:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395540:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395546:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361540.395551:0:84386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788361540.397418:0:84386:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d00448cf60 - data ffff99d1174175e8/ffff99d0070f0800 00000020:01000000:2.0:1788361540.397631:0:84386:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d00697e720 - data ffff99d117620af8/ffff99d137fd8c00 00000020:00000080:2.0:1788361540.398168:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1b56 00000020:00000080:2.0:1788361540.398179:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136441000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788361540.398200:0:84386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d001c6a000 from MGS, refs=2 00000020:01000004:2.0:1788361540.398204:0:84386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d001c6a000 2 00000020:01000004:2.0:1788361540.398208:0:84386:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d001c6a000 from MGS 00000020:00000080:2.0:1788361540.398238:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361540.398247:0:84386:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788361540.398250:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136440800/MGS 00000020:00000080:2.0:1788361540.398254:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136440800/MGS for MGS 00000020:00000080:3.0:1788361540.398261:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136441000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788361540.398263:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788361540.398357:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788361540.398361:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361540.398371:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361540.398379:0:84386:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d136e1b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361540.398385:0:84386:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99d001c619c0) has exports, disconnecting them 00000020:00080000:2.0:1788361540.398391:0:84386:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d136e1b800), last request at 1788361337 00000020:00000080:2.0:1788361540.398396:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1c6e 00000020:00080000:2.0:1788361540.398407:0:84386:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d136e1b800): rc 0 00000020:00000080:2.0:1788361540.398412:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136e1b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361540.398582:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136e1b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788361540.400609:0:84386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788361540.400618:0:84386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361540.400623:0:84386:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361540.400630:0:84386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361540.400757:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002de9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361540.400785:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361540.401324:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788361540.401331:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d139ff7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788361540.401345:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d139ff7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788361540.401351:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788361540.401442:0:84386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d001c6a000 1 00000020:00000080:3.0:1788361540.401450:0:84386:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1b48 00000020:00000080:3.0:1788361540.401456:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d136445000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788361540.401470:0:84386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788361540.401473:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361540.401477:0:84386:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361540.401488:0:84386:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d003818000) has no exports 00000020:00000080:1.0:1788361540.401605:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136445000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361540.417568:0:84386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361540.417582:0:84386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788361540.417588:0:84386:0:(genops.c:906:class_export_put()) final put ffff99d006c8c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361540.417593:0:84386:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788361540.417606:0:84386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788361540.417746:0:84386:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d137d2d800 00000020:02000400:3.0:1788361540.417840:0:84386:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788361540.438042:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429727360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361540.438126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361540.438193:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727360 00000100:00100000:2.0:1788361540.438201:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727360 00000100:00100000:2.0:1788361540.438257:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:2.0:1788361540.438268:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3653:x1875230429727360:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788361540.438278:0:23938:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361540.438332:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3653:x1875230429727360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (206us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361540.438352:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:02020000:2.0:1788361540.438427:0:3653:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788361540.443842:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788361540.443848:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788361540.443852:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788361540.452736:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361540.452747:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2564 00000100:00080000:2.0:1788361540.452755:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361540.452787:0:3653:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d11e7e4700 x1875230429727488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361540.452877:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11e7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429727488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788361540.452962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361540.453047:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727488 00000100:00100000:2.0:1788361540.453055:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727488 00000100:00100000:2.0:1788361540.453091:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:2.0:1788361540.453099:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429727488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788361540.453120:0:8449:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361540.453159:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429727488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 60us (196us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361540.453165:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00080000:1.0:1788361540.454007:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361540.454013:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361540.454028:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11e7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429727488:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788361540.693979:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361541.464527:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11e7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429727616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361541.464888:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361541.464912:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429727744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361541.464948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361541.465053:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727616 00000100:00100000:2.0:1788361541.465062:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727616 00000100:00100000:1.0:1788361541.465122:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727744 00000100:00100000:2.0:1788361541.465127:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788361541.465128:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727744 00000100:00100000:2.0:1788361541.465140:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429727616:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361541.465163:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00002000:00000024:2.0:1788361541.465168:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361541.465174:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429727744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361541.465192:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361541.465221:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429727616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361541.465243:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1788361541.465304:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429727744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361541.465343:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429727744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361541.465351:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1788361541.465385:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11e7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429727616:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788361541.466929:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361541.466936:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788361541.718119:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361541.980562:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361541.980572:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d00541c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361541.980691:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788361541.980842:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d00541e000 for lustre-OST0001 00010000:00010000:2.0:1788361542.742120:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361543.767156:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361544.534256:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361544.534360:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361544.534375:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429728000:0@lo:400:kworker.0 00000100:00100000:2.0:1788361544.534472:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361544.534575:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728000 00000100:00100000:1.0:1788361544.534581:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728000 00000100:00100000:1.0:1788361544.534646:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1788361544.534654:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875230429728000:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788361544.534661:0:66901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361544.534706:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875230429728000:12345-0@lo:400:kworker.0 Request processed in 51us (233us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361544.534728:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00080000:1.0:1788361544.534776:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361544.534780:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361544.534784:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788361544.534789:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361544.534793:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2382 00000100:00080000:1.0:1788361544.534799:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361544.534860:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d118594700 x1875230429728128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361544.534879:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429728000:0@lo:400:kworker.0 00000100:00100000:1.0:1788361544.534902:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429728128:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361544.534927:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361544.534974:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728128 00000100:00100000:1.0:1788361544.534978:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728128 00000100:00100000:1.0:1788361544.535014:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1788361544.535018:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429728128:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788361544.535037:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361544.535067:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429728128:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 47us (139us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361544.535073:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00080000:1.0:1788361544.535106:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361544.535111:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361544.535114:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429728128:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788361544.535408:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429727872:0@lo:400:kworker.0 00000400:00000100:0.0:1788361544.535432:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429727872 offset 0 length 224: 4 00000100:00100000:2.0:1788361544.535601:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429728256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361544.535629:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361544.535686:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728256 00000100:00100000:0.0:1788361544.535690:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728256 00000100:00100000:0.0:1788361544.535744:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1788361544.535761:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429728256:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361544.535882:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361544.535991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788361544.536016:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361544.536044:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728384 00000100:00100000:1.0:1788361544.536048:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728384 00000100:00100000:1.0:1788361544.536067:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1788361544.536071:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875230429728384:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788361544.536075:0:66901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361544.536103:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875230429728384:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361544.536109:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00080000:1.0:1788361544.536139:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361544.536142:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361544.536145:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788361544.536149:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361544.536152:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2382 00000100:00080000:1.0:1788361544.536155:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361544.536174:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002d57b80 x1875230429728512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361544.536211:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429728256:12345-0@lo:400:kworker.0 Request processed in 451us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361544.536214:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429728256:0@lo:400:kworker.0 00000100:00100000:0.0:1788361544.536217:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00080000:3.0:1788361544.536405:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361544.536410:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361544.536412:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361544.536416:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2580 00000100:00080000:3.0:1788361544.536419:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1788361544.536421:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429728384:0@lo:400:kworker.0 00000100:00080000:3.0:1788361544.536422:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361544.536436:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c9880 x1875230429728768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361544.536437:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429728512:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361544.536460:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361544.536477:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429728768:0@lo:38:kworker.0 00000100:00100000:1.0:1788361544.536500:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361544.536525:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728512 00000100:00100000:2.0:1788361544.536529:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728512 00000100:00100000:1.0:1788361544.536542:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429729152:0@lo:400:kworker.0 00000100:00100000:2.0:1788361544.536548:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1788361544.536552:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429728512:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361544.536562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:2.0:1788361544.536566:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361544.536578:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361544.536583:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429729024:0@lo:400:kworker.0 00000100:00100000:2.0:1788361544.536595:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429728512:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 42us (134us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361544.536601:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1788361544.536603:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361544.536610:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729152 00000100:00100000:2.0:1788361544.536613:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729152 00000100:00100000:2.0:1788361544.536628:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1788361544.536632:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429729152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361544.536667:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429728896:0@lo:400:kworker.0 00000100:00100000:0.0:1788361544.536699:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361544.536721:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361544.536723:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728768 00000100:00100000:0.0:1788361544.536726:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429728640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361544.536731:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728768 00000100:00100000:3.0:1788361544.536754:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:3.0:1788361544.536758:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429728768:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361544.536768:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361544.536796:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429728768:12345-0@lo:38:kworker.0 Request processed in 37us (295us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361544.536802:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00100000:0.0:1788361544.536817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361544.536846:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728640 00000100:00100000:3.0:1788361544.536850:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728640 00000100:00100000:0.0:1788361544.536863:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729024 00000100:00100000:0.0:1788361544.536866:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729024 00000100:00100000:0.0:1788361544.536890:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429728896 00000100:00100000:0.0:1788361544.536893:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429728896 00000020:00080000:2.0:1788361544.536903:0:66127:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361544.536913:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1788361544.536919:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429729024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361544.537009:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429729152:12345-0@lo:400:kworker.0 Request processed in 374us (444us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361544.537051:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429729024:12345-0@lo:400:kworker.0 Request processed in 117us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361544.537097:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1788361544.537110:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:3.0:1788361544.537111:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1788361544.537117:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429728640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361544.537117:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429728896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361544.537158:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:1.0:1788361544.537163:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361544.537166:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361544.537168:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361544.537198:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788361544.537201:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429729024:0@lo:400:kworker.0 00000100:00080000:2.0:1788361544.537203:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361544.537206:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429728768:0@lo:38:kworker.0 00000100:00080000:1.0:1788361544.537209:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361544.537212:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1788361544.537213:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361544.537215:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:02000400:1.0:1788361544.537215:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788361544.537218:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429728512:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788361544.537219:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361544.537222:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2382 00000100:00080000:1.0:1788361544.537241:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361544.537257:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002d57b80 x1875230429729280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361544.537272:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429729152:0@lo:400:kworker.0 00000100:00100000:3.0:1788361544.537338:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429728640:12345-0@lo:400:kworker.0 Request processed in 221us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361544.537344:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1788361544.537372:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429728896:12345-0@lo:400:kworker.0 Request processed in 255us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361544.537379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:2.0:1788361544.537396:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429729280:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788361544.537420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361544.537865:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729280 00000100:00100000:0.0:1788361544.537870:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729280 00000100:00100000:0.0:1788361544.537891:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1788361544.537895:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429729280:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788361544.537909:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361544.537952:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429729280:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 55us (531us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361544.537958:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:2.0:1788361544.538022:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361544.538027:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361544.538030:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429729280:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361544.538343:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429728640:0@lo:400:kworker.0 00000100:00100000:1.0:1788361544.538354:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429728896:0@lo:400:kworker.0 00000400:00000100:0.0:1788361544.584159:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406962176 offset 0 length 224: 4 00000100:00100000:0.0:1788361544.584208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361544.584398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361544.584481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361544.584510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361544.584553:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406962560 00000100:00100000:0.0:1788361544.584567:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406962688 00000100:00100000:2.0:1788361544.584570:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406962560 00000100:00100000:0.0:1788361544.584573:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406962688 00000100:00100000:2.0:1788361544.584640:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1774 00000100:00100000:2.0:1788361544.584652:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406962560:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361544.584653:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406962304 00000100:00100000:1.0:1788361544.584661:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406962304 00000100:00100000:1.0:1788361544.584703:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406962432 00000100:00100000:1.0:1788361544.584707:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406962432 00000100:00100000:0.0:1788361544.584723:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1775 00000100:00100000:2.0:1788361544.584738:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406962560:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361544.584738:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406962688:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361544.584748:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 767 00000100:00100000:2.0:1788361544.584754:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1774 00000100:00100000:1.0:1788361544.584778:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406962432:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361544.584779:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406962688:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361544.584791:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1027 00000100:00100000:0.0:1788361544.584795:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1775 00000100:00100000:2.0:1788361544.584801:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2409:x1875230406962304:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:2.0:1788361544.584809:0:67579:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:1.0:1788361544.584856:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406962432:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 49us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361544.584864:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 767 00000100:00100000:2.0:1788361544.584878:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2409:x1875230406962304:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 77us (669us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361544.584893:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1027 00000100:00080000:3.0:1788361544.584919:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361544.584925:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361544.584928:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361544.602216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361544.602293:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406962816 00000100:00100000:2.0:1788361544.602305:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406962816 00000100:00100000:2.0:1788361544.602354:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1028 00000100:00100000:2.0:1788361544.602362:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230406962816:12345-192.168.204.35@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788361544.602386:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361544.602454:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230406962816:12345-192.168.204.35@tcp:38:ptlrpcd_00_00.0 Request processed in 91us (246us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361544.602462:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1028 00010000:00010000:1.0:1788361544.790159:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361545.814945:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361546.072002:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788361546.072016:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411436 is committed 00000020:00000080:1.0:1788361546.072022:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d006aab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361546.072069:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006aab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788361546.072306:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006aae800 for lustre-MDT0001 00000001:00100000:0.0:1788361546.074322:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361546.074329:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d13fd10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361546.074383:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd10000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788361546.074435:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006aa8800 for lustre-OST0000 00000100:00100000:2.0:1788361546.582009:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361546.582028:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429729408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361546.582121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361546.582160:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729408 00000100:00100000:0.0:1788361546.582167:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729408 00000100:00100000:2.0:1788361546.582169:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429729536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361546.582193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361546.582244:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361546.582263:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729536 00000100:00100000:0.0:1788361546.582267:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729536 00000100:00100000:2.0:1788361546.582277:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1788361546.582287:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429729408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361546.582289:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1788361546.582295:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429729536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361546.582314:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788361546.582314:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361546.582355:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429729408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.582362:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00080000:2.0:1788361546.582379:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361546.582402:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429729536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.582407:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429729408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361546.582408:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1788361546.582430:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429729536:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788361546.838380:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361547.862308:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361548.886032:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361549.653998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361549.654005:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361549.654008:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788361549.654017:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429729664:0@lo:400:kworker.0 00000100:00080000:3.0:1788361549.654031:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2584 00000100:00080000:3.0:1788361549.654037:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361549.654044:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000400:00000100:2.0:1788361549.654080:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429729664 offset 0 length 224: 4 00000100:00100000:3.0:1788361549.655369:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c9c00 x1875230429729792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361549.655454:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429729920:0@lo:400:kworker.0 00000100:00100000:1.0:1788361549.655515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361549.655584:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729920 00000100:00100000:0.0:1788361549.655591:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729920 00000100:00080000:3.0:1788361549.655629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361549.655634:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361549.655637:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361549.655641:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2584 00000100:00080000:3.0:1788361549.655644:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361549.655648:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361549.655661:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1788361549.655666:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c9880 x1875230429730048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361549.655677:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429729920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361549.655695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361549.655699:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361549.655701:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361549.655705:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2584 00000100:00080000:3.0:1788361549.655708:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361549.655712:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00080000:2.0:1788361549.655994:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361549.656015:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429729792:0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.656050:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361549.656160:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429729920:12345-0@lo:400:kworker.0 Request processed in 487us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361549.656177:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429729920:0@lo:400:kworker.0 00000100:00100000:0.0:1788361549.656181:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:1.0:1788361549.656204:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429730176:0@lo:400:kworker.0 00000100:00100000:3.0:1788361549.656298:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365ca300 x1875230429730304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361549.656366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361549.656369:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361549.656371:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361549.656380:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2584 00000100:00080000:3.0:1788361549.656383:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361549.656387:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361549.656413:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c2300 x1875230429730688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361549.656434:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361549.656441:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429730560:0@lo:400:kworker.0 00000100:00100000:3.0:1788361549.656469:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361549.656496:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730560 00000100:00100000:3.0:1788361549.656500:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730560 00000100:00100000:3.0:1788361549.656544:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:3.0:1788361549.656551:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429730560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361549.656857:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429729792 00000100:00100000:0.0:1788361549.656863:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429729792 00000100:00100000:1.0:1788361549.656869:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429730432:0@lo:400:kworker.0 00000100:00100000:0.0:1788361549.656891:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1788361549.656898:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429729792:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788361549.656910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1788361549.656918:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361549.656959:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429729792:12345-0@lo:38:kworker.0 Request processed in 59us (906us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788361549.656965:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361549.656967:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1788361549.656985:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730432 00000100:00100000:1.0:1788361549.656990:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730432 00000100:00080000:0.0:1788361549.657014:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361549.657026:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1788361549.657034:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429730432:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361549.657111:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361549.657116:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361549.657119:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429729792:0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.657126:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429730048:0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.657159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361549.657187:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429730304:0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.657237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361549.657254:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429730688:0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.657294:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361549.657323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361549.657340:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429730560:12345-0@lo:400:kworker.0 Request processed in 788us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361549.657348:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:2.0:1788361549.657371:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730048 00000100:00100000:2.0:1788361549.657376:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730048 00000100:00100000:3.0:1788361549.657381:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429730560:0@lo:400:kworker.0 00000100:00100000:2.0:1788361549.657399:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730688 00000100:00100000:2.0:1788361549.657404:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730688 00000100:00100000:3.0:1788361549.657414:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730304 00000100:00100000:3.0:1788361549.657419:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730304 00000100:00100000:2.0:1788361549.657420:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730176 00000100:00100000:2.0:1788361549.657425:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730176 00000100:00100000:3.0:1788361549.657443:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:3.0:1788361549.657449:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429730304:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.657459:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00010000:00020000:3.0:1788361549.657462:0:8448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361549.657470:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429730176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361549.657499:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429730304:12345-0@lo:38:kworker.0 Request processed in 48us (260us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361549.657505:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:2.0:1788361549.657521:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429730176:12345-0@lo:400:kworker.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361549.657530:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1788361549.657538:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429730048:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361549.657541:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1788361549.657559:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1788361549.657564:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429730688:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788361549.657575:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361549.657596:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429730688:12345-0@lo:38:kworker.0 Request processed in 32us (303us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361549.657602:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1788361549.657622:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429730176:0@lo:400:kworker.0 00000100:00080000:2.0:1788361549.657642:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361549.657643:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429730432:12345-0@lo:400:kworker.0 Request processed in 608us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361549.657652:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00080000:2.0:1788361549.657660:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361549.657666:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361549.657670:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429730304:0@lo:38:kworker.0 00000100:00080000:2.0:1788361549.657679:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361549.657682:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361549.657685:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429730688:0@lo:38:kworker.0 00000100:00100000:0.0:1788361549.657761:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429730432:0@lo:400:kworker.0 00010000:00020000:3.0:1788361549.657820:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361549.657887:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429730048:12345-0@lo:38:kworker.0 Request processed in 348us (727us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361549.657894:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:2.0:1788361549.657924:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361549.657928:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361549.657931:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429730048:0@lo:38:kworker.0 00000400:00000100:0.0:1788361549.704078:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406962944 offset 0 length 224: 4 00000100:00100000:0.0:1788361549.704181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361549.704267:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963200 00000100:00100000:2.0:1788361549.704284:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963200 00000100:00100000:2.0:1788361549.704380:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 770 00000100:00100000:2.0:1788361549.704394:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406963200:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361549.704481:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406963200:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361549.704506:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 770 00000100:00080000:3.0:1788361549.704659:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361549.704665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361549.704957:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361549.704960:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963456 00000100:00100000:2.0:1788361549.704967:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963456 00000100:00100000:1.0:1788361549.705021:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963328 00000100:00100000:1.0:1788361549.705027:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963328 00000100:00100000:2.0:1788361549.705040:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1778 00000100:00100000:2.0:1788361549.705055:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406963456:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:3.0:1788361549.705079:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361549.705088:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361549.705100:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1779 00000100:00100000:1.0:1788361549.705111:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406963328:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361549.705121:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406963456:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 71us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361549.705129:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1778 00000100:00100000:1.0:1788361549.705149:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406963328:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361549.705158:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1779 00000100:00100000:0.0:1788361549.707972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361549.708110:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963072 00000100:00100000:2.0:1788361549.708119:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963072 00000100:00100000:2.0:1788361549.708162:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1032 00000100:00100000:2.0:1788361549.708170:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230406963072:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:2.0:1788361549.708194:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361549.708301:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230406963072:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 129us (334us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361549.708309:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1032 00010000:00010000:2.0:1788361549.910098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361550.934018:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361551.704308:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429730944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361551.704373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361551.704452:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429730816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361551.704522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361551.704581:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730944 00000100:00100000:1.0:1788361551.704589:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730944 00000100:00100000:1.0:1788361551.704636:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429730816 00000100:00100000:1.0:1788361551.704639:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429730816 00000100:00100000:1.0:1788361551.704664:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788361551.704673:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429730944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361551.704700:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361551.704744:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429730944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361551.704751:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788361551.704774:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1788361551.704782:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429730816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361551.704809:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361551.704873:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429730816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361551.704879:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00080000:1.0:1788361551.704902:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361551.704907:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361551.704951:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429730816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361551.705558:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429730944:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788361551.959075:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.989987:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361554.006793:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361554.774790:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361554.774848:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429731072:0@lo:400:kworker.0 00000100:00080000:2.0:1788361554.774888:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361554.774895:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361554.774899:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361554.774904:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2589 00000400:00000100:3.0:1788361554.774909:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429731072 offset 0 length 224: 4 00000100:00080000:2.0:1788361554.774910:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361554.774938:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361554.774964:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1364fd180 x1875230429731200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361554.775018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361554.775022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361554.775023:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361554.775027:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2589 00000100:00080000:2.0:1788361554.775030:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361554.775034:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361554.775045:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1364fed80 x1875230429731456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361554.775060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361554.775063:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361554.775065:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361554.775068:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2589 00000100:00080000:2.0:1788361554.775070:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361554.775073:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361554.775084:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1364fc700 x1875230429731712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361554.775112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361554.775116:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361554.775118:0:8:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361554.775121:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2589 00000100:00080000:2.0:1788361554.775123:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361554.775132:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361554.775144:0:8:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1364fea00 x1875230429732096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361554.775169:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429731840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361554.775208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361554.775231:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361554.775236:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429731968:0@lo:400:kworker.0 00000100:00100000:2.0:1788361554.775254:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361554.775278:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731840 00000100:00100000:2.0:1788361554.775284:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731840 00000100:00100000:0.0:1788361554.775457:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429731200:0@lo:38:kworker.0 00000100:00100000:0.0:1788361554.775488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361554.775506:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429731456:0@lo:38:kworker.0 00000100:00100000:1.0:1788361554.775522:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429731328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.775523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361554.775541:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429731712:0@lo:38:kworker.0 00000100:00100000:0.0:1788361554.775593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361554.775605:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429732096:0@lo:38:kworker.0 00000100:00100000:0.0:1788361554.775625:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731200 00000100:00100000:0.0:1788361554.775632:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731200 00000100:00100000:1.0:1788361554.775641:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361554.775654:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731456 00000100:00100000:0.0:1788361554.775658:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731456 00000100:00100000:1.0:1788361554.775673:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361554.775677:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731328 00000100:00100000:1.0:1788361554.775680:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429731584:0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.775682:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731328 00000100:00100000:1.0:1788361554.775705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361554.775716:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731584 00000100:00100000:0.0:1788361554.775724:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731584 00000100:00100000:1.0:1788361554.775757:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00080000:3.0:1788361554.775856:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361554.775862:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361554.775871:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731968 00000100:00100000:3.0:1788361554.775874:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731968 00000100:00100000:3.0:1788361554.775905:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:3.0:1788361554.775913:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429731968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.775985:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1788361554.775987:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429731328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.776003:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429731584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361554.776040:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429731328:12345-0@lo:400:kworker.0 Request processed in 59us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361554.776060:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429731584:12345-0@lo:400:kworker.0 Request processed in 60us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361554.776067:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1788361554.776084:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1788361554.776089:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429731200:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788361554.776103:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00010000:00020000:0.0:1788361554.776106:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361554.776125:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788361554.776131:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429731456:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361554.776139:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429731200:12345-0@lo:38:kworker.0 Request processed in 47us (647us total) trans 0 rc -19/-19 00010000:00020000:1.0:1788361554.776145:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361554.776150:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1788361554.776185:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429731456:12345-0@lo:38:kworker.0 Request processed in 51us (660us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361554.776186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361554.776227:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361554.776233:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361554.776237:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429731200:0@lo:38:kworker.0 00000100:00080000:0.0:1788361554.776248:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788361554.776250:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00080000:0.0:1788361554.776252:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361554.776258:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429731456:0@lo:38:kworker.0 00000100:00100000:1.0:1788361554.776264:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732096 00000100:00100000:1.0:1788361554.776268:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732096 00000100:00100000:1.0:1788361554.776284:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788361554.776288:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429732096:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361554.776296:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361554.776320:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429731712 00000100:00100000:1.0:1788361554.776323:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429732096:12345-0@lo:38:kworker.0 Request processed in 33us (139us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361554.776326:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429731712 00000100:00100000:1.0:1788361554.776328:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1788361554.776359:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:0.0:1788361554.776365:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429731712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788361554.776376:0:23939:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361554.776396:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429731584:0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.776409:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429731712:12345-0@lo:38:kworker.0 Request processed in 41us (813us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361554.776413:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429731328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.776420:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00080000:0.0:1788361554.776455:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361554.776459:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361554.776464:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429731712:0@lo:38:kworker.0 00000100:00080000:0.0:1788361554.776478:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788361554.776481:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429731968:0@lo:400:kworker.0 00000100:00080000:0.0:1788361554.776484:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361554.776490:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429732096:0@lo:38:kworker.0 00000100:00100000:3.0:1788361554.776653:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429731968:12345-0@lo:400:kworker.0 Request processed in 739us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361554.776660:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00080000:3.0:1788361554.776677:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361554.776781:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:0.0:1788361554.776790:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429731840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.776855:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429731840:12345-0@lo:400:kworker.0 Request processed in 67us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361554.776861:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1788361554.777512:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429731840:0@lo:400:kworker.0 00000100:00100000:0.0:1788361554.827111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000400:00000100:0.0:1788361554.827169:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406963584 offset 0 length 224: 4 00000100:00100000:0.0:1788361554.827183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361554.827211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361554.827236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361554.827268:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963968 00000100:00100000:0.0:1788361554.827277:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963968 00000100:00100000:2.0:1788361554.827287:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963712 00000100:00100000:2.0:1788361554.827293:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963712 00000100:00100000:0.0:1788361554.827326:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964096 00000100:00100000:0.0:1788361554.827338:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964096 00000100:00100000:2.0:1788361554.827343:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406963840 00000100:00100000:0.0:1788361554.827367:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1782 00000100:00100000:0.0:1788361554.827373:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406963968:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361554.827403:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406963840 00000100:00100000:2.0:1788361554.827441:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 773 00000100:00100000:0.0:1788361554.827451:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406963968:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361554.827452:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406963840:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361554.827466:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1782 00000100:00100000:0.0:1788361554.827489:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1783 00000100:00100000:0.0:1788361554.827497:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406964096:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361554.827525:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406964096:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361554.827529:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1783 00000100:00080000:0.0:1788361554.827541:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361554.827544:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361554.827545:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361554.827636:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1036 00000100:00100000:0.0:1788361554.827640:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230406963712:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:0.0:1788361554.827656:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361554.827677:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230406963712:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 36us (575us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361554.827681:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1036 00000100:00100000:2.0:1788361554.828006:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406963840:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 557us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361554.828013:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 773 00010000:00010000:0.0:1788361555.030427:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361556.054136:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361556.476749:0:85003:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361556.476755:0:85003:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788361556.476757:0:85003:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788361556.476901:0:85003:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d006aa8800 00000020:01000004:0.0:1788361556.476914:0:85003:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788361556.476924:0:85003:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788361556.476938:0:85003:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d00381b380) 00000020:00000080:0.0:1788361556.476951:0:85003:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788361556.547083:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788361556.548900:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.550256:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.550725:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.551015:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.551251:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.551521:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.551723:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.551988:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.552215:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.552419:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.552627:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.552849:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.553113:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.553364:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.553572:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.553796:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.554091:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.554271:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.554522:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.554727:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.554900:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.555163:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.555394:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.555590:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.555803:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.556085:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.556267:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.556497:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.556717:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.556911:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.557198:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.557430:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788361556.557652:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788361556.558735:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788361556.561215:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788361556.561635:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788361556.562010:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788361556.562225:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788361556.562519:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788361556.562731:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788361556.563139:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.563537:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.563770:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.564048:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.564370:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788361556.564611:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.566016:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.566539:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.566747:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.567220:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.567470:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788361556.567646:0:85003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788361556.568484:0:85003:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788361556.568729:0:85003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788361556.568738:0:85003:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788361556.568750:0:85003:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2065 00000020:01000004:3.0:1788361556.568756:0:85003:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788361556.568769:0:85003:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788361556.568774:0:85003:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d006aa8800 from MGS 00000020:01000004:3.0:1788361556.568778:0:85003:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788361556.568787:0:85003:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d001c619c0) 00000020:00000080:3.0:1788361556.568798:0:85003:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788361556.569019:0:85003:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d006aa8800 from MGS, refs=2 00080000:01000000:3.0:1788361556.569025:0:85003:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788361556.569030:0:85003:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2073 00010000:00010000:3.0:1788361556.569153:0:85003:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788361556.573620:0:85003:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788361556.574857:0:85007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788361556.574922:0:85003:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788361556.575374:0:85003:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361556.576116:0:85003:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788361556.576508:0:85003:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361556.576801:0:85003:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788361556.576808:0:85003:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788361556.580414:0:85003:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788361556.580441:0:85003:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788361556.582422:0:85003:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788361556.582431:0:85003:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361556.583055:0:85003:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361556.583079:0:85003:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788361556.583081:0:85003:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788361556.583084:0:85003:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1788361556.583090:0:85003:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788361556.583096:0:85003:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788361556.583099:0:85003:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788361556.583101:0:85003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788361556.583108:0:85003:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d1365c8e00 x1875230429727872/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361556.583132:0:85003:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d1365cb480 x1875230429729664/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361556.583185:0:85003:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d1364fdf80 x1875230429731072/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788361556.583203:0:85003:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788361556.583206:0:85003:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788361556.583207:0:85003:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788361556.583210:0:85003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1788361556.583272:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429727872:0@lo:400:kworker.0 00000100:00100000:2.0:1788361556.583377:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429731072:0@lo:400:kworker.0 00000100:00100000:0.0:1788361556.583457:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429729664:0@lo:400:kworker.0 10000000:01000000:3.0:1788361556.583514:0:85003:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788361556.583528:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d005309200/0x1b69fa8920fe1d2b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1d32 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.583539:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d005309200/0x1b69fa8920fe1d2b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1d32 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.583545:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788361556.583561:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.583569:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d005309200/0x1b69fa8920fe1d2b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1d32 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.583598:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371ff200/0x1b69fa8920fe1c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1c98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.583605:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff200/0x1b69fa8920fe1c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1c98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.583610:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.583614:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.583618:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371ff200/0x1b69fa8920fe1c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1c98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.583627:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe1cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1cb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.583633:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe1cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1cb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.583638:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.583642:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.583645:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe1cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1cb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.583654:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe1cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1cde expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.583660:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe1cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1cde expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.583665:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.583999:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584003:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe1cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1cde expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584021:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aad600/0x1b69fa8920fe1ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1cec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584028:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad600/0x1b69fa8920fe1ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1cec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584034:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.584208:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584214:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aad600/0x1b69fa8920fe1ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1cec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584227:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0e600/0x1b69fa8920fe1d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1d08 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584234:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e600/0x1b69fa8920fe1d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1d08 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584239:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.584248:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584251:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0e600/0x1b69fa8920fe1d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1d08 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584260:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d005308a00/0x1b69fa8920fe1d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1d16 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584266:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d005308a00/0x1b69fa8920fe1d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1d16 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584282:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.584287:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584291:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d005308a00/0x1b69fa8920fe1d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1d16 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584300:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d005309e00/0x1b69fa8920fe1d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1d40 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584306:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d005309e00/0x1b69fa8920fe1d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1d40 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584310:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.584314:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584317:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d005309e00/0x1b69fa8920fe1d39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1d40 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584329:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371ff400/0x1b69fa8920fe1c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1ca6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584335:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff400/0x1b69fa8920fe1c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1ca6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584340:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.584343:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584347:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371ff400/0x1b69fa8920fe1c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1ca6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584358:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe1cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1cc2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584372:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe1cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1cc2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584375:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361556.584384:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584388:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe1cbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1cc2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584400:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe1cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1cd0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584406:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe1cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1cd0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584411:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361556.584418:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584422:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe1cc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1cd0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584430:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aaca00/0x1b69fa8920fe1cf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1cfa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584437:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aaca00/0x1b69fa8920fe1cf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1cfa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584441:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361556.584451:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584454:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aaca00/0x1b69fa8920fe1cf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1cfa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.584474:0:85003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d005309a00/0x1b69fa8920fe1d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe1d24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361556.584480:0:85003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d005309a00/0x1b69fa8920fe1d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe1d24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.584486:0:85003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361556.584499:0:85003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361556.584503:0:85003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d005309a00/0x1b69fa8920fe1d1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe1d24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361556.584518:0:85003:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99d1054f2000 already not connected (conn 47, was 0): DISCONN 00000100:00080000:3.0:1788361556.584524:0:85003:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361556.584529:0:85003:0:(import.c:510:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 2377 00000100:00080000:3.0:1788361556.584536:0:85003:0:(import.c:624:import_select_connection()) MGC192.168.204.135@tcp: import ffff99d1054f2000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361556.584566:0:85003:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c1880 x1875230429732224/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361556.584584:0:85003:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788361556.584608:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429732224:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788361556.584666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.584808:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732224 00000100:00100000:1.0:1788361556.584814:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732224 00000100:00100000:1.0:1788361556.585066:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361556.585073:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875230429732224:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788361556.585099:0:85008:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo t0 exp 0000000000000000 cur 2596 last 0 00000020:00000080:1.0:1788361556.585124:0:85008:0:(genops.c:1406:class_connect()) connect: client c8a6f36d-efb9-41cf-af98-5917323f2b0d, cookie 0x1b69fa8920fe207a 00000100:00080000:1.0:1788361556.585251:0:85008:0:(import.c:65:import_set_state_nolock()) ffff99d005037000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361556.585336:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:3649:x1875230429732224:12345-0@lo:250:mount.lustre.0 Request processed in 263us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.585341:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361556.585407:0:3649:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 24 00000100:00080000:0.0:1788361556.585413:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:0.0:1788361556.585418:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788361556.585421:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788361556.585422:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788361556.585424:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788361556.585463:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788361556.585480:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429732224:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1788361556.585509:0:48377:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.135@tcp 00000100:00080000:2.0:1788361556.585524:0:85003:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 10000000:01000000:3.0:1788361556.585526:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788361556.585529:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361556.585531:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361556.585532:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361556.585532:0:85003:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788361556.585533:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361556.585534:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361556.585536:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361556.585537:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361556.585538:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361556.585540:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:2.0:1788361556.585558:0:85003:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788361556.585562:0:85003:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:3.0:1788361556.585575:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788361556.585586:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788361556.585588:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361556.585589:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361556.585590:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361556.585591:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361556.585592:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361556.585593:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361556.585593:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361556.585594:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361556.585595:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788361556.585609:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788361556.585612:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788361556.585614:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361556.585614:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788361556.585616:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361556.585617:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361556.585618:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361556.585618:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361556.585619:0:48377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361556.585620:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361556.585621:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788361556.585641:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788361556.585670:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429732480:0@lo:253:kworker.0 00000040:01000000:2.0:1788361556.585689:0:85003:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000100:00100000:3.0:1788361556.585714:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788361556.585721:0:85003:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788361556.585725:0:85003:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788361556.585726:0:85003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361556.585728:0:85003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361556.585729:0:85003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361556.585730:0:85003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361556.585731:0:85003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361556.585732:0:85003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361556.585734:0:85003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361556.585735:0:85003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361556.585737:0:85003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788361556.585740:0:85003:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000100:00100000:3.0:1788361556.585742:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:01000004:2.0:1788361556.585742:0:85003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361556.585744:0:85003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361556.585745:0:85003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361556.585746:0:85003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1788361556.585748:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429732352:0@lo:253:kworker.0 00000020:01000004:2.0:1788361556.585748:0:85003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361556.585749:0:85003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361556.585750:0:85003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361556.585752:0:85003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361556.585758:0:85003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361556.585759:0:85003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788361556.585771:0:85003:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361556.585774:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.585781:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429732736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361556.585795:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429732608:0@lo:253:kworker.0 00000100:00100000:2.0:1788361556.585813:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.585819:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.585846:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.585882:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732480 00000100:00100000:3.0:1788361556.585886:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732480 00000100:00100000:3.0:1788361556.585907:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732352 00000100:00100000:3.0:1788361556.585910:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732352 00000100:00100000:3.0:1788361556.585919:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732736 00000100:00100000:3.0:1788361556.585926:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732736 00000100:00100000:3.0:1788361556.585938:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732608 00000100:00100000:3.0:1788361556.585940:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732608 00000100:00100000:3.0:1788361556.585951:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361556.585956:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429732480:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788361556.585974:0:85010:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788361556.585980:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361556.585987:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429732352:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788361556.586001:0:85011:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:3.0:1788361556.586244:0:85012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788361556.586294:0:85010:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 103 20000000:01000000:2.0:1788361556.587690:0:85013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788361556.587696:0:85013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788361556.587699:0:85013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788361556.587712:0:85013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788361556.587911:0:85013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788361556.588148:0:85010:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361556.588203:0:85011:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361556.589543:0:85011:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361556.589557:0:85011:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788361556.589573:0:85012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361556.589576:0:85012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788361556.589599:0:85012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589615:0:85012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361556.589624:0:85012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048295s 00010000:00010000:2.0:1788361556.589629:0:85012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589637:0:85012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589644:0:85012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589650:0:85012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589657:0:85012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc0c1d300) 20000000:01000000:3.0:1788361556.589660:0:85010:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788361556.589674:0:85012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589683:0:85012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589694:0:85012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589712:0:85012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.589719:0:85012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715dc00/0x1b69fa8920fe2081 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361556.589914:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429732352:12345-0@lo:253:kworker.0 Request processed in 3923us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.589924:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361556.589968:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361556.589976:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:85003:x1875230429732736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361556.590003:0:85011:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361556.590006:0:85011:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361556.590023:0:85011:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788361556.590029:0:85011:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1788361556.590153:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361556.590155:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361556.590156:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361556.590158:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361556.590159:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361556.590161:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361556.590162:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361556.590164:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361556.590171:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361556.590174:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429732352:0@lo:253:kworker.0 20000000:01000000:3.0:1788361556.591762:0:85010:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361556.591780:0:85010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788361556.591931:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:85003:x1875230429732736:12345-0@lo:253:mount.lustre.0 Request processed in 1954us (6113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.591942:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361556.591975:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361556.591981:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:3651:x1875230429732480:12345-0@lo:253:kworker.0 Request processed in 6025us (6278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.591983:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1202ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:3652:x1875230429732608:12345-0@lo:253:kworker.0 00000100:00100000:3.0:1788361556.591988:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 20000000:01000000:0.0:1788361556.592004:0:85011:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:3.0:1788361556.592026:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361556.592038:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361556.592039:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361556.592040:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361556.592041:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361556.592042:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361556.592044:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361556.592045:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361556.592046:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361556.592049:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429732480:0@lo:253:kworker.0 20000000:01000000:2.0:1788361556.592162:0:85012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361556.592167:0:85012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1788361556.592181:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429732736:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1788361556.592184:0:85012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361556.592192:0:85003:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788361556.592194:0:85003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361556.592196:0:85003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00010000:00010000:2.0:1788361556.592197:0:85012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361556.592197:0:85003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361556.592198:0:85003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361556.592200:0:85003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361556.592201:0:85003:0:(tgt_mount.c:1180:server_mti_print()) flags: 20000000:01000000:2.0:1788361556.592206:0:85012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048295s 00000020:01000004:1.0:1788361556.592207:0:85003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361556.592208:0:85003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00010000:00010000:2.0:1788361556.592210:0:85012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361556.592210:0:85003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361556.592211:0:85003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00010000:00010000:2.0:1788361556.592217:0:85012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.592223:0:85012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361556.592229:0:85003:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d006aa8800 from lustre-MDT0000 00010000:00010000:2.0:1788361556.592237:0:85012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.592243:0:85012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361556.592247:0:85012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.592254:0:85012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361556.592256:0:85003:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788361556.592258:0:85003:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00010000:00010000:2.0:1788361556.592264:0:85012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.592271:0:85012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.592278:0:85012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2088 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361556.592497:0:85011:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 10000000:01000000:1.0:1788361556.592600:0:85003:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d006aa8800 10000000:01000000:1.0:1788361556.592605:0:85003:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788361556.592608:0:85003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99d006aa8800 10000000:01000000:1.0:1788361556.592611:0:85003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788361556.592669:0:85003:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d006aa8800 from 1 10000000:01000000:1.0:1788361556.592673:0:85003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788361556.592711:0:85003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.592720:0:85003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.592729:0:85003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.592748:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109066680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429732864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361556.592780:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.592814:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361556.592882:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732864 00000100:00100000:2.0:1788361556.592888:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732864 00000100:00100000:2.0:1788361556.593027:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361556.593035:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:85003:x1875230429732864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361556.593046:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361556.593057:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715d000/0x1b69fa8920fe2096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe208f expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.593072:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715d000/0x1b69fa8920fe2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe208f expref: 7 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.593093:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715d000/0x1b69fa8920fe2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe208f expref: 7 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.593100:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d000, rc 0) 00000100:00100000:2.0:1788361556.593175:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:85003:x1875230429732864:12345-0@lo:101:mount.lustre.0 Request processed in 141us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361556.593183:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361556.593256:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109066680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429732864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361556.593269:0:85003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.593277:0:85003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.593295:0:85003:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788361556.593311:0:85003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.593319:0:85003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.593335:0:85003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361556.593340:0:85003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361556.593344:0:85003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d006aa8800 10000000:01000000:3.0:1788361556.593346:0:85003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788361556.593349:0:85003:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788361556.593351:0:85003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361556.593365:0:85003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.593371:0:85003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.593378:0:85003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361556.593388:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429732992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361556.593415:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.593438:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361556.593455:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429732992 00000100:00100000:0.0:1788361556.593459:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429732992 00000100:00100000:0.0:1788361556.593527:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361556.593535:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:85003:x1875230429732992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361556.593542:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361556.593552:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1364d3400/0x1b69fa8920fe20a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe209d expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.593565:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1364d3400/0x1b69fa8920fe20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe209d expref: 8 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.593588:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1364d3400/0x1b69fa8920fe20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe209d expref: 8 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.593595:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d3400, rc 0) 00000100:00100000:0.0:1788361556.593635:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85003:x1875230429732992:12345-0@lo:101:mount.lustre.0 Request processed in 101us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.593641:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361556.594526:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429732992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361556.594541:0:85003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.594549:0:85003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361556.594600:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429733120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361556.594625:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.594654:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361556.594658:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733120 00000100:00100000:2.0:1788361556.594662:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733120 00000100:00100000:2.0:1788361556.594696:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361556.594714:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85003:x1875230429733120:12345-0@lo:501:mount.lustre.0 20000000:01000000:1.0:1788361556.594763:0:85011:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361556.594773:0:85011:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788361556.594844:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:85003:x1875230429733120:12345-0@lo:501:mount.lustre.0 Request processed in 141us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361556.594864:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361556.595050:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429733120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361556.595077:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429733248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361556.595119:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.595146:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4900 going to sleep for 11 seconds 20000000:01000000:1.0:1788361556.595217:0:85012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:0.0:1788361556.595220:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733248 10000000:01000000:1.0:1788361556.595221:0:85012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1788361556.595224:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733248 00010000:00010000:1.0:1788361556.595237:0:85012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595246:0:85012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361556.595257:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 20000000:01000000:1.0:1788361556.595258:0:85012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048295s 00010000:00010000:1.0:1788361556.595262:0:85012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595269:0:85012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361556.595270:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:85003:x1875230429733248:12345-0@lo:503:mount.lustre.0 00010000:00010000:1.0:1788361556.595276:0:85012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595283:0:85012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595290:0:85012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361556.595293:0:85012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595300:0:85012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595309:0:85012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595315:0:85012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.595320:0:85012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aad000/0x1b69fa8920fe20ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.595392:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1202ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:3652:x1875230429732608:12345-0@lo:253:kworker.0 Request processed in 3410us (9571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.595403:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1788361556.595516:0:3652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361556.595519:0:3652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788361556.595520:0:3652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361556.595521:0:3652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361556.595522:0:3652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361556.595524:0:3652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361556.595525:0:3652:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361556.595527:0:3652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361556.595529:0:3652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361556.595532:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429732608:0@lo:253:kworker.0 00000100:00100000:0.0:1788361556.595984:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85003:x1875230429733248:12345-0@lo:503:mount.lustre.0 Request processed in 721us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.595992:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361556.596491:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429733248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361556.596942:0:85014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85014:1875230429733376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361556.596981:0:85014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.597013:0:85014:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361556.597016:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733376 00000100:00100000:1.0:1788361556.597021:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733376 00000100:00100000:1.0:1788361556.597048:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361556.597056:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85014:x1875230429733376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.597570:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85014:x1875230429733376:12345-0@lo:502:llog_process_th.0 Request processed in 514us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.597577:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361556.597752:0:85014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85014:1875230429733376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361556.597775:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361556.597785:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.597787:0:85014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788361556.597792:0:85014:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788361556.597795:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361556.597808:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d003818000) 00000020:00000080:0.0:1788361556.598069:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788361556.598078:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788361556.598221:0:85014:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788361556.598230:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe20b9 00000020:00000080:0.0:1788361556.598528:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788361556.598533:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361556.598536:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.598538:0:85014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788361556.598541:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361556.598545:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.598546:0:85014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788361556.598550:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361556.598559:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d002360000) 00000020:00000080:0.0:1788361556.598573:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788361556.598585:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788361556.598587:0:85014:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788361556.598589:0:85014:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788361556.598596:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788361556.598819:0:85014:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d006aa8800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788361556.598972:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d13a3a8000) 00000020:00000080:0.0:1788361556.598983:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788361556.599038:0:85014:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788361556.599044:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe20ce 00000020:00000080:0.0:1788361556.599137:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788361556.599144:0:85014:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788361556.599149:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b69fa8920fe20d5 00080000:01000000:0.0:1788361556.599153:0:85014:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788361556.599157:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe20dc 00010000:00010000:1.0:1788361556.659568:0:85014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1788361556.660071:0:85014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: ec302d84-8f96-49d3-8682-aefc474f8448 idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:1.0:1788361556.660116:0:85014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:1.0:1788361556.660141:0:85014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:1.0:1788361556.660249:0:85014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1788361556.660304:0:85014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d00655a3c0: xid 1875230406957824, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:1.0:1788361556.662892:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d104013380) 00000020:00000080:1.0:1788361556.662920:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1788361556.663022:0:85014:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788361556.663031:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe20f8 00000020:00000080:0.0:1788361556.665227:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788361556.675141:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b69fa8920fe20ff 00000020:00000080:3.0:1788361556.675759:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788361556.675771:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361556.675778:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361556.675780:0:85014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788361556.675783:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361556.675786:0:85014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788361556.675788:0:85014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361556.675789:0:85014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361556.675791:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361556.675794:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361556.675796:0:85014:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361556.675799:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361556.675804:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361556.675805:0:85014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788361556.675810:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788361556.675889:0:85014:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788361556.675905:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361556.675908:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361556.675909:0:85014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788361556.675912:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361556.675915:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361556.675916:0:85014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788361556.675918:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361556.675923:0:85014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:3.0:1788361556.675946:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361556.675960:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d001c60000) 00000020:00000080:3.0:1788361556.675976:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788361556.675980:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361556.676156:0:85014:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788361556.676162:0:85014:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788361556.676173:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe210d 00010000:00080000:3.0:1788361556.676205:0:85014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d001c6a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361556.679928:0:85014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788361556.681029:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361556.681043:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788361556.681089:0:85014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788361556.681115:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2114 00000100:00080000:0.0:1788361556.681125:0:85014:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361556.681131:0:85014:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99d001c6a000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361556.681180:0:85014:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c91500 x1875230429733504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361556.681253:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429733504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361556.681333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.681435:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733504 00000100:00100000:3.0:1788361556.681442:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733504 00000100:00100000:3.0:1788361556.681471:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:3.0:1788361556.681478:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429733504:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788361556.681500:0:8448:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2596 last 0 00000020:00000080:3.0:1788361556.681530:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe211b 00000004:00100000:3.0:1788361556.681551:0:8448:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361556.681646:0:8448:0:(import.c:65:import_set_state_nolock()) ffff99d139ff4800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788361556.681709:0:85014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788361556.681771:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361556.681776:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.681777:0:85014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788361556.681781:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361556.681784:0:85014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788361556.681785:0:85014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361556.681787:0:85014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361556.681789:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361556.681797:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.681799:0:85014:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361556.681802:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361556.681806:0:85014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788361556.681810:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.681812:0:85014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788361556.681814:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361556.681818:0:85014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:0.0:1788361556.681853:0:85014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788361556.681856:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361556.681869:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d13a3acd40) 00000020:00000080:0.0:1788361556.681886:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788361556.681891:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788361556.681951:0:85014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788361556.681958:0:85014:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788361556.681962:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2129 00010000:00080000:0.0:1788361556.681986:0:85014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d12c4e7800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788361556.682155:0:85014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788361556.682577:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429733504:12345-0@lo:38:llog_process_th.0 Request processed in 1097us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.682586:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00080000:3.0:1788361556.682612:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361556.682617:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361556.682619:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361556.682624:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2594 00000100:00080000:3.0:1788361556.682627:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361556.682632:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361556.682654:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c3100 x1875230429733632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361556.682692:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361556.682696:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361556.682697:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361556.682709:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2594 00000100:00080000:3.0:1788361556.682711:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361556.682715:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361556.682733:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c0000 x1875230429733888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361556.682759:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361556.682763:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361556.682764:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361556.682767:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2594 00000100:00080000:3.0:1788361556.682769:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788361556.682773:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361556.682785:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c1180 x1875230429734144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361556.682803:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361556.682806:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361556.682808:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361556.682811:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2594 00000100:00080000:3.0:1788361556.682813:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361556.682816:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361556.682847:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365c2680 x1875230429734528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361556.682874:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429733760:0@lo:400:kworker.0 00000100:00100000:3.0:1788361556.682880:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429734016:0@lo:400:kworker.0 00000100:00100000:1.0:1788361556.682922:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.682929:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429734272:0@lo:400:kworker.0 00000100:00100000:1.0:1788361556.682960:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361556.682966:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.682969:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429734400:0@lo:400:kworker.0 00000100:00100000:1.0:1788361556.682999:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.683036:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733760 00000100:00100000:1.0:1788361556.683052:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733760 00000100:00100000:1.0:1788361556.683102:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1788361556.683118:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361556.683160:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429733760:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.683165:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1788361556.685642:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734272 00000100:00100000:3.0:1788361556.685656:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734272 00000100:00100000:2.0:1788361556.685661:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361556.685673:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1788361556.685682:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788361556.685689:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788361556.685693:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d001c6a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361556.685719:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429733504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361556.685730:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734400 00000100:00100000:3.0:1788361556.685750:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734400 00000100:00100000:2.0:1788361556.685755:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429733632:0@lo:38:kworker.0 00000100:00100000:3.0:1788361556.685782:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1788361556.685793:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429734272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361556.685885:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1788361556.685895:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429734400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361556.685953:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429734400:12345-0@lo:400:kworker.0 Request processed in 59us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.685956:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429734272:12345-0@lo:400:kworker.0 Request processed in 164us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361556.685967:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.685967:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:3.0:1788361556.685981:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00080000:1.0:1788361556.686021:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361556.686027:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361556.686028:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429734272:0@lo:400:kworker.0 00000100:00080000:1.0:1788361556.686050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361556.686066:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429733888:0@lo:38:kworker.0 00000100:00100000:1.0:1788361556.686073:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733632 00000100:00100000:1.0:1788361556.686078:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733632 00000040:01000000:0.0:1788361556.686080:0:85014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788361556.686089:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361556.686102:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429734656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361556.686110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.686113:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788361556.686121:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429733632:12345-0@lo:38:kworker.0 00000040:01000000:0.0:1788361556.686123:0:85014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788361556.686141:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429734144:0@lo:38:kworker.0 00000100:00100000:3.0:1788361556.686154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.686182:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429733632:12345-0@lo:38:kworker.0 Request processed in 60us (362us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361556.686190:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1788361556.686197:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429733888 00000100:00100000:2.0:1788361556.686202:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429733888 00000100:00100000:1.0:1788361556.686217:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.686229:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734016 00000100:00100000:2.0:1788361556.686233:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734016 00000100:00080000:1.0:1788361556.686254:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361556.686267:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1788361556.686273:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429733888:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361556.686289:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1788361556.686301:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361556.686312:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429733888:12345-0@lo:38:kworker.0 Request processed in 37us (205us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361556.686320:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734656 00000100:00100000:1.0:1788361556.686320:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788361556.686327:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734656 00000100:00100000:2.0:1788361556.686356:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429734016:12345-0@lo:400:kworker.0 Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.686365:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429734016:0@lo:400:kworker.0 00000100:00100000:3.0:1788361556.686368:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1788361556.686369:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1788361556.686384:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429734656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361556.686407:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429734400:0@lo:400:kworker.0 00000004:00000024:3.0:1788361556.686411:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361556.686422:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429733760:0@lo:400:kworker.0 00000100:00100000:3.0:1788361556.686457:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429734656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.686466:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:0.0:1788361556.686508:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429734656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361556.686521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.686549:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429734528:0@lo:38:kworker.0 00000100:00100000:3.0:1788361556.686568:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734144 00000100:00100000:3.0:1788361556.686574:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734144 00000100:00100000:2.0:1788361556.686579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.686596:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:3.0:1788361556.686602:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429734144:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788361556.686617:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361556.686624:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361556.686624:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734528 00000100:00100000:0.0:1788361556.686631:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734528 00000100:00100000:2.0:1788361556.686632:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429733632:0@lo:38:kworker.0 00000100:00100000:3.0:1788361556.686643:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429734144:12345-0@lo:38:kworker.0 Request processed in 39us (136us total) trans 0 rc -11/-11 00000100:00080000:2.0:1788361556.686648:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788361556.686652:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00080000:2.0:1788361556.686656:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361556.686662:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429733888:0@lo:38:kworker.0 00000100:00100000:0.0:1788361556.686664:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00080000:2.0:1788361556.686676:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361556.686680:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361556.686683:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429734144:0@lo:38:kworker.0 00000100:00100000:0.0:1788361556.686740:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429734528:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361556.686792:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429734528:12345-0@lo:38:kworker.0 Request processed in 55us (213us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361556.686799:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000040:00080000:1.0:1788361556.686914:0:85014:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000100:00080000:2.0:1788361556.687028:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361556.687039:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361556.687043:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429734528:0@lo:38:kworker.0 00000040:00080000:1.0:1788361556.688650:0:85014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361556.689017:0:85014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:1.0:1788361556.693803:0:85014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:3.0:1788361556.694365:0:85020:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:3.0:1788361556.694370:0:85020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788361556.694539:0:85020:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1788361556.694558:0:85020:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788361556.694810:0:85020:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1788361556.694813:0:85020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788361556.695446:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361556.695458:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788361556.695495:0:85014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788361556.695519:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2130 00000100:00080000:0.0:1788361556.695531:0:85014:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361556.695537:0:85014:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d12c4e7800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361556.695572:0:85014:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c92d80 x1875230429734784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361556.695807:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429734784:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788361556.695988:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361556.696069:0:85014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788361556.696082:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734784 00000100:00100000:1.0:1788361556.696090:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734784 00000100:00100000:1.0:1788361556.696121:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4861 00000020:01000000:0.0:1788361556.696126:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788361556.696128:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3649:x1875230429734784:12345-0@lo:8:llog_process_th.0 00000020:00000080:0.0:1788361556.696129:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.696131:0:85014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788361556.696134:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361556.696137:0:85014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788361556.696138:0:85014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361556.696140:0:85014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361556.696141:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361556.696144:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.696145:0:85014:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361556.696148:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361556.696152:0:85014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788361556.696156:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361556.696157:0:85014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788361556.696160:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361556.696164:0:85014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:0.0:1788361556.696184:0:85014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788361556.696187:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361556.696206:0:85014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99d1053199c0) 00000020:00000080:0.0:1788361556.696327:0:85014:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00010000:00080000:1.0:1788361556.696331:0:15123:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2596 last 0 00000020:00000080:0.0:1788361556.696334:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:1.0:1788361556.696356:0:15123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe213e 00002000:00100000:1.0:1788361556.696369:0:15123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d003822000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788361556.696373:0:15123:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788361556.696375:0:15123:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:0.0:1788361556.696402:0:85014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788361556.696407:0:85014:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788361556.696412:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2145 00002000:00080000:1.0:1788361556.696431:0:15123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:0.0:1788361556.696441:0:85014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d0055d7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00000100:00080000:1.0:1788361556.696448:0:15123:0:(import.c:65:import_set_state_nolock()) ffff99d003825000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361556.696510:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429734784:12345-0@lo:8:llog_process_th.0 Request processed in 381us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.696517:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4861 00000100:00100000:2.0:1788361556.696623:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361556.696630:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788361556.696634:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788361556.696638:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788361556.696639:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d12c4e7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788361556.696660:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788361556.696664:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429734784:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788361556.696691:0:85020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788361556.696745:0:85020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2596705922099ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788361556.696753:0:85020:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788361556.698580:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429734912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361556.698683:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361556.698767:0:85014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1788361556.698854:0:85014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788361556.698932:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429734912 00000100:00100000:1.0:1788361556.698939:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429734912 00000040:01000000:0.0:1788361556.698942:0:85014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788361556.698991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1788361556.698999:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429734912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361556.699023:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361556.699076:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429734912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.699083:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1788361556.699128:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429734912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788361556.699171:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788361556.699836:0:85014:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000004:00080000:3.0:1788361556.700310:0:85004:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1788361556.700593:0:85014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361556.700618:0:85014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:0.0:1788361556.701562:0:85014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:0.0:1788361556.702976:0:85022:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1788361556.702983:0:85022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788361556.703674:0:85014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361556.703687:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788361556.704263:0:85014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788361556.704291:0:85014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe214c 00000100:00080000:1.0:1788361556.704392:0:85014:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361556.704398:0:85014:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d0055d7800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361556.704435:0:85014:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d109066a00 x1875230429735040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361556.704463:0:85014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788361556.704560:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361556.704565:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.704567:0:85014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788361556.704570:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361556.704573:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.704575:0:85014:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361556.704578:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361556.704580:0:85014:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361556.704582:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361556.704585:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.704586:0:85014:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361556.704588:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361556.704591:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.704592:0:85014:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361556.704596:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788361556.704625:0:85014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109065c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85014:1875230429735168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.704713:0:85014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.704748:0:85014:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361556.704956:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429735040:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361556.704972:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735168 00000100:00100000:0.0:1788361556.704979:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735168 00000100:00100000:2.0:1788361556.704997:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.705037:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361556.705048:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85014:x1875230429735168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361556.705170:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85014:x1875230429735168:12345-0@lo:502:llog_process_th.0 Request processed in 124us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.705178:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361556.705323:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735040 00000100:00100000:1.0:1788361556.705328:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735040 00000100:00100000:1.0:1788361556.705357:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4862 00000100:00100000:1.0:1788361556.705361:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1875230429735040:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788361556.705385:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2596 last 0 00000020:00000080:1.0:1788361556.705416:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2153 00002000:00100000:1.0:1788361556.705429:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d136ca5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788361556.705433:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788361556.705435:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788361556.705497:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361556.705517:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99d105495000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361556.705565:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429735040:12345-0@lo:8:llog_process_th.0 Request processed in 202us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.705572:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4862 00000100:00100000:3.0:1788361556.705612:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361556.705621:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788361556.705627:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788361556.705631:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788361556.705635:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d0055d7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788361556.705655:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788361556.705661:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429735040:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788361556.705733:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429735296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788361556.705740:0:85014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109065c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85014:1875230429735168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361556.705764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788361556.705769:0:85014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361556.705775:0:85014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361556.705778:0:85014:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788361556.705783:0:85014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788361556.705810:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735296 00000100:00100000:3.0:1788361556.705815:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735296 00000100:00080000:0.0:1788361556.705872:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361556.705887:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863 00000100:00100000:3.0:1788361556.705896:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429735296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788361556.705915:0:26166:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1698 count 1 00000100:00100000:3.0:1788361556.706067:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429735296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 173us (302us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361556.706084:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863 00000020:01000000:3.0:1788361556.706113:0:85003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788361556.706136:0:85003:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788361556.706155:0:85003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.706165:0:85003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361556.706174:0:85003:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d006aa8800 from 1 10000000:01000000:3.0:1788361556.706178:0:85003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361556.706214:0:85003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.706222:0:85003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.706232:0:85003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361556.706244:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361556.706271:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788361556.706273:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d1365c2a00, transno 0 00000004:00080000:2.0:1788361556.706278:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d1365c2a00/1, rc -2, transno 0 00000100:00100000:2.0:1788361556.706283:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429735296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788361556.706305:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361556.706346:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361556.706355:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429735552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361556.706381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788361556.706412:0:85022:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1788361556.706432:0:85022:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788361556.706442:0:85022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:3.0:1788361556.706562:0:85022:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1788361556.706566:0:85022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788361556.706583:0:85022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788361556.706614:0:85022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2596715790748ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788361556.706620:0:85022:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788361556.706697:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735424 00000100:00100000:0.0:1788361556.706711:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735424 00000100:00100000:0.0:1788361556.706740:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361556.706746:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:85003:x1875230429735424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361556.706755:0:85011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361556.706774:0:85011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe215a expref: -99 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.706792:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735552 00010000:00010000:0.0:1788361556.706794:0:85011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 9 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.706800:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735552 00010000:00010000:0.0:1788361556.706809:0:85011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 9 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.706819:0:85011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d3600, rc 0) 00000100:00100000:1.0:1788361556.706854:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1788361556.706864:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429735552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361556.706872:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:85003:x1875230429735424:12345-0@lo:101:mount.lustre.0 Request processed in 124us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.706879:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00000024:1.0:1788361556.706884:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361556.706933:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429735552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.706940:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1788361556.706980:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429735552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361556.707076:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361556.707089:0:85003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.707098:0:85003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361556.707570:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735680:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788361556.707610:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.707682:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361556.707726:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735680 00000100:00100000:0.0:1788361556.707730:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735680 00000100:00100000:0.0:1788361556.707768:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361556.707776:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:85003:x1875230429735680:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788361556.707791:0:85008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788361556.707806:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361556.707810:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361556.707814:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361556.707817:0:85008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 106 00000100:00100000:0.0:1788361556.708123:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:85003:x1875230429735680:12345-0@lo:256:mount.lustre.0 Request processed in 347us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.708132:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361556.708225:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735680:0@lo:256:mount.lustre.0 00000004:00080000:2.0:1788361556.708541:0:85004:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:1.0:1788361556.709036:0:85003:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361556.709091:0:85003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709103:0:85003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361556.709123:0:85003:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d006aa8800 from 1 10000000:01000000:1.0:1788361556.709126:0:85003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361556.709155:0:85003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709163:0:85003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709172:0:85003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.709187:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361556.709219:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.709248:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.709297:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735808 00000100:00100000:3.0:1788361556.709301:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735808 00000100:00100000:3.0:1788361556.709332:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361556.709339:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:85003:x1875230429735808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361556.709349:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361556.709362:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe216f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2168 expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709378:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe216f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2168 expref: 10 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709387:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe216f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2168 expref: 10 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709395:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e600, rc 0) 00000100:00100000:3.0:1788361556.709426:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85003:x1875230429735808:12345-0@lo:101:mount.lustre.0 Request processed in 87us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.709440:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361556.709451:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361556.709464:0:85003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.709472:0:85003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361556.709516:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361556.709611:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.709630:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361556.709696:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429735936 00000100:00100000:0.0:1788361556.709713:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429735936 00000100:00100000:0.0:1788361556.709774:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361556.709780:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85003:x1875230429735936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361556.709900:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85003:x1875230429735936:12345-0@lo:501:mount.lustre.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.709907:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361556.709990:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429735936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361556.710033:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361556.710167:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.710196:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361556.710209:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736064 00000100:00100000:1.0:1788361556.710215:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736064 00000100:00100000:1.0:1788361556.710247:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361556.710254:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85003:x1875230429736064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361556.710328:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85003:x1875230429736064:12345-0@lo:503:mount.lustre.0 Request processed in 76us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.710333:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361556.710792:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361556.711339:0:85024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109066300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85024:1875230429736192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.711378:0:85024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.711408:0:85024:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361556.711609:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736192 00000100:00100000:0.0:1788361556.711614:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736192 00000100:00100000:0.0:1788361556.711647:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361556.711654:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d001f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85024:x1875230429736192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361556.712154:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d001f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85024:x1875230429736192:12345-0@lo:502:llog_process_th.0 Request processed in 499us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.712162:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361556.712243:0:85024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109066300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85024:1875230429736192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361556.712268:0:85024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361556.712280:0:85024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.712283:0:85024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788361556.712289:0:85024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d006aa8800 00000020:00000080:1.0:1788361556.712292:0:85024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361556.712299:0:85024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361556.712302:0:85024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.712303:0:85024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788361556.712305:0:85024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361556.712308:0:85024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361556.712309:0:85024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788361556.712312:0:85024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d006aa8800 00000020:00000080:1.0:1788361556.712314:0:85024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788361556.712391:0:85024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109066300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85024:1875230429736320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.712424:0:85024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.712849:0:85024:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.713043:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736320 00000100:00100000:3.0:1788361556.713048:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736320 00000100:00100000:3.0:1788361556.713073:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361556.713080:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d001f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85024:x1875230429736320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361556.713184:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d001f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85024:x1875230429736320:12345-0@lo:502:llog_process_th.0 Request processed in 104us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.713191:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361556.713299:0:85024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109066300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85024:1875230429736320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361556.713318:0:85024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361556.713322:0:85024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361556.713324:0:85024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788361556.713328:0:85024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788361556.713508:0:85003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788361556.713548:0:85003:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361556.713600:0:85003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.713612:0:85003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361556.713667:0:85003:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361556.713671:0:85003:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d006aa8800 10000000:01000000:1.0:1788361556.713674:0:85003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d006aa8800 10000000:01000000:1.0:1788361556.713677:0:85003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361556.713683:0:85003:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d006aa8800 from 1 10000000:01000000:1.0:1788361556.713686:0:85003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361556.713722:0:85003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.713739:0:85003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.713748:0:85003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.713762:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109064e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361556.713790:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.713819:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.713887:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736448 00000100:00100000:3.0:1788361556.713892:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736448 00000100:00100000:3.0:1788361556.713956:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361556.713964:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d001f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:85003:x1875230429736448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361556.713972:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361556.713983:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0f600/0x1b69fa8920fe217d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2176 expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.714003:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0f600/0x1b69fa8920fe217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2176 expref: 11 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.714012:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0f600/0x1b69fa8920fe217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2176 expref: 11 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.714020:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0f600, rc 0) 00000100:00100000:3.0:1788361556.714048:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d001f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429736448:12345-0@lo:101:mount.lustre.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.714054:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361556.714151:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109064e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361556.714163:0:85003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.714172:0:85003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.714219:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109064e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361556.714241:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.714298:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.714334:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736576 00000100:00100000:3.0:1788361556.714343:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736576 00000100:00100000:3.0:1788361556.714369:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361556.714375:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d001f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429736576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361556.714481:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d001f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429736576:12345-0@lo:501:mount.lustre.0 Request processed in 105us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.714488:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361556.714500:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109064e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361556.714527:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361556.714561:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.714608:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361556.714639:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736704 00000100:00100000:2.0:1788361556.714643:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736704 00000100:00100000:2.0:1788361556.714713:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361556.714721:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429736704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361556.714804:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429736704:12345-0@lo:503:mount.lustre.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361556.714818:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361556.714920:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429736704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361556.715266:0:85026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85026:1875230429736832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361556.715297:0:85026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.715318:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736832 00000100:00100000:0.0:1788361556.715322:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736832 00000100:00100000:0.0:1788361556.715342:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361556.715347:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85026:x1875230429736832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361556.715414:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85026:x1875230429736832:12345-0@lo:502:llog_process_th.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.715421:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361556.715456:0:85026:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361556.715468:0:85026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85026:1875230429736832:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788361556.715513:0:85026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788361556.715527:0:85026:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99d10531cd40) 00000020:00000080:0.0:1788361556.715549:0:85026:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788361556.718799:0:85026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d006aa8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361556.718809:0:85026:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d006aa8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361556.718812:0:85026:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d006aa8800 4 00010000:00080000:1.0:1788361556.718864:0:85026:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d005034800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788361556.722515:0:85026:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788361556.722638:0:85026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788361556.722689:0:85026:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788361556.722716:0:85026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b69fa8920fe218b 00000100:00080000:1.0:1788361556.722732:0:85026:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361556.722738:0:85026:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d005034800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361556.722772:0:85026:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d109065880 x1875230429736960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361556.722805:0:85026:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788361556.723015:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429736960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361556.723088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.724398:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429736960 00000100:00100000:1.0:1788361556.724408:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429736960 00000100:00100000:1.0:1788361556.724455:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1788361556.724463:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429736960:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361556.724536:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429736960:12345-0@lo:38:llog_process_th.0 Request processed in 72us (1448us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361556.724544:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1788361556.724648:0:85026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85026:1875230429737088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.724695:0:85026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.724734:0:85026:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11f01bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361556.724817:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361556.724850:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361556.724854:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361556.724858:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429736960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361556.724885:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737088 00000100:00100000:0.0:1788361556.724888:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737088 00000100:00100000:0.0:1788361556.724918:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361556.724925:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85026:x1875230429737088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361556.725102:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85026:x1875230429737088:12345-0@lo:502:llog_process_th.0 Request processed in 177us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.725110:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361556.725408:0:85026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85026:1875230429737088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.725455:0:85026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85026:1875230429737216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361556.725494:0:85026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.725523:0:85026:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11f01bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.725542:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737216 00000100:00100000:3.0:1788361556.725547:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737216 00000100:00100000:3.0:1788361556.725581:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361556.725591:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85026:x1875230429737216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361556.725685:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85026:x1875230429737216:12345-0@lo:502:llog_process_th.0 Request processed in 95us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.725694:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788361556.725809:0:85026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85026:1875230429737216:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361556.725909:0:85026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788361556.726096:0:85003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788361556.726119:0:85003:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361556.726176:0:85003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.726187:0:85003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361556.726246:0:85003:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788361556.726251:0:85003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361556.726263:0:85003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361556.726265:0:85003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361556.726266:0:85003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361556.726267:0:85003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361556.726268:0:85003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361556.726269:0:85003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361556.726271:0:85003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361556.726272:0:85003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361556.726276:0:85003:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788361556.726279:0:85003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361556.726280:0:85003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361556.726281:0:85003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361556.726282:0:85003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361556.726283:0:85003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361556.726284:0:85003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361556.726285:0:85003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361556.726285:0:85003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361556.726286:0:85003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361556.726287:0:85003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361556.726301:0:85003:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788361556.726311:0:85003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429737344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361556.726344:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.726368:0:85003:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0040e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.726382:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737344 00000100:00100000:3.0:1788361556.726387:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737344 00000100:00100000:3.0:1788361556.726417:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361556.726424:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429737344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361556.726444:0:85010:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788361556.726456:0:85010:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361556.731574:0:85010:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361556.731631:0:85010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788361556.732095:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:85003:x1875230429737344:12345-0@lo:253:mount.lustre.0 Request processed in 5667us (5745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.732109:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361556.732265:0:85003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:85003:1875230429737344:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361556.732282:0:85003:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788361556.732297:0:85003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361556.732299:0:85003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361556.732301:0:85003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361556.732302:0:85003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361556.732303:0:85003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361556.732305:0:85003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361556.732306:0:85003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361556.732307:0:85003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361556.732309:0:85003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361556.732311:0:85003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788361556.732327:0:85003:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788361556.734176:0:85012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361556.734183:0:85012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788361556.734204:0:85012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.734230:0:85012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 10 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.734238:0:85012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.734276:0:85012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 10 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.734289:0:85012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 10 pid: 85011 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361556.734302:0:85012:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85012:1875230429737472:0@lo:104: 00000100:00100000:2.0:1788361556.734358:0:85012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.734399:0:85012:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361556.734549:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737472 00000100:00100000:1.0:1788361556.734555:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737472 00000100:00100000:1.0:1788361556.734605:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788361556.734614:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:85012:x1875230429737472:12345-0@lo:104: 00010000:00010000:1.0:1788361556.734627:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.734710:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361556.734716:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:85012:x1875230429737472:12345-0@lo:104: Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.734723:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:1.0:1788361556.734747:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361556.734754:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.734762:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0e000 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361556.734766:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.734774:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361556.734799:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361556.734805:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361556.734922:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.734929:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361556.734947:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.734953:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe215a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2161 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.734965:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361556.734966:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361556.734968:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361556.734979:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429737600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361556.735071:0:85012:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85012:1875230429737472:0@lo:104: 00000100:00100000:1.0:1788361556.735073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361556.735098:0:85012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.735120:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737600 00000100:00100000:1.0:1788361556.735123:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737600 00010000:00010000:1.0:1788361556.735139:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 11 pid: 85011 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.735172:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1788361556.735180:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3653:x1875230429737600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361556.735190:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361556.735196:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 11 pid: 85011 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735215:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 11 pid: 85011 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735240:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1364d3600/0x1b69fa8920fe2161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe215a expref: 11 pid: 85011 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735254:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735262:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361556.735276:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001093221s 00010000:00010000:1.0:1788361556.735280:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735288:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735297:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735303:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735310:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361556.735314:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735321:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735346:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735356:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361556.735389:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:3653:x1875230429737600:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.735397:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1788361556.735429:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429737600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361556.735445:0:85012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735453:0:85012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.735459:0:85012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2192 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788361556.743289:0:85003:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411366 00000040:01000000:0.0:1788361556.743681:0:85003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788361556.743755:0:85032:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411366 00000020:00080000:1.0:1788361556.743759:0:85032:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411366 00000040:01000000:1.0:1788361556.744167:0:85033:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788361556.744198:0:85003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788361556.744222:0:85033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361556.746365:0:85034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85034:1875230429737728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361556.746433:0:85034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.746469:0:85034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.746837:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737728 00000100:00100000:3.0:1788361556.746846:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737728 00000100:00100000:3.0:1788361556.746893:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000040:01000000:0.0:1788361556.746893:0:85003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:3.0:1788361556.746901:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85034:x1875230429737728:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788361556.746932:0:85003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361556.746974:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85034:x1875230429737728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.746982:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:2.0:1788361556.747389:0:85034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85034:1875230429737728:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788361556.747435:0:85034:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788361556.747462:0:85034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85034:1875230429737856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361556.747492:0:85034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.747521:0:85034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361556.747903:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737856 00000100:00100000:3.0:1788361556.747914:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737856 00000100:00100000:3.0:1788361556.747943:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:3.0:1788361556.747949:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85034:x1875230429737856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361556.748041:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85034:x1875230429737856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.748047:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:2.0:1788361556.748378:0:85034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85034:1875230429737856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361556.748451:0:85034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85034:1875230429737984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361556.748481:0:85034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361556.748504:0:85034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b3e40 going to sleep for 11 seconds 00000004:00000080:0.0:1788361556.748574:0:85003:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788361556.748583:0:85003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788361556.748633:0:85003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361556.748763:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429737984 00000100:00100000:3.0:1788361556.748768:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429737984 00000100:00100000:3.0:1788361556.748801:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:3.0:1788361556.748807:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85034:x1875230429737984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361556.748869:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85034:x1875230429737984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361556.748876:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:2.0:1788361556.748962:0:85034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85034:1875230429737984:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788361556.749005:0:85034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361556.749190:0:85033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788361556.749240:0:85033:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788361556.756215:0:85003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788361556.757212:0:85003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788361556.757251:0:85003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788361556.757450:0:85003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361556.757611:0:85034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788361556.757687:0:85034:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788361556.757690:0:85034:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:0.0:1788361556.757994:0:85003:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:1.0:1788361556.760086:0:85003:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:1.0:1788361556.763105:0:85035:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85035 00010000:02000000:1.0:1788361556.763128:0:85035:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788361556.763132:0:85035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788361556.763142:0:85035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788361556.763223:0:85003:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361556.763242:0:85003:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361556.763262:0:85003:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788361556.763292:0:85003:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788361556.764291:0:85003:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788361556.764541:0:85003:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788361556.821953:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361556.821976:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429738112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361556.822044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.822084:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738112 00000100:00100000:1.0:1788361556.822089:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738112 00000100:00100000:1.0:1788361556.822125:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1788361556.822133:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429738112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361556.822155:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361556.822199:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429738112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.822207:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1788361556.822255:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429738112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361556.823038:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361556.823053:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429738240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361556.823100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361556.823138:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738240 00000100:00100000:1.0:1788361556.823144:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738240 00000100:00100000:1.0:1788361556.823174:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1788361556.823183:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429738240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361556.823195:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361556.823232:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429738240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361556.823239:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1788361556.823274:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429738240:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788361557.079029:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361558.102931:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361558.166902:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361558.166910:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d006aa8800 from 107 10000000:01000000:1.0:1788361558.166916:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361558.166971:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361558.166995:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361558.167007:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361558.167035:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361558.167109:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361558.167164:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.167178:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738368 00000100:00100000:3.0:1788361558.167194:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738368 00000100:00100000:3.0:1788361558.167319:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361558.167333:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:6520:x1875230429738368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361558.167354:0:85011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361558.167378:0:85011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0f800/0x1b69fa8920fe21a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2199 expref: -99 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.167413:0:85011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0f800/0x1b69fa8920fe21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2199 expref: 11 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.167443:0:85011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0f800/0x1b69fa8920fe21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2199 expref: 11 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.167454:0:85011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0f800, rc 0) 00000100:00100000:3.0:1788361558.167536:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429738368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.167543:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361558.167642:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.167666:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.167688:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.167750:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.167794:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.167950:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.168060:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738496 00000100:00100000:3.0:1788361558.168068:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738496 00000100:00100000:3.0:1788361558.168139:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361558.168148:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429738496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361558.168168:0:85010:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361558.168187:0:85010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361558.168190:0:85010:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 107 00000100:00100000:3.0:1788361558.168305:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429738496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.168314:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361558.168338:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361558.168396:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361558.168403:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.168412:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361558.168422:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361558.168425:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 52 10000000:01000000:0.0:1788361558.168434:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361558.168465:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.168480:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.168488:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.168502:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.168535:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.168564:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.168705:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738624 00000100:00100000:3.0:1788361558.168712:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738624 00000100:00100000:3.0:1788361558.168818:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361558.168857:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429738624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361558.168871:0:85011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361558.168885:0:85011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe21ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21a7 expref: -99 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.168906:0:85011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21a7 expref: 12 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.168927:0:85011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21a7 expref: 12 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.168936:0:85011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e800, rc 0) 00000100:00100000:3.0:1788361558.168974:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429738624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.168981:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788361558.169060:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.169071:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.169080:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.169133:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.169160:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.169190:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.169232:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738752 00000100:00100000:3.0:1788361558.169236:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738752 00000100:00100000:3.0:1788361558.169263:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361558.169271:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429738752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.169382:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429738752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.169389:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788361558.169573:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.169608:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.169648:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.169681:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361558.169706:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429738880 00000100:00100000:0.0:1788361558.169710:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429738880 00000100:00100000:0.0:1788361558.169744:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361558.169751:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0022e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429738880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.169848:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0022e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429738880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361558.169856:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361558.169863:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429738880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361558.171109:0:85183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788361558.171379:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788361558.171422:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361558.171436:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.171447:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361558.171461:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788361558.171470:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 104 10000000:01000000:0.0:1788361558.171473:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361558.171501:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.171509:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.171518:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.171535:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.171655:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.171787:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739008 00000100:00100000:2.0:1788361558.171793:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739008 00000100:00100000:0.0:1788361558.171803:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.171902:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788361558.171913:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0022e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429739008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.171924:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.171936:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe21bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21b5 expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.171957:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21b5 expref: 13 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.171967:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21b5 expref: 13 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.171975:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c000, rc 0) 00000100:00100000:2.0:1788361558.172017:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0022e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429739008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.172024:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361558.172158:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.172171:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.172181:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.172222:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.172250:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.172362:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.173067:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739136 00000100:00100000:2.0:1788361558.173073:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739136 00000100:00100000:2.0:1788361558.173102:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361558.173109:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0022e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429739136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361558.173130:0:85011:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788361558.173143:0:85011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361558.173146:0:85011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788361558.173149:0:85011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788361558.173152:0:85011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788361558.173154:0:85011:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:2.0:1788361558.173243:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0022e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429739136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.173251:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361558.173317:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361558.173389:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361558.173396:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.173509:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361558.173518:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788361558.173520:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788361558.173523:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361558.173542:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.173550:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.173637:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.173654:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.173739:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.173768:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.173872:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739264 00000100:00100000:2.0:1788361558.173876:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739264 00000100:00100000:2.0:1788361558.173907:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361558.173914:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0022e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429739264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.173921:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.173932:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe21ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21c3 expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.173950:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21c3 expref: 14 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.173959:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21c3 expref: 14 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.173966:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c800, rc 0) 00000100:00100000:2.0:1788361558.173999:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0022e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429739264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.174005:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788361558.174023:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.174035:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.174044:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.174091:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.174115:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.174147:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.174278:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739392 00000100:00100000:2.0:1788361558.174282:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739392 00000100:00100000:2.0:1788361558.174317:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361558.174325:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0022e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429739392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.174452:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0022e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429739392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.174458:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788361558.174559:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.174586:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.174622:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.174643:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.174700:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739520 00000100:00100000:2.0:1788361558.174705:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739520 00000100:00100000:2.0:1788361558.174731:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361558.174736:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0022e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429739520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.175440:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0022e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429739520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 701us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.175448:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361558.175668:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361558.176358:0:85184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788361558.176441:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788361558.176479:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788361558.176489:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.176500:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361558.176510:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788361558.176513:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d002df9000 from 1 10000000:01000000:0.0:1788361558.176516:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361558.176547:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.176556:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.176576:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.176595:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.176646:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.176686:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361558.176703:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739648 00000100:00100000:0.0:1788361558.176707:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739648 00000100:00100000:0.0:1788361558.176747:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361558.176757:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00723a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429739648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.176769:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361558.176781:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1364d3800/0x1b69fa8920fe21d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21d1 expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.176806:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1364d3800/0x1b69fa8920fe21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21d1 expref: 15 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.176816:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1364d3800/0x1b69fa8920fe21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21d1 expref: 15 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.176849:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d3800, rc 0) 00000100:00100000:0.0:1788361558.176946:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00723a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429739648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361558.176953:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361558.176976:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.176990:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.177000:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361558.177014:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788361558.177019:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.177027:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361558.177033:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788361558.177040:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d002df9000 from 7 10000000:01000000:2.0:1788361558.177043:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361558.177056:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.177063:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.177069:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.177082:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.177110:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.177140:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361558.177576:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739776 00000100:00100000:0.0:1788361558.177581:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739776 00000100:00100000:0.0:1788361558.177612:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788361558.177624:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429739776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.177632:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361558.177640:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1364d2200/0x1b69fa8920fe21e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21df expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.177654:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1364d2200/0x1b69fa8920fe21e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21df expref: 16 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.177668:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1364d2200/0x1b69fa8920fe21e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21df expref: 16 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.177684:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d2200, rc 0) 00000100:00100000:0.0:1788361558.177718:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429739776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361558.177725:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361558.177818:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.177883:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.177891:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.177941:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.177967:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.178054:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361558.178497:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429739904 00000100:00100000:0.0:1788361558.178502:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429739904 00000100:00100000:0.0:1788361558.178535:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361558.178542:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429739904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.179048:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429739904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 505us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361558.179056:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361558.179771:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429739904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.179847:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.179901:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.179937:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361558.179973:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740032 00000100:00100000:0.0:1788361558.179979:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740032 00000100:00100000:0.0:1788361558.180013:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361558.180019:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00723a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429740032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.180119:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00723a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429740032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361558.180126:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361558.180360:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361558.181358:0:85185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788361558.181442:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788361558.181479:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788361558.181487:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.181495:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361558.181501:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788361558.181504:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 52 10000000:01000000:2.0:1788361558.181506:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361558.181532:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.181537:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.181543:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.181565:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.181593:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.181625:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740160 00000100:00100000:2.0:1788361558.181627:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.181632:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740160 00000100:00100000:3.0:1788361558.181682:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361558.181691:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00723bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429740160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361558.181702:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361558.181717:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe21f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21ed expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.181740:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe21f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21ed expref: 17 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.181764:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe21f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21ed expref: 17 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.181773:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0fc00, rc 0) 00000100:00100000:2.0:1788361558.181886:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.181901:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.181911:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.181967:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.182053:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.182080:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.182113:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00723bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429740160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 424us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.182121:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361558.182141:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740288 00000100:00100000:3.0:1788361558.182144:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740288 00000100:00100000:3.0:1788361558.182203:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788361558.182210:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429740288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.182330:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429740288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.182338:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788361558.182430:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.182460:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.182498:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.182511:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.182522:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740416 00000100:00100000:2.0:1788361558.182526:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740416 00000100:00100000:2.0:1788361558.182545:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788361558.182551:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00723b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429740416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.182625:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00723b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429740416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.182631:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788361558.182668:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361558.185232:0:85186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788361558.185400:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788361558.185423:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361558.185434:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.185445:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361558.185456:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788361558.185459:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788361558.185462:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788361558.185499:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.185519:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.185530:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.185555:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.185615:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.185707:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.185744:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740544 00000100:00100000:2.0:1788361558.185750:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740544 00000100:00100000:2.0:1788361558.185848:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788361558.185858:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00723b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429740544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.185871:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.185884:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe21fb expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.185919:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe21fb expref: 18 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.185930:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe21fb expref: 18 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.185940:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d400, rc 0) 00000100:00100000:2.0:1788361558.185983:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00723b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429740544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.185990:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788361558.186104:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.186117:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.186125:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.186180:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.186205:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.186262:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.186293:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740672 00000100:00100000:3.0:1788361558.186297:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740672 00000100:00100000:3.0:1788361558.186360:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361558.186368:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429740672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.186500:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429740672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.186507:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788361558.186565:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.186591:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.186628:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.186642:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.186655:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740800 00000100:00100000:2.0:1788361558.186662:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740800 00000100:00100000:2.0:1788361558.186699:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788361558.186706:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429740800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.187597:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429740800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 890us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.187605:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361558.187618:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361558.188195:0:85187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788361558.188254:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788361558.188275:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788361558.188283:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.188293:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361558.188302:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361558.188310:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0021f9800 from 7 10000000:01000000:3.0:1788361558.188313:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361558.188339:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.188348:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.188357:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.188373:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.188416:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.188451:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.188532:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429740928 00000100:00100000:2.0:1788361558.188538:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429740928 00000100:00100000:2.0:1788361558.188580:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788361558.188591:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429740928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.188604:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.188617:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c600/0x1b69fa8920fe2210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2209 expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.188638:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c600/0x1b69fa8920fe2210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2209 expref: 19 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.188649:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c600/0x1b69fa8920fe2210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2209 expref: 19 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.188657:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c600, rc 0) 00000100:00100000:2.0:1788361558.188703:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429740928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.188710:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788361558.188724:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429740928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361558.188736:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.188746:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.188790:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.188811:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.188848:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.188858:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741056 00000100:00100000:2.0:1788361558.188862:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741056 00000100:00100000:2.0:1788361558.188884:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361558.188890:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00723ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429741056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.188984:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00723ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429741056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.188991:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361558.188993:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.189018:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.189051:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.189065:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.189068:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741184 00000100:00100000:2.0:1788361558.189071:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741184 00000100:00100000:2.0:1788361558.189093:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361558.189099:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429741184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.189177:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.189178:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429741184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.189184:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:2.0:1788361558.191003:0:85188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788361558.191101:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788361558.191128:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361558.191141:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.191151:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361558.191159:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361558.191161:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 52 10000000:01000000:3.0:1788361558.191164:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361558.191203:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.191211:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.191222:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.191244:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.191291:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.191701:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741312 00000100:00100000:2.0:1788361558.191708:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741312 00000100:00100000:3.0:1788361558.191718:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.191754:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788361558.191765:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429741312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.191777:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.191790:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715de00/0x1b69fa8920fe221e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2217 expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.191897:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715de00/0x1b69fa8920fe221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2217 expref: 20 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.191909:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715de00/0x1b69fa8920fe221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2217 expref: 20 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.191919:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715de00, rc 0) 00000100:00100000:2.0:1788361558.191959:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429741312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.191973:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.191985:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788361558.191988:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.191998:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.192059:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.192084:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.192109:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.192174:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741440 00000100:00100000:2.0:1788361558.192178:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741440 00000100:00100000:2.0:1788361558.192213:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788361558.192220:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429741440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.192343:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429741440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.192351:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361558.192358:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.192392:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.192437:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.192456:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.192458:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741568 00000100:00100000:2.0:1788361558.192463:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741568 00000100:00100000:2.0:1788361558.192486:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788361558.192493:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429741568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.192562:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429741568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.192571:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361558.192578:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361558.193282:0:85189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788361558.193368:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788361558.193390:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361558.193397:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.193407:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361558.193416:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788361558.193419:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788361558.193422:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361558.193442:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.193455:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.193464:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.193481:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.193508:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.193534:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741696 00000100:00100000:2.0:1788361558.193538:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.193540:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741696 00000100:00100000:3.0:1788361558.193574:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361558.193582:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429741696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361558.193590:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361558.193601:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0fa00/0x1b69fa8920fe222c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2225 expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.193618:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0fa00/0x1b69fa8920fe222c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2225 expref: 21 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.193627:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0fa00/0x1b69fa8920fe222c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2225 expref: 21 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.193634:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0fa00, rc 0) 00000100:00100000:3.0:1788361558.193667:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429741696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.193695:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788361558.193698:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.193714:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.193723:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.193763:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.193787:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361558.193803:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.193812:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741824 00000100:00100000:3.0:1788361558.193817:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741824 00000100:00100000:3.0:1788361558.193866:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788361558.193874:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429741824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.193992:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429741824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.193999:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788361558.194059:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.194085:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.194118:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.194144:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429741952 00000100:00100000:2.0:1788361558.194145:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.194150:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429741952 00000100:00100000:3.0:1788361558.194179:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361558.194185:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429741952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.194643:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429741952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 457us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.194651:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361558.194668:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429741952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361558.195595:0:85190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788361558.195667:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788361558.195706:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788361558.195716:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.195725:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361558.195731:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361558.195733:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d137d28000 from 7 10000000:01000000:3.0:1788361558.195735:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361558.195757:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.195766:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.195773:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.195784:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.195810:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.195853:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.195861:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742080 00000100:00100000:2.0:1788361558.195867:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742080 00000100:00100000:2.0:1788361558.195904:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788361558.195913:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429742080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.195923:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.195935:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715d800/0x1b69fa8920fe223a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2233 expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.195953:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715d800/0x1b69fa8920fe223a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2233 expref: 22 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.195962:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715d800/0x1b69fa8920fe223a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2233 expref: 22 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.195981:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d800, rc 0) 00000100:00100000:2.0:1788361558.196015:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429742080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.196021:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361558.196070:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361558.196080:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.196086:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.196118:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.196134:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.196151:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.196268:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742208 00000100:00100000:2.0:1788361558.196273:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742208 00000100:00100000:2.0:1788361558.196307:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788361558.196314:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429742208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.196401:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429742208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.196408:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361558.196479:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.196508:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.196543:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.196563:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.196599:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742336 00000100:00100000:2.0:1788361558.196602:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742336 00000100:00100000:2.0:1788361558.196661:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788361558.196668:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429742336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.196749:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429742336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.196754:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788361558.196818:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361558.197360:0:85191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788361558.197509:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788361558.197527:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361558.197539:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.197548:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361558.197554:0:6520:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788361558.197556:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99d1349b4d40 from 1 10000000:01000000:3.0:1788361558.197558:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788361558.197577:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.197585:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.197593:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.197607:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361558.197636:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361558.197660:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.197702:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742464 00000100:00100000:2.0:1788361558.197707:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742464 00000100:00100000:2.0:1788361558.197772:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788361558.197781:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429742464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.197790:0:85011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.197802:0:85011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715da00/0x1b69fa8920fe2248 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2241 expref: -99 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.197819:0:85011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715da00/0x1b69fa8920fe2248 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2241 expref: 23 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.197881:0:85011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715da00/0x1b69fa8920fe2248 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2241 expref: 23 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.197891:0:85011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715da00, rc 0) 00000100:00100000:2.0:1788361558.197931:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429742464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.197939:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361558.197964:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.197986:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.198005:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361558.198024:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788361558.198028:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.198034:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361558.198040:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788361558.198042:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:0.0:1788361558.198044:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788361558.198058:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.198064:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.198071:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.198083:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.198108:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.198132:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.198178:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742592 00000100:00100000:2.0:1788361558.198183:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742592 00000100:00100000:2.0:1788361558.198243:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361558.198251:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11ebc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429742592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361558.198267:0:85008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.198275:0:85008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe224f expref: -99 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.198289:0:85008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe224f expref: 24 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.198297:0:85008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe224f expref: 24 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.198304:0:85008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c200, rc 0) 00000100:00100000:2.0:1788361558.198340:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11ebc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429742592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.198345:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361558.198399:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361558.198410:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.198427:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.198470:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361558.198559:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361558.198580:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361558.198619:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742720 00000100:00100000:2.0:1788361558.198623:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742720 00000100:00100000:2.0:1788361558.198651:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361558.198657:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11ebc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429742720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361558.198764:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11ebc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429742720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (203us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361558.198771:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361558.200604:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429742720:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788361558.200653:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361558.200663:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.200687:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788361558.911230:0:85286:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361559.126110:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788361559.418570:0:85338:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788361559.418791:0:85338:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788361559.914084:0:85388:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788361559.914300:0:85388:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788361559.943405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361559.943433:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361559.943454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361559.943473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361559.943498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361559.943528:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964608 00000100:00100000:1.0:1788361559.943538:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964608 00000100:00100000:1.0:1788361559.943589:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964736 00000100:00100000:1.0:1788361559.943592:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964736 00000100:00100000:1.0:1788361559.943618:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4864 00000100:00100000:1.0:1788361559.943630:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+5:2408:x1875230406964608:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788361559.943670:0:26162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe1f4d 00000100:00080000:1.0:1788361559.943679:0:26162:0:(import.c:65:import_set_state_nolock()) ffff99d002092800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361559.943722:0:26162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968745 00000100:00100000:1.0:1788361559.943884:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230406964608:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 257us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.943892:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4864 00000100:00100000:1.0:1788361559.943908:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4865 00000100:00100000:1.0:1788361559.943924:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+5:2408:x1875230406964736:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788361559.943937:0:26162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe152f 00000100:00080000:1.0:1788361559.943942:0:26162:0:(import.c:65:import_set_state_nolock()) ffff99d136e18000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361559.943966:0:26162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968746 00000100:00100000:1.0:1788361559.944030:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230406964736:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 106us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.944037:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4865 00010000:00010000:1.0:1788361559.944062:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361559.944069:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361559.944088:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361559.944092:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361559.944263:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964224 00000100:00100000:2.0:1788361559.944268:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964224 00000100:00100000:2.0:1788361559.944303:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:2.0:1788361559.944308:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11ebc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2410:x1875230406964224:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:2.0:1788361559.944324:0:85008:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:2.0:1788361559.944356:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11ebc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2410:x1875230406964224:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (959us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361559.944364:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:2.0:1788361559.944392:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964480 00000100:00100000:2.0:1788361559.944396:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964480 00000100:00100000:2.0:1788361559.944442:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964352 00000100:00100000:2.0:1788361559.944446:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964352 00000100:00100000:2.0:1788361559.944468:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 776 00000100:00100000:2.0:1788361559.944482:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406964480:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361559.944513:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406964480:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.944519:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 776 00000100:00100000:2.0:1788361559.944530:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1041 00000100:00100000:2.0:1788361559.944592:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230406964352:12345-192.168.204.35@tcp:38:kworker.0 00010000:00080000:2.0:1788361559.944616:0:67579:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'ec302d84-8f96-49d3-8682-aefc474f8448' at ffff99d137f16800, cookie 0x1b69fa8920fe20e3 00010000:00080000:2.0:1788361559.944621:0:67579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp recovering/t98784247810 exp ffff99d137f16800 cur 2599 last 1788361556 00010000:02000400:2.0:1788361559.944627:0:67579:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788361559.944633:0:67579:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788361559.944664:0:67579:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788361559.944795:0:67579:0:(import.c:65:import_set_state_nolock()) ffff99d006c8b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361559.944838:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406964352:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 286us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.944844:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1041 00000100:00080000:3.0:1788361559.944876:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361559.948079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361559.948160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361559.948377:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406959616 00000100:00100000:3.0:1788361559.948395:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406959616 00000100:00100000:3.0:1788361559.948551:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1042 00000100:00100000:3.0:1788361559.948567:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406959616:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00080000:3.0:1788361559.948593:0:66901:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:3.0:1788361559.948680:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406959616:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 118us (608us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361559.948704:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1042 00010000:00080000:1.0:1788361559.948764:0:85035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1788361559.948980:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964864 00000100:00100000:2.0:1788361559.948995:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964864 00000100:00100000:2.0:1788361559.949039:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:2.0:1788361559.949047:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2408:x1875230406964864:12345-192.168.204.35@tcp:250:ptlrpcd_00_01.0 00010000:00080000:2.0:1788361559.949071:0:85011:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1f5c0251-1795-40ef-8392-cb147010b7b5@192.168.204.35@tcp t0 exp 0000000000000000 cur 2599 last 0 00000020:00000080:2.0:1788361559.949110:0:85011:0:(genops.c:1406:class_connect()) connect: client 1f5c0251-1795-40ef-8392-cb147010b7b5, cookie 0x1b69fa8920fe225d 00000100:00080000:2.0:1788361559.949231:0:85011:0:(import.c:65:import_set_state_nolock()) ffff99d006c8d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361559.949296:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+5:2408:x1875230406964864:12345-192.168.204.35@tcp:250:ptlrpcd_00_01.0 Request processed in 248us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.949304:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00010000:00010000:0.0:1788361560.150165:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361561.174686:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361561.223757:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361561.223849:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406964992 00000100:00100000:1.0:1788361561.223860:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406964992 00000100:00100000:1.0:1788361561.223914:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788361561.223923:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+5:42333:x1875230406964992:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361561.223938:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361561.223957:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe2264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cfd expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.223983:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe2264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cfd expref: 6 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.223993:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe2264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cfd expref: 6 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.224019:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac600, rc 0) 00000100:00100000:1.0:1788361561.224075:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406964992:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 153us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.224082:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788361561.225698:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361561.225800:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965120 00000100:00100000:3.0:1788361561.225807:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965120 00000100:00100000:3.0:1788361561.225921:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788361561.225930:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406965120:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361561.225953:0:85008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788361561.225973:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361561.225977:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788361561.225979:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788361561.225982:0:85008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788361561.225989:0:85008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:3.0:1788361561.230126:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406965120:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 4187us (4423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361561.230140:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:2.0:1788361561.233135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361561.233661:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965248 00000100:00100000:0.0:1788361561.233673:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965248 00000100:00100000:0.0:1788361561.233737:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:0.0:1788361561.233749:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406965248:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361561.233765:0:85011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361561.233785:0:85011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1364d2400/0x1b69fa8920fe226b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d04 expref: -99 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361561.233813:0:85011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1364d2400/0x1b69fa8920fe226b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d04 expref: 7 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361561.233865:0:85011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1364d2400/0x1b69fa8920fe226b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d04 expref: 7 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361561.233874:0:85011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d2400, rc 0) 00000100:00100000:0.0:1788361561.233936:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230406965248:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 189us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.233943:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:1.0:1788361561.236220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361561.236315:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965376 00000100:00100000:3.0:1788361561.236325:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965376 00000100:00100000:3.0:1788361561.236378:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:3.0:1788361561.236388:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230406965376:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361561.236542:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406965376:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 156us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361561.236554:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:2.0:1788361561.238142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361561.238208:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965504 00000100:00100000:1.0:1788361561.238215:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965504 00000100:00100000:1.0:1788361561.238298:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788361561.238307:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406965504:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361561.238430:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406965504:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.238439:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:2.0:1788361561.242543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361561.243372:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965632 00000100:00100000:0.0:1788361561.243384:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965632 00000100:00100000:0.0:1788361561.243441:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361561.243449:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406965632:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361561.243463:0:85011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361561.243481:0:85011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1364d3e00/0x1b69fa8920fe2272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d0b expref: -99 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361561.243510:0:85011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1364d3e00/0x1b69fa8920fe2272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d0b expref: 9 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361561.243518:0:85011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1364d3e00/0x1b69fa8920fe2272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d0b expref: 9 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361561.243525:0:85011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1364d3e00, rc 0) 00000100:00100000:0.0:1788361561.243576:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406965632:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 129us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.243581:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361561.246150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361561.246260:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965760 00000100:00100000:1.0:1788361561.246269:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965760 00000100:00100000:1.0:1788361561.246347:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:1.0:1788361561.246357:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406965760:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361561.246544:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406965760:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 188us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.246551:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788361561.247906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361561.247993:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406965888 00000100:00100000:3.0:1788361561.248002:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406965888 00000100:00100000:3.0:1788361561.248100:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788361561.248111:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406965888:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361561.248247:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406965888:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361561.248260:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:2.0:1788361561.251297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361561.251360:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966016 00000100:00100000:1.0:1788361561.251368:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966016 00000100:00100000:1.0:1788361561.251416:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:1.0:1788361561.251428:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406966016:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361561.251460:0:85010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361561.251478:0:85010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d117aac200/0x1b69fa8920fe2279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d12 expref: -99 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.251509:0:85010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d117aac200/0x1b69fa8920fe2279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d12 expref: 10 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.251522:0:85010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d117aac200/0x1b69fa8920fe2279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d12 expref: 10 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.251534:0:85010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac200, rc 0) 00000100:00100000:1.0:1788361561.251591:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406966016:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 167us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.251598:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:1.0:1788361561.253069:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361561.253181:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966144 00000100:00100000:3.0:1788361561.253200:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966144 00000100:00100000:3.0:1788361561.253270:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:3.0:1788361561.253279:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1202ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406966144:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361561.253388:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1202ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406966144:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 110us (326us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361561.253397:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00080000:0.0:1788361561.942358:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361561.942365:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361561.942369:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361561.942385:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361561.942411:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c91c00 x1875230429743104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361561.942455:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361561.942459:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361561.942461:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361561.942466:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361561.942477:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c90380 x1875230429743360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361561.942492:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361561.942495:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361561.942497:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361561.942501:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361561.942513:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c92d80 x1875230429743616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361561.942552:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429743104:0@lo:38:kworker.0 00000100:00080000:0.0:1788361561.942567:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361561.942570:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361561.942573:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361561.942579:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361561.942593:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d14109ad80 x1875230429744000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361561.942646:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788361561.942648:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361561.942650:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d005034800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361561.942655:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d005034800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361561.942665:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d14109b800 x1875230429744512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361561.942773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361561.942855:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429743360:0@lo:38:kworker.0 00000100:00100000:2.0:1788361561.942891:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429742976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361561.942892:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361561.942923:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429743616:0@lo:38:kworker.0 00000100:00100000:2.0:1788361561.942969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361561.942985:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743104 00000100:00100000:3.0:1788361561.942997:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743104 00000100:00100000:3.0:1788361561.943043:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743360 00000100:00100000:3.0:1788361561.943047:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743360 00000100:00100000:3.0:1788361561.943071:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1788361561.943080:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429743104:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788361561.943118:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2601 last 0 00000100:00100000:0.0:1788361561.943129:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429743488:0@lo:400:kworker.0 00000100:00100000:0.0:1788361561.943173:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788361561.943175:0:66126:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe2280 00000100:00100000:2.0:1788361561.943200:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429743872:0@lo:400:kworker.0 00000100:00100000:2.0:1788361561.943231:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361561.943261:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429744640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361561.943283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:3.0:1788361561.943294:0:66126:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361561.943474:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d002096800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361561.943621:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429743104:12345-0@lo:38:kworker.0 Request processed in 539us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361561.943653:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1788361561.945458:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743488 00000100:00100000:0.0:1788361561.945468:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429744256:0@lo:400:kworker.0 00000100:00100000:3.0:1788361561.945474:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743488 00000100:00100000:0.0:1788361561.945520:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361561.945558:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788361561.945563:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1788361561.945572:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429743232:0@lo:400:kworker.0 00000100:00100000:3.0:1788361561.945582:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429743488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361561.945616:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361561.945631:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429744128:0@lo:400:kworker.0 00000100:00100000:0.0:1788361561.945655:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361561.945677:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429744768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361561.945880:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429742848:0@lo:400:kworker.0 00000100:00100000:0.0:1788361561.945914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361561.945941:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429743744:0@lo:400:kworker.0 00000100:00100000:0.0:1788361561.946051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361561.946066:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743232 00000100:00100000:1.0:1788361561.946074:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743232 00000100:00100000:1.0:1788361561.946124:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1788361561.946134:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429743232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361561.946152:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742976 00000100:00100000:2.0:1788361561.946159:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742976 00000100:00100000:1.0:1788361561.946193:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429743232:12345-0@lo:400:kworker.0 Request processed in 59us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361561.946196:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744128 00000100:00100000:2.0:1788361561.946202:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744128 00000100:00100000:1.0:1788361561.946205:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1788361561.946228:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1788361561.946232:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1788361561.946239:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429743360:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361561.946248:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3653:x1875230429742976:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788361561.946267:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2601 last 0 00000004:00000024:2.0:1788361561.946276:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361561.946302:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429744384:0@lo:400:kworker.0 00000020:00000080:1.0:1788361561.946305:0:66128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b69fa8920fe2287 00000004:00100000:1.0:1788361561.946329:0:66128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788361561.946337:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3653:x1875230429742976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.946343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361561.946349:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:2.0:1788361561.946372:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00080000:1.0:1788361561.946374:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d10f770800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361561.946382:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429744128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361561.946398:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743872 00000100:00100000:0.0:1788361561.946405:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743872 00000100:00100000:1.0:1788361561.946431:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875230429743360:12345-0@lo:38:kworker.0 Request processed in 190us (3541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361561.946435:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429744128:12345-0@lo:400:kworker.0 Request processed in 55us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.946439:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744256 00000100:00100000:0.0:1788361561.946444:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744256 00000100:00100000:1.0:1788361561.946445:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1788361561.946450:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:1.0:1788361561.946474:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744640 00000100:00100000:1.0:1788361561.946479:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744640 00000100:00100000:2.0:1788361561.946480:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743744 00000100:00100000:2.0:1788361561.946486:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743744 00000100:00100000:1.0:1788361561.946510:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1788361561.946519:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744384 00000100:00100000:1.0:1788361561.946521:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429744640:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361561.946524:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744384 00000100:00100000:0.0:1788361561.946535:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00002000:00000024:1.0:1788361561.946543:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361561.946549:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429743872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361561.946556:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:2.0:1788361561.946565:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361561.946612:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429744640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (3327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.946618:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1788361561.946669:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429743872:12345-0@lo:400:kworker.0 Request processed in 124us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.946677:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1788361561.946693:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:0.0:1788361561.946700:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429743744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361561.946719:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1788361561.946721:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429744256:12345-0@lo:400:kworker.0 Request processed in 155us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.946731:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429744384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361561.946733:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:0.0:1788361561.946741:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429743744:12345-0@lo:400:kworker.0 Request processed in 41us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.946750:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1788361561.946775:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429744384:12345-0@lo:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.946782:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1788361561.946789:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361561.946807:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429743616 00000100:00100000:1.0:1788361561.946812:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429743616 00000100:00100000:2.0:1788361561.946842:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429744000:0@lo:38:kworker.0 00000100:00100000:1.0:1788361561.946859:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1788361561.946866:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429743616:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788361561.946882:0:8448:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d137f12000, cookie 0x1b69fa8920fe20ea 00010000:00080000:1.0:1788361561.946887:0:8448:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d137f12000 cur 2601 last 1788361556 00000100:00100000:0.0:1788361561.946891:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429743744:0@lo:400:kworker.0 00000004:00100000:1.0:1788361561.946899:0:8448:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788361561.946909:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429744384:0@lo:400:kworker.0 00000100:00080000:1.0:1788361561.946918:0:8448:0:(import.c:65:import_set_state_nolock()) ffff99d11787a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361561.946948:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429742848 00000100:00100000:0.0:1788361561.946953:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429742848 00000100:00100000:1.0:1788361561.946960:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429743616:12345-0@lo:38:kworker.0 Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.946973:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:0.0:1788361561.946984:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788361561.946993:0:85035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788361561.946995:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429742848:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788361561.946998:0:85035:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:1.0:1788361561.947004:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.947007:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:1.0:1788361561.947011:0:85035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247810) 00000100:00100000:2.0:1788361561.947014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788361561.947015:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.947028:0:85035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406959616 t98784247810 from 192.168.204.35@tcp req@ffff99d109066300 x1875230406959616/t0(98784247810) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:620/0 lens 528/0 e 0 to 0 dl 1788361570 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361561.947107:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429742848:0@lo:400:kworker.0 00000100:00100000:2.0:1788361561.947119:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429744512:0@lo:38:kworker.0 00000100:00100000:0.0:1788361561.947180:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429742848:12345-0@lo:400:kworker.0 Request processed in 178us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361561.947184:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361561.947192:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788361561.947223:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d137c91c00 x1875230429743104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361561.947224:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744000 00000100:00100000:1.0:1788361561.947229:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744000 00000100:00100000:1.0:1788361561.947252:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744512 00000100:00080000:2.0:1788361561.947254:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:1.0:1788361561.947256:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744512 00000100:00100000:0.0:1788361561.947262:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429744640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361561.947275:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1788361561.947282:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429744000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361561.947285:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429742976:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788361561.947300:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2601 last 0 00000100:00100000:0.0:1788361561.947316:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429743872:0@lo:400:kworker.0 00000020:00000080:1.0:1788361561.947332:0:66128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1b69fa8920fe228e 00000004:00100000:1.0:1788361561.947341:0:66128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788361561.947350:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361561.947359:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d11787b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361561.947387:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429744256:0@lo:400:kworker.0 00000100:00100000:1.0:1788361561.947403:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875230429744000:12345-0@lo:38:kworker.0 Request processed in 119us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.947411:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429743232:0@lo:400:kworker.0 00000100:00100000:1.0:1788361561.947414:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788361561.947431:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429744128:0@lo:400:kworker.0 00000100:00100000:1.0:1788361561.947437:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1788361561.947443:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429744512:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361561.947457:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744768 00000100:00100000:0.0:1788361561.947462:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744768 00010000:00080000:1.0:1788361561.947467:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2601 last 0 00000020:00000080:1.0:1788361561.947492:0:66128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b69fa8920fe2295 00000004:00100000:1.0:1788361561.947498:0:66128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788361561.947511:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d11e637800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361561.947538:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429744512:12345-0@lo:38:kworker.0 Request processed in 94us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.947544:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1788361561.947652:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1788361561.947661:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429744768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788361561.947677:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361561.947714:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429744768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361561.947719:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1788361561.947754:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429744768:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788361561.947909:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361561.947913:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361561.947916:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361561.948298:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d137c91c00 x1875230429743104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361586 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361561.948307:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361561.948311:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361561.948315:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788361561.948320:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429743104:0@lo:38:kworker.0 00010000:00080000:2.0:1788361561.948338:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d137c90380 x1875230429743360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361561.948348:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000004:00080000:1.0:1788361561.948492:0:85035:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1422us 00000001:00100000:1.0:1788361561.948924:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788361561.949570:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429743488:12345-0@lo:400:kworker.0 Request processed in 3988us (6388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361561.949586:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00080000:2.0:1788361561.950082:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d137c90380 x1875230429743360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361586 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361561.950092:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361561.950097:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361561.950100:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788361561.950105:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429743360:0@lo:38:kworker.0 00000100:00080000:2.0:1788361561.950131:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:2.0:1788361561.950139:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788361561.950143:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788361561.950145:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:2.0:1788361561.950149:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d106904000 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:2.0:1788361561.950152:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788361561.950440:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429743616:0@lo:38:kworker.0 00010000:00080000:2.0:1788361561.950471:0:85401:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788361561.950483:0:85401:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788361561.950489:0:85401:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00080000:3.0:1788361561.950500:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d14109ad80 x1875230429744000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361561.950512:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:2.0:1788361561.951626:0:85401:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1788361561.952098:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429743488:0@lo:400:kworker.0 00000100:00080000:3.0:1788361561.953750:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d14109ad80 x1875230429744000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361586 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361561.953761:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788361561.953766:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361561.953771:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788361561.953777:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429744000:0@lo:38:kworker.0 00010000:00080000:3.0:1788361561.953806:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d14109b800 x1875230429744512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361561.953819:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:3.0:1788361561.953841:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361561.953846:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361561.953849:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361561.953863:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429744512:0@lo:38:kworker.0 00000100:00100000:3.0:1788361561.953901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429744896:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788361561.953962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361561.954276:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429744896 00000100:00100000:1.0:1788361561.954283:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429744896 00000100:00100000:1.0:1788361561.954341:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1788361561.954352:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429744896:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788361561.954372:0:8449:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d1365c2d80 x1875230429744896/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:622/0 lens 224/0 e 0 to 0 dl 1788361572 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361561.954385:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429744896:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 36us (424us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361561.954393:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00010000:00010000:1.0:1788361561.962924:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.962946:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.962969:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.962988:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.962997:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.963005:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964029:0:85035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964039:0:85035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964045:0:85035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964050:0:85035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361561.964054:0:85035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964062:0:85035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964074:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d119daaa00) 00010000:00010000:1.0:1788361561.964077:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361561.964081:0:85035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964094:0:85035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe229c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361561.964110:0:85035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b00c69c2 reply state 000000001fec0c68 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964120:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361561.964126:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119daa900) 00010000:00010000:1.0:1788361561.964129:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361561.964132:0:85035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788361561.964236:0:85035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1788361561.964265:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.964269:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:1.0:1788361561.964272:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.964274:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000100:00100000:1.0:1788361561.966552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361561.966971:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960128 00000100:00100000:2.0:1788361561.966982:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960128 00000100:00100000:2.0:1788361561.967044:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1047 00000100:00100000:2.0:1788361561.967057:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406960128:12345-192.168.204.35@tcp:36:rm.0 00010000:00080000:2.0:1788361561.967080:0:66128:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:2.0:1788361561.967095:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406960128:12345-192.168.204.35@tcp:36:rm.0 Request processed in 42us (550us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361561.967103:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1047 00000001:00080000:0.0:1788361561.967114:0:85004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00000020:00080000:2.0:1788361561.967126:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.967132:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:2.0:1788361561.967137:0:85035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:2.0:1788361561.967140:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.967148:0:85035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406960128 t98784247811 from 192.168.204.35@tcp req@ffff99d109065c00 x1875230406960128/t0(98784247811) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:622/0 lens 512/0 e 0 to 0 dl 1788361572 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788361561.967174:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361561.967186:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361561.967193:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361561.967199:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361561.967203:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361561.967211:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967224:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361561.967227:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119daa900) 00010000:00010000:3.0:1788361561.967234:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361561.967240:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967244:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361561.967250:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe22a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967261:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967275:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967294:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967301:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967367:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967376:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967383:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967556:0:85035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967563:0:85035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967569:0:85035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967574:0:85035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361561.967577:0:85035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967583:0:85035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967591:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99d112cabb00) 00010000:00010000:2.0:1788361561.967614:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361561.967618:0:85035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967624:0:85035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe22b8 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967641:0:85035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967647:0:85035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967653:0:85035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967658:0:85035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361561.967660:0:85035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967666:0:85035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967673:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112cab100) 00010000:00010000:2.0:1788361561.967675:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361561.967678:0:85035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967684:0:85035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ca00/0x1b69fa8920fe22aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361561.967693:0:85035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048935da3 reply state 00000000134777b1 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967713:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.967782:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d112cabf00) 00010000:00010000:2.0:1788361561.967785:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361561.967788:0:85035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788361561.967862:0:85035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361561.967877:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.967880:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:2.0:1788361561.967884:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.967886:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:2.0:1788361561.969938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361561.969982:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960640 00000100:00100000:1.0:1788361561.969990:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960640 00000100:00100000:1.0:1788361561.970040:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1048 00000100:00100000:1.0:1788361561.970050:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406960640:12345-192.168.204.35@tcp:101:lfs.0 00010000:00080000:1.0:1788361561.970065:0:66127:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:1.0:1788361561.970077:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406960640:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 30us (145us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361561.970082:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1048 00000020:00080000:2.0:1788361561.970099:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.970104:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:2.0:1788361561.970107:0:85035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:2.0:1788361561.970110:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.970119:0:85035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406960640 t98784247812 from 192.168.204.35@tcp req@ffff99d117947480 x1875230406960640/t0(98784247812) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:622/0 lens 536/0 e 0 to 0 dl 1788361572 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361561.970137:0:85035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361561.970533:0:85035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe22bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cef expref: -99 pid: 85035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.970935:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.970948:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.970969:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.970983:0:85035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.970990:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.970997:0:85035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361561.971315:0:85035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:2.0:1788361561.971333:0:85035:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x1b69fa8920fe2042 00000004:00080000:2.0:1788361561.971336:0:85035:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x1b69fa8920fe2042 in new mfd 00010000:00010000:2.0:1788361561.971345:0:85035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971352:0:85035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971359:0:85035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971364:0:85035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361561.971368:0:85035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971376:0:85035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971397:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112cab300) 00010000:00010000:2.0:1788361561.971400:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361561.971405:0:85035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971477:0:85035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361561.971489:0:85035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026b5fe4b reply state 00000000df54aeb8 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971499:0:85035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971505:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d112cab800) 00010000:00010000:2.0:1788361561.971507:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361561.971509:0:85035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361561.971531:0:85035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe22bf lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 10 pid: 85035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971539:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112cab300) 00010000:00010000:2.0:1788361561.971542:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361561.971545:0:85035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe22bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cef expref: 10 pid: 85035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.971558:0:85035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c400, rc 0) 00010000:00080000:2.0:1788361561.971762:0:85035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361561.971777:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.971780:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:2.0:1788361561.971788:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.971790:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:0.0:1788361561.989992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361561.990083:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406960896 00000100:00100000:1.0:1788361561.990107:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406960896 00000100:00100000:1.0:1788361561.990161:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1049 00000100:00100000:1.0:1788361561.990172:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230406960896:12345-192.168.204.35@tcp:101:lfs.0 00010000:00080000:1.0:1788361561.990192:0:80345:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:1.0:1788361561.990212:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230406960896:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 44us (232us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361561.990219:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1049 00000020:00080000:2.0:1788361561.990354:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.990359:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:2.0:1788361561.990362:0:85035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:2.0:1788361561.990365:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.990376:0:85035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406960896 t98784247813 from 192.168.204.35@tcp req@ffff99d14109a680 x1875230406960896/t0(98784247813) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:622/0 lens 736/0 e 0 to 0 dl 1788361572 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361561.990399:0:85035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361561.990424:0:85035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710cf6 expref: -99 pid: 85035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361561.990513:0:85035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:2.0:1788361561.990682:0:85035:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x1b69fa8920fe2057 00000004:00080000:2.0:1788361561.990686:0:85035:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x1b69fa8920fe2057 in new mfd 00010000:00010000:2.0:1788361561.990715:0:85035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cf6 expref: 12 pid: 85035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.990729:0:85035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112cab300) 00010000:00010000:2.0:1788361561.990732:0:85035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361561.990737:0:85035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe22db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cf6 expref: 12 pid: 85035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.990753:0:85035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ff400, rc 0) 00010000:00080000:2.0:1788361561.990885:0:85035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361561.990898:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.990901:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:2.0:1788361561.990912:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361561.990914:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:1.0:1788361561.993147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361561.993241:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961280 00000100:00100000:3.0:1788361561.993250:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961280 00000100:00100000:3.0:1788361561.993296:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 215 00000100:00100000:3.0:1788361561.993317:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230406961280:12345-192.168.204.35@tcp:35:lfs.0 00010000:00080000:3.0:1788361561.993334:0:66130:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1788361561.993393:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230406961280:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 78us (253us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361561.993400:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 215 00000020:00080000:1.0:1788361561.993998:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.994003:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:1.0:1788361561.994007:0:85035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:1.0:1788361561.994010:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.994020:0:85035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406961280 t98784247814 from 192.168.204.35@tcp req@ffff99d109066a00 x1875230406961280/t0(98784247814) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:622/0 lens 392/0 e 0 to 0 dl 1788361572 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361561.994460:0:85035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788361561.994474:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.994477:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:1.0:1788361561.994480:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.994482:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:0.0:1788361561.996910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361561.996991:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406961536 00000100:00100000:2.0:1788361561.997001:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406961536 00000100:00100000:2.0:1788361561.997048:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 216 00000100:00100000:2.0:1788361561.997058:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:2408:x1875230406961536:12345-192.168.204.35@tcp:35:lfs.0 00010000:00080000:2.0:1788361561.997075:0:81013:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:2.0:1788361561.997084:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:2408:x1875230406961536:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 30us (184us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361561.997091:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 216 00000020:00080000:1.0:1788361561.997193:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.997197:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:1.0:1788361561.997201:0:85035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:1.0:1788361561.997204:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.997212:0:85035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406961536 t98784247815 from 192.168.204.35@tcp req@ffff99d141098700 x1875230406961536/t0(98784247815) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:622/0 lens 392/0 e 0 to 0 dl 1788361572 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361561.997534:0:85035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788361561.997552:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.997554:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:1.0:1788361561.997558:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361561.997560:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:0.0:1788361562.002486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361562.002554:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966400 00000100:00100000:2.0:1788361562.002651:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966400 00000100:00100000:2.0:1788361562.002766:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 779 00000100:00100000:2.0:1788361562.002778:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230406966400:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788361562.002806:0:66128:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d14109aa00 x1875230406966400/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:623/0 lens 224/0 e 0 to 0 dl 1788361573 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361562.002859:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230406966400:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 Request processed in 84us (381us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361562.002867:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 779 00000020:00080000:3.0:1788361562.002916:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361562.002920:0:85035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:3.0:1788361562.002924:0:85035:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788361562.002926:0:85035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361562.002932:0:85035:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788361562.002935:0:85035:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788361562.003041:0:85035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:3.0:1788361562.004652:0:85004:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:3.0:1788361562.004658:0:85004:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788361562.004705:0:85004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000001:00080000:1.0:1788361562.004777:0:85035:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788361562.004808:0:85035:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788361562.004843:0:85035:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d1365c2d80 x1875230429744896/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:622/0 lens 224/0 e 0 to 0 dl 1788361572 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788361562.004942:0:85035:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.35@tcp: req@ffff99d14109aa00 x1875230406966400/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:623/0 lens 224/0 e 0 to 0 dl 1788361573 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788361562.004992:0:85035:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:0.0:1788361562.005804:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005817:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005837:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005859:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361562.005864:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005872:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005892:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d112cabf00) 00010000:00010000:0.0:1788361562.005895:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361562.005898:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005903:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe22b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005924:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005930:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005936:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005941:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361562.005943:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005949:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005969:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d112cab800) 00010000:00010000:0.0:1788361562.005971:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361562.005974:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.005981:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe22cd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361562.006556:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788361562.006566:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d1364fd180 x1875230429744896/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361577 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361562.006574:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d1364fd180 x1875230429744896/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361577 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361562.006580:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361562.006589:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788361562.006605:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000020fbf0e1): req@ffff99d136594000 x1875230429727360/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361556 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361562.006627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429744896:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788361562.006732:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361562.006745:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429745024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361562.006753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361562.006789:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361562.006811:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429727360 00000100:00100000:0.0:1788361562.006816:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429727360 00000100:00100000:3.0:1788361562.006843:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745024 00000100:00100000:3.0:1788361562.006855:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745024 00000100:00100000:0.0:1788361562.006886:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:3.0:1788361562.006897:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:0.0:1788361562.006898:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3653:x1875230429727360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361562.006910:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429745024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788361562.006930:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000004:00000024:3.0:1788361562.006931:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:3.0:1788361562.006989:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429745024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361562.006992:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3653:x1875230429727360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.007002:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:0.0:1788361562.007011:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1788361562.007021:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429727360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361562.007048:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429745024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361562.008902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361562.008982:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966272 00000100:00100000:3.0:1788361562.008990:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966272 00000100:00100000:3.0:1788361562.009037:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1050 00000100:00100000:3.0:1788361562.009045:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:65184:x1875230406966272:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361562.009060:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361562.009081:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe22e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d19 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.009138:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe22f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.009151:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe22f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.009162:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe22f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361562.009212:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361562.009216:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361562.009237:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe22f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.009259:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe22e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d19 expref: 8 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.009284:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe22f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d19 expref: 7 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.009292:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:3.0:1788361562.009295:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361562.009298:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0f400, rc 0) 00000100:00100000:3.0:1788361562.009344:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+7:65184:x1875230406966272:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 300us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.009351:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1050 00000100:00100000:2.0:1788361562.013466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361562.013579:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966528 00000100:00100000:3.0:1788361562.013588:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966528 00000100:00100000:3.0:1788361562.013658:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1051 00000100:00100000:3.0:1788361562.013667:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:65184:x1875230406966528:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361562.013696:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:3.0:1788361562.013771:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:65184:x1875230406966528:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.013779:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1051 00000100:00100000:2.0:1788361562.017215:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361562.017426:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966656 00000100:00100000:1.0:1788361562.017436:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966656 00000100:00080000:3.0:1788361562.017490:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361562.017508:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1052 00000100:00100000:1.0:1788361562.017520:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:65184:x1875230406966656:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361562.017556:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361562.017637:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:65184:x1875230406966656:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 120us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361562.017644:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1052 00000100:00100000:2.0:1788361562.021375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361562.021426:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966784 00000100:00100000:3.0:1788361562.021436:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966784 00000100:00100000:3.0:1788361562.021488:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4866 00000100:00100000:3.0:1788361562.021497:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1875230406966784:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:3.0:1788361562.021531:0:8535:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2602 last 0 00000020:00000080:3.0:1788361562.021566:0:8535:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe22f7 00002000:00100000:3.0:1788361562.021578:0:8535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d002090800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361562.021615:0:8535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361562.021701:0:8535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361562.021732:0:8535:0:(import.c:65:import_set_state_nolock()) ffff99d136ec1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361562.021900:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406966784:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 402us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.021909:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4866 00000001:00100000:2.0:1788361562.024049:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:2.0:1788361562.024059:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:2.0:1788361562.024063:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d002095000/ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:2.0:1788361562.024084:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361562.024166:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002095000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0000 00000020:00000080:1.0:1788361562.024213:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002092800 for lustre-OST0000 00000100:00100000:2.0:1788361562.025102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361562.025157:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406966912 00000100:00100000:1.0:1788361562.025166:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406966912 00000100:00100000:1.0:1788361562.025237:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1434 00000100:00100000:1.0:1788361562.025247:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65184:x1875230406966912:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361562.025287:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361562.025342:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65184:x1875230406966912:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361562.025349:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1434 00000100:00080000:3.0:1788361562.025464:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361562.027547:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361562.027723:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967040 00000100:00100000:3.0:1788361562.027735:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967040 00000100:00100000:3.0:1788361562.027780:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4867 00000100:00100000:3.0:1788361562.027788:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2408:x1875230406967040:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:3.0:1788361562.027819:0:26168:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2602 last 0 00000020:00000080:3.0:1788361562.027879:0:26168:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe22fe 00002000:00100000:3.0:1788361562.027890:0:26168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d136ec5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361562.027901:0:26168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361562.027968:0:26168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361562.027995:0:26168:0:(import.c:65:import_set_state_nolock()) ffff99d136ec7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361562.028247:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406967040:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 457us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.028255:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4867 00000100:00100000:1.0:1788361562.030283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361562.030364:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967168 00000100:00100000:3.0:1788361562.030373:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967168 00000001:00100000:1.0:1788361562.030498:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:1.0:1788361562.030505:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361562.030509:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d136e1b000/ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:1.0:1788361562.030529:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788361562.030647:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1435 00000100:00100000:3.0:1788361562.030657:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65184:x1875230406967168:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788361562.030678:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361562.030733:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65184:x1875230406967168:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 79us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.030741:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1435 00000020:00000080:2.0:1788361562.030997:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136e1b000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0001 00000020:00000080:2.0:1788361562.031038:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136e18000 for lustre-OST0001 00000100:00080000:2.0:1788361562.032902:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:0.0:1788361562.039298:0:85035:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa08886f3e10 00100000:10000000:0.0:1788361562.039313:0:85035:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788361562.043262:0:85021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:1.0:1788361562.043311:0:85021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109064380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85021:1875230429745152:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361562.043472:0:85023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1788361562.043493:0:85023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85023:1875230429745280:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361562.043554:0:85021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361562.043647:0:85021:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11f01bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361562.043756:0:85023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361562.043955:0:85023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d120d9d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361562.044031:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745152 00000100:00100000:2.0:1788361562.044039:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745152 00000100:00100000:2.0:1788361562.044084:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745280 00000100:00100000:2.0:1788361562.044087:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745280 00000100:00100000:2.0:1788361562.044141:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4868 00000100:00100000:2.0:1788361562.044150:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:85021:x1875230429745152:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788361562.044177:0:26164:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -561 00002000:02000040:2.0:1788361562.044182:0:26164:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1761) 00000100:00100000:0.0:1788361562.044623:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4869 00000100:00100000:0.0:1788361562.044632:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:85023:x1875230429745280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788361562.044652:0:26166:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -63 00002000:02000040:0.0:1788361562.044656:0:26166:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1761) 00002000:00010000:2.0:1788361562.052472:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.052485:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052503:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.052522:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.052528:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052545:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052556:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052564:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052590:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361562.052628:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.052637:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052646:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.052651:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052660:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052680:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052697:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe2305 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.052708:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.052714:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052719:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.052723:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.052724:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.052726:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.052730:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.052736:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052745:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052753:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052766:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052786:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361562.052805:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.052812:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052844:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.052849:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.052852:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.052863:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052865:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052881:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.052885:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.052889:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052890:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052911:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe230c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052914:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.052932:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052936:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.052940:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.052942:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.052949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.052966:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361562.053008:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.053014:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053027:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.053030:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.053034:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053043:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053052:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053060:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053125:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361562.053167:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.053173:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053181:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.053184:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.053189:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053198:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053219:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.053227:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055195:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361562.055209:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055222:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.055227:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055237:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055254:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055261:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2313 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055284:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361562.055288:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055295:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.055298:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055304:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055330:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055337:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe231a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055350:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.055353:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055359:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.055362:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055369:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055379:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.055386:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.055388:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.055390:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361562.058207:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.058222:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058256:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.058261:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.058268:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058285:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058294:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058302:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058377:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361562.058485:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.058490:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058498:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.058501:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.058504:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058513:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058530:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058538:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058553:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361562.058615:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.058621:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058628:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.058631:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.058635:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058643:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058650:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058656:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058680:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788361562.058721:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.058726:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058734:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.058737:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.058741:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058749:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058757:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058763:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058772:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788361562.058807:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.058812:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058820:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.058965:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.058970:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058980:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058987:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.058994:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059002:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788361562.059037:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.059042:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059050:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.059053:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.059056:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059065:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059072:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059085:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059094:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788361562.059131:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.059135:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059142:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.059144:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.059148:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059156:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059163:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059169:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059177:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788361562.059211:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.059215:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059228:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.059231:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.059235:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059244:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059251:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059258:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059267:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788361562.059304:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.059309:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059316:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.059318:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.059322:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059329:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059348:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059355:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059364:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788361562.059402:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361562.059405:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788361562.059408:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059414:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059418:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.059427:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361562.059430:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.059433:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059436:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059454:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059455:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059478:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059487:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059488:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059507:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd8044c4/0x1b69fa8920fe2328 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.059531:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1788361562.059539:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788361562.059544:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059553:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d2c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.059563:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059571:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059583:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059589:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb0fe2e/0x1b69fa8920fe232f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059613:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788361562.059616:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059623:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.059626:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059633:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059641:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059647:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1f22d4/0x1b69fa8920fe2336 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059668:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788361562.059671:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059679:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1364d3c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.059680:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788361562.059683:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059688:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059693:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059712:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059713:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.059719:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059726:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f06a8f61/0x1b69fa8920fe233d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059734:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059742:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788361562.059748:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059750:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059763:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.059767:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040dd65f7/0x1b69fa8920fe2344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059769:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059797:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361562.059801:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059802:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059838:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.059842:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059847:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059850:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059866:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffbf0874/0x1b69fa8920fe234b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059874:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059880:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361562.059886:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059895:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d9727c/0x1b69fa8920fe2352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059897:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a82200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.059903:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059915:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059921:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361562.059925:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059926:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059942:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059299006/0x1b69fa8920fe2359 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059944:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a82600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.059951:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.059970:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059980:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.059984:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.059985:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.060007:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.060008:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8bde42/0x1b69fa8920fe2360 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.060012:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.060027:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060030:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.060034:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.060038:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.060042:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060048:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.060052:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9793ff9/0x1b69fa8920fe2367 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060056:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.060067:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.060070:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.060073:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361562.060890:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.060897:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060906:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.060910:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.060915:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060923:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060931:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060938:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.060957:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361562.061022:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.061026:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061034:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.061036:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.061040:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061063:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061072:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061080:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061095:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361562.061104:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361562.061108:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061115:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.061119:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061128:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061138:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061145:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe236e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061180:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.061183:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061190:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aaca00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.061193:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061201:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061212:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061218:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000597d9c47/0x1b69fa8920fe2375 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061229:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061231:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061233:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361562.061275:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.061281:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061288:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.061296:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.061300:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061309:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061316:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061323:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061335:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361562.061342:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.061345:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061353:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aada00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.061356:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061363:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061372:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061389:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3aa77d/0x1b69fa8920fe237c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061406:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061408:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061410:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361562.061451:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.061456:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061464:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.061467:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.061471:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061480:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061487:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061494:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061505:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361562.061550:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.061555:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061576:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.061580:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.061584:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061611:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061620:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061628:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061641:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361562.061647:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361562.061651:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061658:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aade00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.061661:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061680:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061691:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe2383 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061714:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361562.061718:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061724:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.061727:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061735:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061745:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061758:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4731e9/0x1b69fa8920fe238a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061782:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061784:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061786:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361562.061848:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.061854:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061863:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.061866:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.061871:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.061878:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061882:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.061891:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.061891:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.061901:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062239:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361562.062283:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.062288:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062308:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.062311:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.062315:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062324:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062331:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062338:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062363:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361562.062368:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062384:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.062388:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062395:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062401:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361562.062408:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062411:0:26164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2321 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062425:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d177652/0x1b69fa8920fe2391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062446:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361562.062449:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062454:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.062457:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062464:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062472:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062485:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.062487:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.062489:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.062521:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361562.062525:0:26166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005181a206/0x1b69fa8920fe2398 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.062583:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361562.062584:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.062592:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062614:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.062618:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.062622:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062633:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062643:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.062649:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.062656:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062675:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062676:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.062684:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.062694:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062710:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361562.062711:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062722:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062729:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.062760:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.062767:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062776:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.062779:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.062783:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361562.062784:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062798:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062807:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.062815:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.062849:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.062855:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062863:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.062866:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.062870:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062878:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062885:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.062902:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062951:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361562.062956:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062963:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.062966:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062974:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062985:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.062992:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6234fd9/0x1b69fa8920fe239f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063006:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361562.063009:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063014:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aadc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.063023:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063032:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063042:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063049:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2228bdf/0x1b69fa8920fe23a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063066:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361562.063070:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063076:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.063079:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063086:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063094:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063101:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361562.063108:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063114:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aace00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.063117:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063124:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063133:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063140:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.063142:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.063144:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.063209:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.063238:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361562.063244:0:26164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d30c40b/0x1b69fa8920fe23ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063273:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361562.063279:0:26166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b68db703/0x1b69fa8920fe23b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.063316:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.063323:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.063331:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.063335:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.063339:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.063341:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.063352:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.063355:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063372:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.063374:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063377:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.063386:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.063388:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063406:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063416:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063423:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063457:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361562.063461:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063468:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.063471:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063478:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063498:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063505:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361562.063508:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063514:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.063518:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.063520:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.063527:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063536:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.063543:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.063544:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.063546:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.063658:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361562.063663:0:26164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e849edb/0x1b69fa8920fe23bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063696:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361562.063702:0:26166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe23c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.063717:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.063724:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.063744:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.063748:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.063752:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.063757:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.063763:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063765:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063783:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.063789:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.063791:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063794:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.063812:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063816:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063879:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.063938:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064010:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361562.064015:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064022:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fee00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.064031:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064039:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064049:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064057:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361562.064061:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064067:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361562.064070:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064077:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064087:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361562.064093:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.064095:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.064097:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.064162:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361562.064177:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.064192:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.064210:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361562.064215:0:26166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe23d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064222:0:26164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d479f9dd/0x1b69fa8920fe23c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.064294:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.064300:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.064304:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.064312:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.064314:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064317:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.064327:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064330:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.064335:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.064344:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064351:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064356:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064360:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064372:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064375:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064393:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064404:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361562.064409:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361562.064449:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.064456:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.064460:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.064465:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.064468:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064470:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.064479:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064483:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.064492:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.064494:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064508:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064509:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064533:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064551:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.064554:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064570:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788361562.064623:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.064629:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064637:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.064640:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.064645:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064649:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361562.064657:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064660:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064679:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361562.064681:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064685:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064696:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064702:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064710:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788361562.064718:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064728:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dddb817b/0x1b69fa8920fe23d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064747:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:2.0:1788361562.064749:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.064751:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064757:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064781:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.064784:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361562.064786:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.064790:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064793:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064812:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064814:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064849:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064870:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064870:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe23de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064893:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064900:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361562.064904:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361562.064906:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064915:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.064918:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064927:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064938:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.064947:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.064951:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003277a5dc/0x1b69fa8920fe23e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064955:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064969:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.064973:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.064974:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361562.064978:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064980:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.064997:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.064999:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.065006:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065020:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065028:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065036:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065038:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065063:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb295b38/0x1b69fa8920fe23f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065064:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361562.065080:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361562.065084:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065091:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.065102:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.065103:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065113:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065117:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065126:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.065133:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.065137:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065139:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065159:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065160:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a16e5e8/0x1b69fa8920fe23fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065181:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065189:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361562.065191:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065194:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065209:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.065214:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065227:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361562.065230:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065243:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065251:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c75006/0x1b69fa8920fe2401 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.065263:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065269:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065273:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.065279:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065281:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.065289:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.065297:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065297:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.065303:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065312:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065315:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065330:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065336:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065339:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065353:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a416d0/0x1b69fa8920fe2408 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065356:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361562.065370:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.065374:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065382:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.065386:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.065397:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065409:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065413:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065421:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:0.0:1788361562.065429:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065437:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.065444:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007430d0d0/0x1b69fa8920fe240f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065446:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065469:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065471:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.065475:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.065478:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.065481:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.065488:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.065490:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065506:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361562.065543:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065548:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065565:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.065568:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.065572:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065581:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065589:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065613:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065624:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361562.065634:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065648:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788361562.065662:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065668:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065677:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.065680:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.065683:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065693:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065701:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.065701:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.065713:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065715:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065738:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.065739:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788361562.065746:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.065752:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065762:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065771:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.065781:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065791:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065796:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065818:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.065836:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788361562.065843:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.065848:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065859:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065868:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065876:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.065880:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.065887:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788361562.065888:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065899:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.065903:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.065908:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065919:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.065927:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.065932:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.065937:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065939:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065959:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.065959:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788361562.065966:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.065970:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065979:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.065999:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361562.066002:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.066008:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066011:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.066022:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1788361562.066033:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.066037:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.066041:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066052:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066061:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.066065:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.066072:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066082:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788361562.066122:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.066127:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066135:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.066138:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.066142:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066150:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066168:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066175:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066183:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788361562.066221:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.066225:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066232:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.066234:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.066238:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066245:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066253:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066259:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066277:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788361562.066313:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.066318:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066325:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.066328:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.066332:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066340:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066347:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066353:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066361:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788361562.066391:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.066395:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066402:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.066409:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.066413:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066422:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066430:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066436:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066443:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1788361562.066478:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.066482:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066489:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.066492:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.066496:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066503:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066511:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066523:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.066531:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:0.0:1788361562.066666:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788361562.066672:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066679:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.066683:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066692:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066704:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066717:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f541ca4/0x1b69fa8920fe2416 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066736:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788361562.066740:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066746:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.066749:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066757:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066767:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066773:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe241d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066785:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788361562.066788:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066794:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.066803:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066810:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066834:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066842:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe23ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066856:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788361562.066860:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066866:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.066870:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066877:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066886:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066893:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005601585e/0x1b69fa8920fe2424 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066911:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788361562.066914:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066920:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.066923:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066930:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066939:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066945:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe242b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066955:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788361562.066958:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066963:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.066966:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066982:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066991:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.066998:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eab7829/0x1b69fa8920fe2432 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067011:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788361562.067014:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067020:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067023:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067030:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067038:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067044:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2439 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067064:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788361562.067067:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067072:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067074:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067080:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067087:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067093:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe2440 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067103:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788361562.067106:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067112:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067115:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067131:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067142:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067149:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2447 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067162:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788361562.067165:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067172:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067175:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067182:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067191:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067197:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067220:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788361562.067223:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067229:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067231:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067238:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067247:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067253:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe245c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067263:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361562.067266:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067272:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067276:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067293:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067304:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067311:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067324:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361562.067327:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067332:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067335:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067342:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067350:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067356:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe246a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067376:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.067379:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067385:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.067387:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067395:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067404:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067410:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2471 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.067420:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.067422:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.067424:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.067432:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361562.067489:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.067495:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.067503:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.067506:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361562.067510:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.067519:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.067527:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.067533:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.067553:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788361562.067960:0:26166:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00000100:00100000:1.0:1788361562.068046:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:85023:x1875230429745280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23412us (24286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361562.068060:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4869 00010000:00010000:0.0:1788361562.068134:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.068139:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.068146:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.068155:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.068164:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.068174:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.068181:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2478 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.068194:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.068195:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.068197:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361562.068942:0:85023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85023:1875230429745280:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361562.068958:0:85023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:3.0:1788361562.069043:0:85023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85023:1875230429745536:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361562.069084:0:85023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361562.069110:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429745408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361562.069112:0:85023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d006902cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361562.069137:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745536 00000100:00100000:3.0:1788361562.069144:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745536 00000100:00100000:1.0:1788361562.069149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361562.069186:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4870 00000100:00100000:3.0:1788361562.069196:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:85023:x1875230429745536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361562.069234:0:26172:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00000100:00100000:0.0:1788361562.069282:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745408 00000100:00100000:0.0:1788361562.069288:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745408 00000100:00100000:0.0:1788361562.069323:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1788361562.069332:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429745408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361562.069347:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361562.069402:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429745408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361562.069411:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1788361562.069476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429745408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361562.070709:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:85023:x1875230429745536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1512us (1622us total) trans 4294968747 rc 0/0 00000100:00100000:3.0:1788361562.070720:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4870 00000100:00100000:0.0:1788361562.070745:0:85023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85023:1875230429745536:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788361562.070757:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788361562.070761:0:85023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00010000:00010000:3.0:1788361562.070786:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.070974:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.070990:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.070995:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.071001:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071017:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071028:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071037:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071070:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361562.071094:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.071101:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071118:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.071122:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071133:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.071145:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.071151:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071152:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071174:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe244e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071175:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.071182:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.071189:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071200:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071203:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.071207:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.071211:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.071212:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071220:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071235:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361562.071243:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.071249:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071267:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ca00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.071272:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.071273:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.071284:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071287:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071294:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.071305:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361562.071307:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071310:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071322:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe247f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071328:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071337:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.071339:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.071341:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.071344:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361562.071352:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071371:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361562.071422:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.071427:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071434:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.071437:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.071441:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071449:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071457:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071470:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071488:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361562.071511:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361562.071518:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071526:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ce00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361562.071527:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.071531:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071534:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071550:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071552:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.071556:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.071561:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071570:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071578:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071586:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071616:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361562.071654:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.071660:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071675:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.071678:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.071682:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071690:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071698:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071719:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071727:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071733:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788361562.071737:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2486 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071754:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361562.071758:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071777:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158800 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361562.071779:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.071782:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071785:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071803:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071804:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.071812:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.071845:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071853:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071858:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071872:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff709f9/0x1b69fa8920fe248d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071894:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071897:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361562.071904:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071906:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071923:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361562.071927:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361562.071928:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071939:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071949:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071967:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a892fa23/0x1b69fa8920fe2494 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.071970:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.071981:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.071987:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361562.071990:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:1.0:1788361562.071992:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.071996:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.072005:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072008:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.072015:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072020:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072027:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072033:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072043:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072045:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072066:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af6347bb/0x1b69fa8920fe249b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072092:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361562.072094:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361562.072099:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072106:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.072116:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072125:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.072132:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361562.072138:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072139:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072160:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd704cd0/0x1b69fa8920fe24a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072161:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.072168:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.072177:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072185:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361562.072188:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072190:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072207:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072208:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361562.072215:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072221:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072230:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072234:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361562.072246:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.072271:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361562.072278:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072285:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.072293:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.072297:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072306:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072315:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072322:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072326:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.072334:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072336:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361562.072347:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.072351:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072361:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072374:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361562.072377:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361562.072388:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf223632/0x1b69fa8920fe24b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072389:0:26164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072409:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=2602s v=(0 0) 00010000:00010000:2.0:1788361562.072412:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361562.072421:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072433:0:26164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072436:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.072442:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072445:0:26164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072451:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.072457:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072464:0:26164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072471:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361562.072477:0:26164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361562.072488:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072497:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce382276/0x1b69fa8920fe24b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072511:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361562.072515:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072521:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361562.072525:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072549:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072561:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072569:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dbaaee7/0x1b69fa8920fe24be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.072583:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.072586:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.072589:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361562.072609:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.072640:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068f47cf4/0x1b69fa8920fe24a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.072665:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.072667:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361562.072671:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361562.073853:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788361562.077377:0:26164:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:2.0:1788361562.077479:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:85021:x1875230429745152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 33326us (33922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361562.077489:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4868 00000100:00100000:1.0:1788361562.077712:0:85021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109064380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85021:1875230429745152:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788361562.077728:0:85021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:1.0:1788361562.077810:0:85021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85021:1875230429745792:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361562.077872:0:85021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361562.077904:0:85021:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361562.077980:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d109064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429745664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361562.078009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361562.078046:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745664 00000100:00100000:0.0:1788361562.078052:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745664 00000100:00100000:0.0:1788361562.078086:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788361562.078093:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429745664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361562.078112:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361562.078142:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429745664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361562.078149:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788361562.078177:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429745664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361562.078264:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745792 00000100:00100000:3.0:1788361562.078269:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745792 00000100:00100000:3.0:1788361562.078299:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4871 00000100:00100000:3.0:1788361562.078309:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:85021:x1875230429745792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788361562.078338:0:26171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00000100:00100000:0.0:1788361562.080564:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:85021:x1875230429745792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2255us (2689us total) trans 4294968746 rc 0/0 00000100:00100000:0.0:1788361562.080580:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4871 00000100:00100000:1.0:1788361562.080655:0:85021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d109067b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85021:1875230429745792:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788361562.080668:0:85021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00010000:00010000:0.0:1788361562.198004:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361563.222929:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361564.245981:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361564.991993:0:85583:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:3.0:1788361565.066772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361565.066819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361565.066888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361565.066911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361565.066935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361565.066960:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967808 00000100:00100000:0.0:1788361565.066973:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967552 00000100:00100000:3.0:1788361565.066977:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967808 00000100:00100000:0.0:1788361565.066979:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967552 00000100:00100000:2.0:1788361565.067011:0:85008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967296 00000100:00100000:2.0:1788361565.067016:0:85008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967296 00000100:00100000:3.0:1788361565.067033:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967680 00000100:00100000:3.0:1788361565.067038:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967680 00000100:00100000:2.0:1788361565.067463:0:85008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:2.0:1788361565.067507:0:85008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406967296:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361565.067960:0:85008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406967296:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 486us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361565.067968:0:85008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:3.0:1788361565.068427:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1790 00000100:00100000:0.0:1788361565.068429:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967424 00000100:00100000:3.0:1788361565.068435:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406967808:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361565.068438:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967424 00000100:00100000:3.0:1788361565.068466:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406967808:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 33us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361565.068471:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1790 00000100:00100000:3.0:1788361565.068480:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1791 00000100:00100000:3.0:1788361565.068484:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406967680:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361565.068497:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406967680:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 14us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361565.068500:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1791 00000100:00100000:3.0:1788361565.068514:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 780 00000100:00100000:3.0:1788361565.068518:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406967552:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361565.068548:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406967552:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 17us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361565.068556:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 780 00000100:00100000:3.0:1788361565.068580:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 781 00000100:00100000:3.0:1788361565.068587:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:2410:x1875230406967424:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361565.068614:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:2410:x1875230406967424:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361565.068620:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 781 00000100:00080000:2.0:1788361565.068776:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361565.068781:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361565.068783:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361565.068785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361565.270248:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361566.020164:0:85632:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1788361566.294648:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361567.062116:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429746048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361567.062219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.062242:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429746176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361567.062273:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429745920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361567.062285:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361567.062309:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361567.062377:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746048 00000100:00100000:2.0:1788361567.062386:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746048 00000100:00100000:2.0:1788361567.062439:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429745920 00000100:00100000:2.0:1788361567.062443:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429745920 00000100:00100000:2.0:1788361567.062467:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1788361567.062476:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429746048:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361567.062618:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:3.0:1788361567.062626:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429745920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788361567.062650:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:3.0:1788361567.062692:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429745920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.062699:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:3.0:1788361567.062724:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429746688:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.062755:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.062791:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d139f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429747200:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.062816:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.062860:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788361567.062866:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429746560:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.062886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.062899:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429747072:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.062915:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.062947:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429746304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.062972:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.062992:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429746816:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.063024:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d139f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429747328:0@lo:400:kworker.0 00000004:00000024:2.0:1788361567.063034:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:3.0:1788361567.063045:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.063066:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788361567.063079:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429746432:0@lo:400:kworker.0 00000100:00100000:2.0:1788361567.063087:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429746048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 610us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361567.063095:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1788361567.063106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.063121:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429746944:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.063155:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d139f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429747456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.063206:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746688 00000100:00100000:3.0:1788361567.063211:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746688 00000100:00100000:1.0:1788361567.063253:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746176 00000100:00100000:3.0:1788361567.063255:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746560 00000100:00100000:1.0:1788361567.063259:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746176 00000100:00100000:3.0:1788361567.063260:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746560 00000100:00100000:3.0:1788361567.063287:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747072 00000100:00100000:3.0:1788361567.063290:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747072 00000100:00100000:1.0:1788361567.063298:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1788361567.063307:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746816 00000100:00100000:1.0:1788361567.063311:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429746176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361567.063312:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746816 00000100:00100000:3.0:1788361567.063332:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746432 00002000:00000024:1.0:1788361567.063335:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361567.063336:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746432 00000100:00100000:3.0:1788361567.063353:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747456 00000100:00100000:3.0:1788361567.063356:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747456 00000100:00100000:3.0:1788361567.063373:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1788361567.063378:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429746176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.063385:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429746688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.063390:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1788361567.063416:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1788361567.063425:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429746560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.063464:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429746560:12345-0@lo:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.063475:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429746688:12345-0@lo:400:kworker.0 Request processed in 91us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.063482:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:3.0:1788361567.063489:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1788361567.063510:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1788361567.063520:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429747072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063525:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1788361567.063533:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429746816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.063553:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429747072:12345-0@lo:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.063560:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1788361567.063578:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429746816:12345-0@lo:400:kworker.0 Request processed in 44us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.063578:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1788361567.063588:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1788361567.063588:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429746432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063616:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1788361567.063623:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429746432:12345-0@lo:400:kworker.0 Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.063627:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429747456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.063634:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1788361567.063675:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429747456:12345-0@lo:400:kworker.0 Request processed in 52us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.063682:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1788361567.063723:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429746432:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063735:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d139f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429747456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063746:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429746816:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.063783:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429747584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361567.063812:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747200 00000100:00100000:0.0:1788361567.063817:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747200 00000100:00080000:2.0:1788361567.063859:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361567.063864:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361567.063867:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361567.063868:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361567.063880:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747328 00000100:00100000:0.0:1788361567.063885:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747328 00000100:00100000:2.0:1788361567.063901:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746944 00000100:00100000:2.0:1788361567.063906:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746944 00000100:00100000:0.0:1788361567.063923:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1788361567.063932:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429747200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361567.064292:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:2.0:1788361567.064300:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.064862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.064908:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429746048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361567.064916:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429747200:12345-0@lo:400:kworker.0 Request processed in 984us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361567.064927:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:3.0:1788361567.064930:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429745920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361567.064952:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788361567.064963:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429746944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.064988:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429746304 00000100:00100000:3.0:1788361567.064994:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429746304 00000100:00100000:0.0:1788361567.065009:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429746944:12345-0@lo:400:kworker.0 Request processed in 48us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361567.065016:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:3.0:1788361567.065027:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788361567.065037:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429746304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361567.065123:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747584 00000100:00100000:0.0:1788361567.065127:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747584 00000100:00100000:0.0:1788361567.065154:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1788361567.065163:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429747584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788361567.065184:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361567.065247:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429746560:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.065264:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429747072:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.065276:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429746688:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.065286:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d139f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429747200:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.065301:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429746176:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788361567.065346:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361567.065351:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361567.065418:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429746944:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.065428:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429746304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.065550:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429746304:12345-0@lo:400:kworker.0 Request processed in 514us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.065558:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788361567.065615:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429747328:12345-0@lo:400:kworker.0 Request processed in 1316us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361567.065623:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:1.0:1788361567.065681:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d139f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429747328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361567.066151:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429747584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 989us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361567.066166:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1788361567.066282:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429747584:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788361567.318263:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361567.539074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361567.539207:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406967936 00000100:00100000:1.0:1788361567.539238:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406967936 00000100:00100000:1.0:1788361567.539366:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1053 00000100:00100000:1.0:1788361567.539377:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:65653:x1875230406967936:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361567.539409:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:1.0:1788361567.539504:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:65653:x1875230406967936:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 129us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.539510:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1053 00000100:00080000:2.0:1788361567.539710:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361567.542682:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361567.542859:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968064 00000100:00100000:0.0:1788361567.542869:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968064 00000100:00100000:0.0:1788361567.542947:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1054 00000100:00100000:0.0:1788361567.542956:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:65653:x1875230406968064:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361567.542987:0:66128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00080000:2.0:1788361567.543117:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361567.543621:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:65653:x1875230406968064:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 664us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361567.543630:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1054 00000100:00100000:0.0:1788361567.549275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361567.549564:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968192 00000100:00100000:1.0:1788361567.549576:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968192 00000100:00100000:1.0:1788361567.550170:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1440 00000100:00100000:1.0:1788361567.550181:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65653:x1875230406968192:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361567.550212:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361567.550296:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65653:x1875230406968192:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 117us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.550313:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1440 00000100:00080000:2.0:1788361567.551555:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361567.552234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361567.552325:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968320 00000100:00100000:1.0:1788361567.552335:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968320 00000100:00100000:1.0:1788361567.552403:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1441 00000100:00100000:1.0:1788361567.552413:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65653:x1875230406968320:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361567.552440:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361567.552520:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:65653:x1875230406968320:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.552527:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1441 00000100:00080000:2.0:1788361567.553382:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361567.574245:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361567.574247:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429747712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361567.574274:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429747840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361567.574325:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361567.574516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361567.574560:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747712 00000100:00100000:0.0:1788361567.574567:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747712 00000100:00100000:0.0:1788361567.574607:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747840 00000100:00100000:0.0:1788361567.574610:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747840 00000100:00100000:0.0:1788361567.574630:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1788361567.574639:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429747712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361567.574664:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361567.574676:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1788361567.574689:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429747840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361567.574712:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361567.574755:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429747840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361567.574764:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1788361567.574796:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429747840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361567.575528:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429747712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 888us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361567.575536:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1788361567.575734:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429747712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361567.583564:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361567.583616:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968576 00000100:00100000:3.0:1788361567.583628:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968576 00000100:00100000:3.0:1788361567.583693:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1055 00000100:00100000:3.0:1788361567.583704:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+7:65669:x1875230406968576:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361567.583727:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361567.583747:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d20 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.583819:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.583858:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.583869:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.583883:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.583895:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.583903:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584070:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584079:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584115:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584122:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584129:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361567.584133:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584141:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584154:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:3.0:1788361567.584157:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361567.584161:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584167:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584179:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584185:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584190:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584196:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0ee00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361567.584204:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584211:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584219:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d1214c3d00) 00010000:00010000:3.0:1788361567.584221:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361567.584224:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584231:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584262:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d20 expref: 8 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584272:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:3.0:1788361567.584274:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361567.584278:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d20 expref: 8 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361567.584286:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e200, rc 0) 00000100:00100000:3.0:1788361567.584349:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+7:65669:x1875230406968576:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 647us (795us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361567.584356:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1055 00000100:00100000:3.0:1788361567.589265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361567.589333:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968704 00000100:00100000:1.0:1788361567.589357:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968704 00000100:00100000:1.0:1788361567.589421:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1056 00000100:00100000:1.0:1788361567.589432:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:65669:x1875230406968704:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:1.0:1788361567.589517:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589535:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589548:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589564:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589571:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589579:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589683:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589691:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589698:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361567.589740:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361567.589753:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589775:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589782:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589788:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589795:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589801:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361567.589805:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589813:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589857:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:1.0:1788361567.589861:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361567.589866:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589873:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe24da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589887:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589893:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589904:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589909:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361567.589912:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589918:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589927:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99d10a2fb000) 00010000:00010000:1.0:1788361567.589929:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361567.589932:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589938:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe24e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589951:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589957:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589963:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589968:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361567.589971:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589987:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.589996:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99d10a2fbe00) 00010000:00010000:1.0:1788361567.589998:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361567.590001:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361567.590007:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe24e8 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361567.590094:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:65669:x1875230406968704:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 665us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.590102:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1056 00000001:00080000:2.0:1788361568.089273:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968746 is committed 00000001:00080000:0.0:1788361568.089706:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968747 is committed 00010000:00010000:1.0:1788361568.345967:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361569.367963:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361570.188397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361570.188455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361570.188487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361570.188504:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969088 00000100:00100000:2.0:1788361570.188515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361570.188525:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969088 00000100:00100000:2.0:1788361570.188541:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361570.188572:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969344 00000100:00100000:2.0:1788361570.188577:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969344 00000100:00100000:1.0:1788361570.188590:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968960 00000100:00100000:1.0:1788361570.188594:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968960 00000100:00100000:2.0:1788361570.188616:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969216 00000100:00100000:2.0:1788361570.188621:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969216 00000100:00100000:1.0:1788361570.188627:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 788 00000100:00100000:1.0:1788361570.188639:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406969088:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361570.188653:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1795 00000100:00100000:2.0:1788361570.188663:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406969344:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361570.188711:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406969088:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361570.188720:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 788 00000100:00100000:0.0:1788361570.188726:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406968832 00000100:00100000:0.0:1788361570.188737:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406968832 00000100:00100000:1.0:1788361570.188738:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 789 00000100:00100000:1.0:1788361570.188747:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230406968960:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361570.188776:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:0.0:1788361570.188791:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230406968832:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361570.189038:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406969344:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 376us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361570.189048:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1795 00000100:00100000:1.0:1788361570.189049:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230406968960:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 301us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361570.189065:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 789 00000100:00100000:2.0:1788361570.189069:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1796 00000100:00100000:2.0:1788361570.189080:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406969216:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:1.0:1788361570.189093:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361570.189098:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361570.189100:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361570.189103:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361570.189114:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406969216:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361570.189121:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1796 00000100:00100000:0.0:1788361570.190726:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230406968832:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1930us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361570.190739:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 75 00010000:00010000:0.0:1788361570.390632:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361571.074754:0:85826:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 11:06:09 (1788361569) 00000100:00100000:2.0:1788361571.148177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361571.148229:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969472 00000100:00100000:3.0:1788361571.148238:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969472 00000100:00100000:3.0:1788361571.148306:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1057 00000100:00100000:3.0:1788361571.148323:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:66250:x1875230406969472:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361571.148347:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361571.148370:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d27 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148457:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148471:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148484:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148497:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148504:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148511:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148553:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148560:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148566:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148583:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148590:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0e200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361571.148595:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148603:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148615:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:3.0:1788361571.148618:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361571.148623:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148629:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe24f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148639:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148644:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148649:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148653:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361571.148656:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148672:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148679:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99d1214c3500) 00010000:00010000:3.0:1788361571.148681:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361571.148684:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148690:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe24fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148719:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d27 expref: 8 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148730:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:3.0:1788361571.148732:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361571.148736:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe24ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d27 expref: 8 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.148746:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0ee00, rc 0) 00000100:00100000:3.0:1788361571.148814:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:66250:x1875230406969472:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 498us (645us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361571.148959:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1057 00000100:00100000:0.0:1788361571.152524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361571.152601:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969728 00000100:00100000:2.0:1788361571.152611:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969728 00000100:00100000:2.0:1788361571.152711:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1058 00000100:00100000:2.0:1788361571.152722:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:66250:x1875230406969728:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:2.0:1788361571.152779:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361571.152805:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe22f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d19 expref: 7 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.152850:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3300) 00010000:00010000:2.0:1788361571.152863:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361571.152925:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.152939:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.152949:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.152962:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.152970:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.152977:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.153930:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.153948:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.153956:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361571.153972:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af1e5395 reply state 00000000372b94d8 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.153984:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.153990:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:2.0:1788361571.153993:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361571.153997:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788361571.154001:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788361571.154009:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154015:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154022:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154029:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361571.154033:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154041:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154061:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0040d4b00) 00010000:00010000:2.0:1788361571.154063:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361571.154068:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154074:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe2504 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361571.154090:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af1e5395 reply state 00000000372b94d8 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154098:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.154105:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99d0040d4600) 00010000:00010000:2.0:1788361571.154107:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361571.154110:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788361571.154257:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:66250:x1875230406969728:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 1470us (1672us total) trans 103079215105 rc 0/0 00000100:00100000:2.0:1788361571.154266:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1058 00000100:00100000:1.0:1788361571.172209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361571.172242:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969856 00000100:00100000:1.0:1788361571.172251:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969856 00000100:00100000:1.0:1788361571.172303:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1059 00000100:00100000:1.0:1788361571.172311:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:66254:x1875230406969856:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361571.172337:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361571.172360:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d2e expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.172436:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.172451:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.172463:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361571.172508:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361571.172511:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361571.172527:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.172545:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d2e expref: 10 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.172568:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d2e expref: 9 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.172574:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10a2fb000) 00010000:00010000:1.0:1788361571.172577:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361571.172579:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4e00, rc 0) 00000100:00100000:1.0:1788361571.172624:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+9:66254:x1875230406969856:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 314us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361571.172630:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1059 00000100:00100000:2.0:1788361571.177231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361571.177292:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406969984 00000100:00100000:1.0:1788361571.177303:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406969984 00000100:00100000:1.0:1788361571.177369:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1060 00000100:00100000:1.0:1788361571.177382:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+9:66254:x1875230406969984:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361571.177402:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361571.177489:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe2527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d35 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177558:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177577:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177588:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177602:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177618:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177626:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177701:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe253c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177709:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe253c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177717:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe253c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361571.177768:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788361571.177773:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361571.177804:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe253c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177818:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177845:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177852:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177858:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177875:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361571.177880:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177888:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177903:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10a2fb000) 00010000:00010000:1.0:1788361571.177906:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361571.177912:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177919:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe252e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177934:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177940:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177946:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177951:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361571.177954:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177960:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177981:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99d0040d4600) 00010000:00010000:1.0:1788361571.177984:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361571.177987:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.177994:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe2535 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.178028:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe2527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d35 expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.178044:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe253c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d35 expref: 10 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.178062:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:1.0:1788361571.178065:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361571.178068:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5600, rc 0) 00000100:00100000:1.0:1788361571.178137:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+10:66254:x1875230406969984:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 758us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361571.178144:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1060 00000100:00100000:1.0:1788361571.180631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361571.180681:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406970240 00000100:00100000:3.0:1788361571.180690:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406970240 00000100:00100000:3.0:1788361571.180745:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1061 00000100:00100000:3.0:1788361571.180758:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+10:66254:x1875230406970240:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361571.180788:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361571.180808:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe2543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d3c expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361571.180930:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788361571.181085:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe2543 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d3c expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.181098:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10a2fb000) 00010000:00010000:3.0:1788361571.181101:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361571.181106:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe2543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d3c expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.181116:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0ee00, rc 0) 00000100:00100000:3.0:1788361571.181164:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+11:66254:x1875230406970240:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 410us (540us total) trans 103079215106 rc 301/301 00000100:00100000:3.0:1788361571.181171:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1061 00000100:00100000:3.0:1788361571.182569:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361571.182656:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406970496 00000100:00100000:0.0:1788361571.182668:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406970496 00000100:00100000:3.0:1788361571.183255:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1062 00000100:00100000:3.0:1788361571.183264:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+11:66254:x1875230406970496:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:3.0:1788361571.183300:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361571.183318:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe253c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d35 expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.183332:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:3.0:1788361571.183335:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361571.183360:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.183370:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.183377:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361571.183523:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059fbaf74 reply state 0000000029673c6b transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.183536:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.183542:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:3.0:1788361571.183544:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788361571.183547:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788361571.183553:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1788361571.183612:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:66254:x1875230406970496:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 348us (1046us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1788361571.183619:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1062 00000100:00100000:1.0:1788361571.184730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361571.184786:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406970752 00000100:00100000:2.0:1788361571.184791:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406970752 00000100:00100000:2.0:1788361571.184928:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:2.0:1788361571.184939:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:66254:x1875230406970752:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788361571.185053:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:66254:x1875230406970752:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 117us (327us total) trans 103079215108 rc 0/0 00000100:00100000:2.0:1788361571.185060:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 217 00010000:00010000:0.0:1788361571.414011:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788361571.605953:0:85004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:2.0:1788361571.606126:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606138:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606146:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606153:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361571.606157:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606165:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606181:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99d0040d4600) 00010000:00010000:2.0:1788361571.606185:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361571.606190:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606197:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe250b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606217:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606223:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606229:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606248:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361571.606251:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606257:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606266:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:2.0:1788361571.606268:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361571.606271:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606277:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2512 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606292:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606298:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606304:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606309:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361571.606312:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606318:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606335:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:2.0:1788361571.606337:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361571.606340:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.606346:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2551 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361571.650149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361571.650214:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406970880 00000100:00100000:3.0:1788361571.650223:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406970880 00000100:00100000:3.0:1788361571.650283:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1063 00000100:00100000:3.0:1788361571.650295:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:66267:x1875230406970880:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361571.650339:0:66127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:3.0:1788361571.650436:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:66267:x1875230406970880:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 143us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361571.650454:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1063 00000100:00100000:1.0:1788361571.654118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361571.655345:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971008 00000100:00100000:3.0:1788361571.655358:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971008 00000100:00100000:3.0:1788361571.655432:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1064 00000100:00100000:3.0:1788361571.655443:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:66267:x1875230406971008:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361571.655485:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:3.0:1788361571.655564:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:66267:x1875230406971008:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 123us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361571.655572:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1064 00000100:00100000:1.0:1788361571.661360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361571.661653:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971136 00000100:00100000:0.0:1788361571.661663:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971136 00000100:00100000:0.0:1788361571.661719:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1444 00000100:00100000:0.0:1788361571.661730:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:66267:x1875230406971136:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361571.661766:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361571.661853:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:66267:x1875230406971136:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 125us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361571.661861:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1444 00000100:00100000:0.0:1788361571.664337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361571.664464:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971264 00000100:00100000:2.0:1788361571.664473:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971264 00000100:00100000:2.0:1788361571.664525:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1445 00000100:00100000:2.0:1788361571.664534:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:66267:x1875230406971264:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361571.664564:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361571.664628:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:66267:x1875230406971264:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361571.664636:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1445 00000100:00100000:1.0:1788361571.728311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361571.729287:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971520 00000100:00100000:0.0:1788361571.729298:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971520 00000100:00100000:0.0:1788361571.729349:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1065 00000100:00100000:0.0:1788361571.729360:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+7:66274:x1875230406971520:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00010000:0.0:1788361571.729427:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361571.729455:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d2e expref: 7 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.729487:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10a2fb000) 00010000:00010000:0.0:1788361571.729500:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361571.729568:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.729581:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.729590:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.729603:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.729611:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.729618:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730022:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730031:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730038:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730045:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730061:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361571.730066:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730074:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730084:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d004434800) 00010000:00010000:0.0:1788361571.730087:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361571.730091:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730098:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2558 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361571.730114:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004198b929 reply state 00000000dc7a948e transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730125:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.730132:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004434e00) 00010000:00010000:0.0:1788361571.730134:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361571.730137:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361571.730220:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:66274:x1875230406971520:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 861us (1916us total) trans 103079215109 rc 0/0 00000100:00100000:0.0:1788361571.730228:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1065 00000100:00100000:1.0:1788361571.747802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361571.747866:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971648 00000100:00100000:3.0:1788361571.747878:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971648 00000100:00100000:3.0:1788361571.747940:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1066 00000100:00100000:3.0:1788361571.747949:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:66277:x1875230406971648:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788361571.747974:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361571.748088:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d43 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.748167:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe256d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.748182:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe256d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.748196:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe256d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361571.748242:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361571.748260:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361571.748281:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe256d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.748305:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158800/0x1b69fa8920fe2566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d43 expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.748323:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe256d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d43 expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361571.748332:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:2.0:1788361571.748335:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361571.748338:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137158000, rc 0) 00000100:00100000:2.0:1788361571.748399:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+9:66277:x1875230406971648:12345-192.168.204.35@tcp:101:rm.0 Request processed in 451us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361571.748417:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1066 00000100:00100000:1.0:1788361571.751099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361571.751239:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971776 00000100:00100000:3.0:1788361571.751248:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971776 00000100:00100000:3.0:1788361571.751341:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1067 00000100:00100000:3.0:1788361571.751353:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+9:66277:x1875230406971776:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788361571.751371:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361571.751415:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe2574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d4a expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751472:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751489:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751507:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751519:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751527:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751533:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751606:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751613:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751620:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361571.751677:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788361571.751681:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361571.751701:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751712:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751721:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751737:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751744:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751749:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0ee00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361571.751754:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751761:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751773:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:3.0:1788361571.751776:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361571.751780:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751786:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0ee00/0x1b69fa8920fe257b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751797:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751803:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751809:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751814:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361571.751857:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751865:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751873:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004434e00) 00010000:00010000:3.0:1788361571.751875:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361571.751878:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751884:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe2582 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751910:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe2574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d4a expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751923:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d4a expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361571.751931:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99d10af5c800) 00010000:00010000:3.0:1788361571.751933:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361571.751936:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0f400, rc 0) 00000100:00100000:3.0:1788361571.752008:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:66277:x1875230406971776:12345-192.168.204.35@tcp:101:rm.0 Request processed in 658us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361571.752014:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1067 00000100:00100000:1.0:1788361571.755801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361571.756138:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972032 00000100:00100000:0.0:1788361571.756153:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972032 00000100:00100000:0.0:1788361571.756363:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1068 00000100:00100000:0.0:1788361571.756461:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:66277:x1875230406972032:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1788361571.756539:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361571.756574:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2589 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d4a expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756598:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99d10af5c800) 00010000:00010000:0.0:1788361571.756621:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158000/0x1b69fa8920fe256d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d43 expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756632:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0040d4700) 00010000:00010000:0.0:1788361571.756640:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361571.756672:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756689:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756700:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756712:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756721:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756728:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756909:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756925:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.756933:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757398:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757422:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757430:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757438:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757445:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757457:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757479:0:66126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361571.757505:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757512:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757518:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.757519:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361571.757527:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757532:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361571.757533:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a82200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361571.757538:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757538:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.757547:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757547:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.757562:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99d004434200) 00010000:00010000:1.0:1788361571.757565:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361571.757569:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757569:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99d004434200) 00010000:00010000:0.0:1788361571.757571:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788361571.757574:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.757576:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25a5 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757580:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe259e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361571.757591:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361571.757592:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361571.757594:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361571.757603:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757609:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757615:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757621:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757626:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361571.757628:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757640:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757646:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d004434800) 00010000:00010000:0.0:1788361571.757647:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361571.757650:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757653:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe2590 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361571.757661:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbf1f9bb reply state 0000000050d6a091 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757670:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361571.757674:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004434e00) 00010000:00010000:0.0:1788361571.757676:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361571.757678:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361571.757758:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:66277:x1875230406972032:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1368us (1968us total) trans 103079215110 rc 0/0 00000100:00100000:0.0:1788361571.757766:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1068 00000100:00100000:1.0:1788361572.182003:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429747968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361572.182005:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361572.182025:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d139f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429748096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361572.182086:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.182086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.182125:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361572.182130:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429748224:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.182478:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.182522:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429748736:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.182548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.182815:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429748480:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.182868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.182872:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361572.182882:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429748608:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.182892:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429748352:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.182918:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.182929:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429748864:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.182963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.182965:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748096 00000100:00100000:3.0:1788361572.182973:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748096 00000100:00100000:1.0:1788361572.182989:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361572.182996:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429748992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.183020:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748864 00000100:00100000:1.0:1788361572.183023:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.183025:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748864 00000100:00100000:1.0:1788361572.183048:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429749376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.183060:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:3.0:1788361572.183070:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429748096:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361572.183072:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:1.0:1788361572.183074:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361572.183086:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429748864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.183096:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361572.183101:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429749504:0@lo:400:kworker.0 00000004:00000024:3.0:1788361572.183110:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361572.183127:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.183162:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429748096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.183167:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429748864:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.183173:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:2.0:1788361572.183194:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429748864:12345-0@lo:400:kworker.0 Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361572.183201:0:85010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748224 00000100:00100000:2.0:1788361572.183202:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:3.0:1788361572.183208:0:85010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748224 00000100:00100000:2.0:1788361572.183226:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429749248:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.183226:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.183255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.183256:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361572.183273:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429749760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361572.183273:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429749632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361572.183294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.183294:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.183320:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429747968 00000100:00100000:2.0:1788361572.183321:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d139f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429748096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361572.183324:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429747968 00000100:00100000:2.0:1788361572.183343:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748992 00000100:00100000:2.0:1788361572.183352:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748992 00000100:00100000:1.0:1788361572.183358:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749760 00000100:00100000:1.0:1788361572.183360:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749760 00000100:00100000:1.0:1788361572.183377:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788361572.183378:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749376 00000100:00100000:2.0:1788361572.183381:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749376 00000100:00100000:2.0:1788361572.183417:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749248 00000100:00100000:2.0:1788361572.183420:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749248 00000100:00100000:2.0:1788361572.183444:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:2.0:1788361572.183451:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429748992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.183496:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429748992:12345-0@lo:400:kworker.0 Request processed in 45us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.183503:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1788361572.183514:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429747968:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361572.183522:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:2.0:1788361572.183529:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429749376:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788361572.183530:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361572.183557:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429749376:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.183558:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429747968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 175us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.183564:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000100:00100000:1.0:1788361572.183564:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788361572.183578:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:1.0:1788361572.183578:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1788361572.183585:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.183585:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429749760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361572.183599:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361572.183618:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429749248:12345-0@lo:400:kworker.0 Request processed in 34us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.183624:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:1.0:1788361572.183627:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429749760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.183633:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1788361572.183654:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748736 00000100:00100000:1.0:1788361572.183657:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748736 00000100:00100000:2.0:1788361572.183665:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968746 gen 2 00000100:00100000:2.0:1788361572.183677:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429749248:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.183682:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748480 00000100:00100000:1.0:1788361572.183684:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748480 00000100:00100000:2.0:1788361572.183690:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429749760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361572.183726:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748608 00000100:00100000:2.0:1788361572.183730:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748608 00000100:00100000:3.0:1788361572.183800:0:85010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788361572.183806:0:85010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429748224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.183865:0:85010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429748224:12345-0@lo:400:kworker.0 Request processed in 58us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361572.183872:0:85010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788361572.183897:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749632 00000100:00100000:3.0:1788361572.183901:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749632 00000100:00100000:3.0:1788361572.183922:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:3.0:1788361572.183936:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429749632:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361572.183944:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749504 00000100:00100000:1.0:1788361572.183944:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749120 00000100:00100000:2.0:1788361572.183949:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749504 00000100:00100000:1.0:1788361572.183950:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749120 00000004:00000024:3.0:1788361572.183955:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:1.0:1788361572.183970:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1788361572.183975:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1788361572.183979:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.183980:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429748480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.183996:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429749632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361572.184004:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:2.0:1788361572.184024:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429748480:12345-0@lo:400:kworker.0 Request processed in 41us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.184024:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429748736:12345-0@lo:400:kworker.0 Request processed in 46us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.184031:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1788361572.184035:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1788361572.184045:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1788361572.184048:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1788361572.184051:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429748608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.184053:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.184080:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429748608:12345-0@lo:400:kworker.0 Request processed in 29us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.184082:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429749120:12345-0@lo:400:kworker.0 Request processed in 28us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.184086:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1788361572.184088:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1788361572.184097:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1788361572.184103:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429749504:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361572.184130:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361572.184134:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361572.184136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361572.184138:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361572.184476:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429749504:12345-0@lo:400:kworker.0 Request processed in 372us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.184479:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.184483:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1788361572.184492:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429749632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361572.184517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.184564:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429747968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361572.184567:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429748352 00000100:00100000:3.0:1788361572.184573:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429748352 00000100:00100000:1.0:1788361572.184584:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429748480:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.184611:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1788361572.184620:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875230429748352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361572.184621:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361572.184623:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.184637:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429748736:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.184638:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429749504:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.184649:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429748224:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.184651:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968747 gen 2 00000100:00100000:1.0:1788361572.184660:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429749376:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.184672:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429748992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.184679:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875230429748352:12345-0@lo:400:kworker.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361572.184686:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1788361572.184764:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429748352:0@lo:400:kworker.0 00010000:00010000:3.0:1788361572.437989:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361572.694320:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429749888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361572.694402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361572.694487:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361572.694495:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429750016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361572.694520:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.694962:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429749888 00000100:00100000:3.0:1788361572.694970:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429749888 00000100:00100000:3.0:1788361572.695043:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750016 00000100:00100000:3.0:1788361572.695046:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750016 00000100:00100000:2.0:1788361572.695084:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788361572.695100:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429749888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361572.695122:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361572.695161:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429749888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.695168:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788361572.695359:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1788361572.695366:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429750016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361572.695376:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361572.695416:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429750016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.695422:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1788361572.695462:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429750016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361572.695474:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429749888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361573.461962:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361574.486147:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361575.120527:0:86223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788361575.162959:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361575.163157:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972160 00000100:00100000:3.0:1788361575.163168:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972160 00000100:00100000:3.0:1788361575.163272:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1069 00000100:00100000:3.0:1788361575.163284:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:66344:x1875230406972160:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361575.163314:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361575.163351:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe25ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d51 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.163413:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe25b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361575.163418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361575.163441:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe25b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.163461:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe25b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361575.163517:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361575.163521:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361575.163568:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe25b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.163612:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f200/0x1b69fa8920fe25ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d51 expref: 12 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.163632:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe25b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d51 expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.163649:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10af5ce00) 00010000:00010000:3.0:1788361575.163652:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361575.163655:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e200, rc 0) 00010000:00000080:3.0:1788361575.163666:0:80345:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1365c8000 x1875230406972160/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:636/0 lens 576/688 e 0 to 0 dl 1788361586 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361575.163735:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+11:66344:x1875230406972160:12345-192.168.204.35@tcp:101:touch.0 Request processed in 455us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361575.164005:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1069 00000100:00100000:0.0:1788361575.168199:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361575.168370:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972288 00000100:00100000:2.0:1788361575.168385:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972288 00000100:00100000:2.0:1788361575.168465:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1070 00000100:00100000:2.0:1788361575.168477:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+11:66344:x1875230406972288:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361575.168500:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361575.168526:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159c00/0x1b69fa8920fe25ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d58 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168601:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168622:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168633:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168648:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168655:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168661:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168746:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159000/0x1b69fa8920fe25cf lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168754:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159000/0x1b69fa8920fe25cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168761:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159000/0x1b69fa8920fe25cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361575.168795:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788361575.168798:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361575.168846:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159000/0x1b69fa8920fe25cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168862:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168878:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168884:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168891:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168897:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361575.168902:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168909:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168921:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d10af5ce00) 00010000:00010000:2.0:1788361575.168924:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361575.168929:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168935:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159600/0x1b69fa8920fe25c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168947:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168953:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168959:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168969:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361575.168973:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168979:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168986:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99d0040d4200) 00010000:00010000:2.0:1788361575.168989:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361575.168991:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.168997:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137158a00/0x1b69fa8920fe25c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.169027:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159c00/0x1b69fa8920fe25ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d58 expref: 13 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.169040:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159000/0x1b69fa8920fe25cf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d58 expref: 12 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361575.169048:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4000) 00010000:00010000:2.0:1788361575.169050:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361575.169052:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137159000, rc 0) 00010000:00000080:2.0:1788361575.169061:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109ad80 x1875230406972288/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:636/0 lens 592/688 e 0 to 0 dl 1788361586 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361575.169133:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+12:66344:x1875230406972288:12345-192.168.204.35@tcp:101:touch.0 Request processed in 658us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361575.169149:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1070 00000100:00100000:3.0:1788361575.172180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361575.172595:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972544 00000100:00100000:0.0:1788361575.172610:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972544 00000100:00100000:0.0:1788361575.172685:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1071 00000100:00100000:0.0:1788361575.172700:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+12:66344:x1875230406972544:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:0.0:1788361575.172746:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361575.172773:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25d6 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d5f expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173015:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173035:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173051:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173072:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173080:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173100:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173710:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173721:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173729:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361575.173785:0:66901:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1788361575.173799:0:66901:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1788361574 00000004:00010000:0.0:1788361575.173802:0:66901:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1788361574 00000004:00010000:0.0:1788361575.173805:0:66901:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1788361574 00000004:00010000:0.0:1788361575.173808:0:66901:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1788361575.173814:0:66901:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1788361575.173863:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173873:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173880:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173887:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173896:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361575.173902:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173913:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173932:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d0040d4000) 00010000:00010000:0.0:1788361575.173936:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361575.173942:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173950:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83e00/0x1b69fa8920fe25dd lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361575.173981:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ef8efc6 reply state 00000000515480b7 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.173995:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.174003:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99d112cab000) 00010000:00010000:0.0:1788361575.174006:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361575.174009:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361575.174049:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82200/0x1b69fa8920fe25d6 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 15 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.174069:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 14 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.174077:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d112cab400) 00010000:00010000:0.0:1788361575.174080:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1788361575.174082:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a83200, rc 0) 00010000:00000080:0.0:1788361575.174093:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1365c2680 x1875230406972544/t103079215111(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:636/0 lens 752/824 e 0 to 0 dl 1788361586 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361575.174198:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+15:66344:x1875230406972544:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1503us (2023us total) trans 103079215111 rc 0/0 00000100:00100000:0.0:1788361575.174208:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1071 00000100:00100000:3.0:1788361575.176335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361575.176425:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972800 00000100:00100000:0.0:1788361575.176436:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972800 00000100:00100000:0.0:1788361575.176525:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1072 00000100:00100000:0.0:1788361575.176536:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+15:66344:x1875230406972800:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:0.0:1788361575.176648:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.176665:0:66128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 15 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.176675:0:66128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.176708:0:66128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 15 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361575.176722:0:66128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 15 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361575.176737:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429750144:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788361575.176849:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361575.179361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361575.179486:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429750144:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788361575.179513:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972928 00010000:00010000:1.0:1788361575.179515:0:66128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361575.179528:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972928 00010000:00010000:3.0:1788361575.179563:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 16 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361575.179608:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2581 00000100:00100000:3.0:1788361575.179617:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:ec302d84-8f96-49d3-8682-aefc474f8448+16:2410:x1875230406972928:12345-192.168.204.35@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1788361575.179634:0:19648:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 16 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.179644:0:19648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 16 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.179656:0:19648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 16 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.179664:0:19648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d112cab400) 00010000:00010000:3.0:1788361575.179667:0:19648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1788361575.179671:0:19648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.179681:0:19648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.179687:0:19648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361575.179716:0:19648:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 16 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361575.179768:0:66128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361575.179776:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:ec302d84-8f96-49d3-8682-aefc474f8448+16:2410:x1875230406972928:12345-192.168.204.35@tcp:102:ldlm_bl.0 Request processed in 158us (439us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361575.179780:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361575.179801:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2581 00000004:00010000:1.0:1788361575.179930:0:66128:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788361575.179934:0:66128:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1788361574 -> 1788361574 00000004:00010000:1.0:1788361575.179936:0:66128:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1788361574 -> 1788361574 00000004:00010000:1.0:1788361575.179939:0:66128:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1788361574 -> 1788361574 00000004:00010000:1.0:1788361575.179941:0:66128:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1788361575.179948:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc393668 reply state 00000000473cbb89 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361575.179966:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361575.179973:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d112cab400) 00010000:00010000:1.0:1788361575.179976:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361575.179979:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1788361575.180030:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1365c3480 x1875230406972800/t103079215112(0) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:636/0 lens 488/456 e 0 to 0 dl 1788361586 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361575.180078:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+17:66344:x1875230406972800:12345-192.168.204.35@tcp:36:touch.0 Request processed in 3545us (3750us total) trans 103079215112 rc 0/0 00000100:00100000:1.0:1788361575.180086:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1072 00000100:00100000:1.0:1788361575.183506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361575.183599:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973184 00000100:00100000:3.0:1788361575.183611:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973184 00000100:00100000:3.0:1788361575.183671:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 218 00000100:00100000:3.0:1788361575.183682:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+17:66344:x1875230406973184:12345-192.168.204.35@tcp:35:touch.0 00010000:00000080:3.0:1788361575.183947:0:66129:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136594000 x1875230406973184/t103079215113(0) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:636/0 lens 392/456 e 0 to 0 dl 1788361586 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361575.184005:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+18:66344:x1875230406973184:12345-192.168.204.35@tcp:35:touch.0 Request processed in 325us (506us total) trans 103079215113 rc 0/0 00000100:00100000:3.0:1788361575.184014:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 218 00000100:00100000:3.0:1788361575.304123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361575.304713:0:85011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973312 00000100:00100000:0.0:1788361575.304726:0:85011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973312 00000100:00100000:3.0:1788361575.304782:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361575.304802:0:85011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:0.0:1788361575.304818:0:85011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406973312:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361575.304841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361575.304873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361575.304902:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973568 00000100:00100000:3.0:1788361575.304906:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973568 00000100:00100000:0.0:1788361575.304937:0:85011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406973312:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 122us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361575.304946:0:85011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:3.0:1788361575.304953:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973696 00000100:00100000:3.0:1788361575.304957:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973696 00000100:00100000:3.0:1788361575.304981:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1800 00000100:00100000:3.0:1788361575.304991:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406973568:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361575.305015:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1801 00000100:00100000:0.0:1788361575.305026:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406973696:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361575.305028:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406973568:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361575.305039:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1800 00000100:00080000:3.0:1788361575.305062:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361575.305068:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361575.305092:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406973696:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361575.305104:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1801 00000100:00100000:3.0:1788361575.305113:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973440 00000100:00100000:3.0:1788361575.305118:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973440 00000100:00080000:0.0:1788361575.305141:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361575.305670:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 796 00000100:00100000:1.0:1788361575.305682:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406973440:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361575.305722:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406973440:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 44us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361575.305733:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 796 00010000:00010000:1.0:1788361575.510932:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788361576.137133:0:86320:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788361576.137215:0:86320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137232:0:86320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137241:0:86320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137249:0:86320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137270:0:86320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788361576.137276:0:86320:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788361576.137310:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361576.137318:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137338:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361576.137342:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137353:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361576.137361:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361576.137380:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361576.137383:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361576.137386:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788361576.137449:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137457:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361576.137483:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137492:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aac400/0x1b69fa8920fe2176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe217d expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.137505:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361576.137508:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361576.137510:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361576.137527:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361576.137528:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429750272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361576.137534:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788361576.137543:0:86320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788361576.137564:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d005034800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788361576.137586:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429750400:0@lo:39:umount.0 00000100:00100000:1.0:1788361576.137613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361576.137721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361576.137772:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750400 00000100:00100000:3.0:1788361576.137780:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750400 00000100:00100000:3.0:1788361576.137859:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1788361576.137870:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429750400:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788361576.137900:0:66127:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2295 00000100:00080000:3.0:1788361576.137916:0:66127:0:(import.c:65:import_set_state_nolock()) ffff99d11e637800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788361576.138258:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750272 00000100:00100000:2.0:1788361576.138264:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750272 00000100:00100000:1.0:1788361576.139463:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1788361576.139480:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429750272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361576.139499:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361576.139526:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f600/0x1b69fa8920fe217d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2176 expref: 24 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.139558:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361576.139631:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3650:x1875230429750272:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361576.139639:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1788361576.139690:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429750272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361576.139776:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:3.0:1788361576.139814:0:66127:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d110607800 x1875230429750400/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:637/0 lens 224/224 e 0 to 0 dl 1788361587 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361576.139873:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875230429750400:12345-0@lo:39:umount.0 Request processed in 2006us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361576.139882:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000020:00000080:3.0:1788361576.139891:0:66127:0:(genops.c:906:class_export_put()) final put ffff99d11e630000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788361576.139981:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788361576.139992:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429750400:0@lo:39:umount.0 00000100:00080000:2.0:1788361576.140013:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361576.140017:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361576.140022:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361576.140195:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e630000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788361576.140253:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e637800 for lustre-MDT0000 00010000:00010000:2.0:1788361576.141171:0:86320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141186:0:86320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141193:0:86320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141200:0:86320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141224:0:86320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361576.141231:0:86320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141236:0:86320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141240:0:86320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141256:0:86320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141267:0:86320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361576.141274:0:86320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141280:0:86320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141286:0:86320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141292:0:86320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141294:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361576.141301:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141309:0:86320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361576.141313:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0e400 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:2.0:1788361576.141315:0:86320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361576.141317:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141331:0:86320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141338:0:86320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141338:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361576.141345:0:86320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361576.141347:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361576.141353:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361576.141356:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788361576.141367:0:86320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788361576.141371:0:86320:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788361576.141376:0:86320:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788361576.141388:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141395:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1788361576.141408:0:86320:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788361576.141413:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:1.0:1788361576.141417:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361576.141418:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788361576.141425:0:86320:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1788361576.141433:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0e400/0x1b69fa8920fe209d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe20a4 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141445:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361576.141448:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141453:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361576.141457:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141464:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361576.141470:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361576.141475:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361576.141477:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788361576.141479:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788361576.141492:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141499:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361576.141516:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141523:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aad800/0x1b69fa8920fe2199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe21a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141556:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361576.141559:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141564:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361576.141567:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141574:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361576.141580:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361576.141584:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361576.141586:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788361576.141589:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361576.141605:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141611:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361576.141617:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141624:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aad000/0x1b69fa8920fe2168 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe216f expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141634:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361576.141637:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141649:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361576.141652:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141659:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361576.141666:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361576.141672:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361576.141674:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788361576.141676:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788361576.141690:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141696:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361576.141702:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141708:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe208f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2096 expref: -99 pid: 85003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.141720:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361576.141722:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361576.141724:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361576.141744:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429750528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361576.141806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361576.141881:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361576.141894:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429750912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361576.141918:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361576.141945:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429750656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361576.141947:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361576.141953:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361576.141967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361576.141977:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429750784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361576.141998:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750528 00000100:00100000:1.0:1788361576.142006:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750528 00000100:00100000:0.0:1788361576.142006:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361576.142051:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750912 00000100:00100000:1.0:1788361576.142054:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750912 00000100:00100000:0.0:1788361576.142061:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750656 00000100:00100000:0.0:1788361576.142064:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750656 00000100:00100000:1.0:1788361576.142070:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429750784 00000100:00100000:1.0:1788361576.142073:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429750784 00000100:00100000:0.0:1788361576.142097:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1788361576.142106:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3651:x1875230429750528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361576.142119:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361576.142134:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1364d3400/0x1b69fa8920fe20a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe209d expref: 26 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.142147:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361576.142157:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1788361576.142163:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3651:x1875230429750912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361576.142172:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788361576.142178:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3651:x1875230429750528:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (372us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361576.142181:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715d000/0x1b69fa8920fe2096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe208f expref: 25 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361576.142186:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00010000:00010000:1.0:1788361576.142190:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361576.142202:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1788361576.142208:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118597100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429750656:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361576.142210:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3651:x1875230429750912:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361576.142216:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00010000:00010000:0.0:1788361576.142216:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361576.142227:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00010000:00010000:0.0:1788361576.142231:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f800/0x1b69fa8920fe21a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2199 expref: 22 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361576.142232:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3653:x1875230429750784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361576.142239:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361576.142240:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361576.142246:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe216f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2168 expref: 21 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361576.142253:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361576.142265:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118597100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3652:x1875230429750656:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361576.142272:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1788361576.142273:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3653:x1875230429750784:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361576.142284:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1788361576.142318:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429750784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361576.142318:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429750912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361576.142339:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429750528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361576.142353:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429750656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361576.142371:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788361576.144340:0:86320:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1788361576.146259:0:85004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00000020:00000080:2.0:1788361576.146375:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788361576.146387:0:86320:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d117878000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361576.146395:0:86320:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d10f774000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361576.146400:0:86320:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d002097800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361576.146405:0:86320:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d137f12000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361576.146414:0:86320:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d137f16800 ec302d84-8f96-49d3-8682-aefc474f8448 192.168.204.35@tcp 12 (0 0 3) 0 0 0 3: ffff99d107ac3000 103079215113 stale:0 00000020:00080000:2.0:1788361576.146420:0:86320:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99d002360000) has exports, disconnecting them 00000020:00080000:2.0:1788361576.146427:0:86320:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d117878000), last request at 1788361561 00000020:00000080:2.0:1788361576.146435:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe228e 00000100:00080000:2.0:1788361576.146448:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d11787b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361576.146481:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d117878000): rc 0 00000020:00000080:2.0:1788361576.146484:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d117878000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788361576.146554:0:86320:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d10f774000), last request at 1788361572 00000020:00000080:2.0:1788361576.146559:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2287 00000100:00080000:2.0:1788361576.146563:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d10f770800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788361576.146585:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788361576.146594:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d10f774000): rc 0 00000020:00000080:2.0:1788361576.146596:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d10f774000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1788361576.146606:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146621:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146630:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146637:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361576.146643:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361576.146643:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361576.146653:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d117878000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1788361576.146653:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146679:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004434e00) 00010000:00010000:0.0:1788361576.146684:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361576.146691:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146710:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83800/0x1b69fa8920fe255f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361576.146721:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11787b800 for lustre-MDT0000 00010000:00010000:0.0:1788361576.146732:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146741:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146747:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146753:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a82600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361576.146756:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146763:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146772:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004434e00) 00010000:00010000:0.0:1788361576.146774:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361576.146778:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361576.146779:0:86320:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d002097800), last request at 1788361572 00000020:00000080:2.0:1788361576.146788:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2280 00010000:00010000:0.0:1788361576.146790:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82600/0x1b69fa8920fe2597 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361576.146797:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d002096800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788361576.146813:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146844:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788361576.146893:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f774000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1788361576.146919:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788361576.146923:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d10f770800 for lustre-MDT0000 00010000:00010000:0.0:1788361576.146926:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361576.146929:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146936:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146946:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99d112cab000) 00010000:00010000:0.0:1788361576.146948:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361576.146951:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146958:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83000/0x1b69fa8920fe25e4 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146975:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146982:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146987:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.146993:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361576.146996:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361576.147018:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d002097800): rc 0 00000020:00000080:2.0:1788361576.147022:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d002097800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788361576.147037:0:86320:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d137f12000), last request at 1788361556 00000020:00000080:2.0:1788361576.147047:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20ea 00000100:00080000:2.0:1788361576.147059:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d11787a800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788361576.147079:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361576.147087:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002097800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361576.147120:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002096800 for lustre-MDT0000 00000020:00080000:2.0:1788361576.147272:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d137f12000): rc 0 00000020:00000080:2.0:1788361576.147275:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d137f12000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1788361576.147292:0:86320:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.35@tcp (ffff99d137f16800), last request at 1788361575 00000020:00000080:2.0:1788361576.147296:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20e3 00000020:00010000:2.0:1788361576.147304:0:86320:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d137f16800: total 1 00000100:00080000:2.0:1788361576.147307:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d006c8b800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788361576.147338:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d137f16800: total 1 00010000:00010000:3.0:1788361576.147341:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361576.147349:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f12000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361576.147385:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11787a800 for lustre-MDT0000 00010000:00010000:3.0:1788361576.147399:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d137f16800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1788361576.147433:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e200/0x1b69fa8920fe25b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d51 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.147454:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83200/0x1b69fa8920fe25eb lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 7 pid: 66901 timeout: 2715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.147466:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137159000/0x1b69fa8920fe25cf lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d58 expref: 6 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361576.147477:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d137f16800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1788361576.147490:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.147502:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d112cab400) 00010000:00010000:0.0:1788361576.147505:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361576.147509:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.147515:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a83c00/0x1b69fa8920fe25f9 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361576.147914:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d137f16800): rc 0 00000004:00000080:2.0:1788361576.147923:0:86320:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa0880d53ae0 00000100:00080000:2.0:1788361576.147948:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788361576.147953:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788361576.147989:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361576.150788:0:86320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788361576.150862:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d001c6a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361576.150985:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429751040:0@lo:39:umount.0 00000100:00100000:0.0:1788361576.151111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361576.151255:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751040 00000100:00100000:2.0:1788361576.151268:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751040 00000100:00080000:1.0:1788361576.151432:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361576.151440:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968746 gen 3 00000100:00100000:2.0:1788361576.151447:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1788361576.151461:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429751040:12345-0@lo:39:umount.0 00000004:00080000:1.0:1788361576.151465:0:86320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1788361576.151500:0:23939:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe211b 00000100:00080000:2.0:1788361576.151510:0:23939:0:(import.c:65:import_set_state_nolock()) ffff99d139ff4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361576.151535:0:23939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411436 00000100:00080000:1.0:1788361576.151762:0:86320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788361576.151778:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d12c4e7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788361576.151798:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361576.151801:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968747 gen 3 00000004:00080000:1.0:1788361576.151812:0:86320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361576.151862:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3649:x1875230429751040:12345-0@lo:39:umount.0 Request processed in 402us (750us total) trans 77309411437 rc 0/0 00000100:00100000:2.0:1788361576.151889:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00010000:00010000:2.0:1788361576.151920:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361576.151934:0:86320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788361576.151947:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d0055d7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361576.151955:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429751168:0@lo:9:umount.0 00000100:00100000:0.0:1788361576.151991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361576.152283:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d001c6a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788361576.152292:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429751040:0@lo:39:umount.0 00000100:00100000:0.0:1788361576.152307:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429751296:0@lo:9:umount.0 00000100:00100000:0.0:1788361576.152348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361576.152390:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751168 00000100:00100000:0.0:1788361576.152397:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751168 00000100:00100000:0.0:1788361576.152448:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751296 00000100:00100000:0.0:1788361576.152451:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751296 00000100:00100000:0.0:1788361576.152478:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4872 00000100:00100000:0.0:1788361576.152487:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429751168:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788361576.152513:0:8535:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe213e 00000100:00080000:0.0:1788361576.152530:0:8535:0:(import.c:65:import_set_state_nolock()) ffff99d003825000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361576.152598:0:8535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968746 00000100:00100000:0.0:1788361576.152748:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429751168:12345-0@lo:9:umount.0 Request processed in 262us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361576.152757:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4872 00000100:00100000:0.0:1788361576.152774:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4873 00000100:00100000:0.0:1788361576.152780:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429751296:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788361576.152794:0:8535:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2153 00000100:00080000:0.0:1788361576.152801:0:8535:0:(import.c:65:import_set_state_nolock()) ffff99d105495000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361576.152972:0:8535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968747 00010000:00010000:2.0:1788361576.152987:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361576.153078:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361576.153084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788361576.153100:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d002360000) has no exports 00000100:00080000:2.0:1788361576.153129:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d12c4e7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788361576.153140:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788361576.153143:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361576.153147:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429751168:0@lo:9:umount.0 00000100:00100000:0.0:1788361576.153267:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429751296:12345-0@lo:9:umount.0 Request processed in 480us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361576.153281:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4873 00000100:00080000:2.0:1788361576.153305:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d0055d7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788361576.153316:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788361576.153328:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361576.153332:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429751296:0@lo:9:umount.0 00010000:00010000:0.0:1788361576.153346:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788361576.153762:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d002360000) has no exports 00000020:00000080:3.0:1788361576.199586:0:6511:0:(genops.c:906:class_export_put()) final put ffff99d137f16800/ec302d84-8f96-49d3-8682-aefc474f8448 00010000:00010000:2.0:1788361576.199733:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361576.199739:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361576.199743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361576.199758:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f16800/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-MDT0000 00000020:00000080:0.0:1788361576.199961:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006c8b800 for lustre-MDT0000 00000020:00000080:1.0:1788361576.214265:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20ff 00000020:00000080:1.0:1788361576.214289:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d006aa9000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788361576.214313:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788361576.214353:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006aa9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788361576.214384:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361576.214401:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361576.214406:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d104013380) has no exports 00000020:00000080:0.0:1788361576.214772:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20f8 00000020:00000080:0.0:1788361576.214779:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d12c4e0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361576.214877:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361576.214887:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361576.214890:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d12c4e1000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788361576.214892:0:86320:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788361576.214898:0:86320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361576.215116:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788361576.215237:0:86320:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d1046e2420 - data ffff99d11743da20/ffff99d004338000 00000020:01000000:0.0:1788361576.215398:0:86320:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d0055fe7e0 - data ffff99d12cbcc510/ffff99d009ce3800 00000100:00080000:0.0:1788361576.257797:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788361576.257809:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361576.258338:0:86320:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d1365ca300 x1875230429751040/t77309411437(77309411437) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361586 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361576.258371:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788361576.259643:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788361576.259648:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968746 gen 4 00000004:00080000:0.0:1788361576.259660:0:86320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361576.259662:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788361576.263187:0:85020:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788361576.263199:0:85020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:3.0:1788361576.263235:0:85020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:3.0:1788361576.264277:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361576.264285:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968747 gen 4 00000004:00080000:3.0:1788361576.264342:0:86320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361576.264346:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788361576.264634:0:85022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788361576.264639:0:85022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1788361576.264648:0:85022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:3.0:1788361576.265704:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20b9 00000020:00000080:3.0:1788361576.265717:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d10608a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361576.266469:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20ce 00000020:00000080:3.0:1788361576.266475:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d0057f5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361576.266556:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10608a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788361576.266647:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788361576.266654:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361576.266667:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361576.266674:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99d003818000) has no exports 00000004:01000000:3.0:1788361576.266896:0:86320:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788361576.266905:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe214c 00000020:00000080:3.0:1788361576.266910:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d136ca0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361576.266965:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0057f5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788361576.267002:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788361576.267009:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361576.267046:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136ca0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361576.267079:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361576.267083:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d1053199c0) has no exports 00000020:00000080:3.0:1788361576.267090:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2145 00000020:00000080:3.0:1788361576.267094:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d10608e800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788361576.267545:0:86320:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788361576.267551:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361576.267556:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968747 gen 5 00000004:00080000:3.0:1788361576.267562:0:86320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361576.267565:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361576.267599:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10608e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361576.267688:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361576.267697:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361576.267703:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2130 00000020:00000080:3.0:1788361576.267707:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d140d59000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361576.267733:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d0055d7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361576.267740:0:79303:0:(genops.c:906:class_export_put()) final put ffff99d140d5e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361576.267742:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d5e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788361576.267748:0:79303:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361576.267979:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788361576.267992:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361576.267998:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361576.268001:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99d13a3acd40) has no exports 00000020:00000080:3.0:1788361576.268007:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2129 00000020:00000080:3.0:1788361576.268010:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d12c4e7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361576.268037:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d59000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1788361576.268485:0:86320:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788361576.268488:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361576.268491:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968746 gen 5 00000004:00080000:3.0:1788361576.268495:0:86320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361576.268497:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361576.268544:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361576.268627:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361576.268634:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788361576.268647:0:86320:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788361576.268653:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2114 00000020:00000080:3.0:1788361576.268658:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d10608f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361576.268675:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d12c4e7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361576.268680:0:79303:0:(genops.c:906:class_export_put()) final put ffff99d106089000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361576.268682:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d106089000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788361576.268686:0:79303:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361576.268778:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788361576.268782:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361576.268788:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361576.268791:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99d001c60000) has no exports 00000020:00000080:3.0:1788361576.268796:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe210d 00000020:00000080:3.0:1788361576.268799:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d141655000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361576.268879:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10608f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788361576.269787:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141655000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788361576.273906:0:86320:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788361576.273918:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788361576.273923:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788361576.273934:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361576.273999:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361576.274020:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361576.274053:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361576.274057:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361576.274064:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d140d58000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361576.274071:0:86320:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d58000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788361576.274082:0:86320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361576.274205:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20d5 00000020:00000080:0.0:1788361576.274214:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d0057f1800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788361576.274220:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788361576.274225:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361576.274231:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361576.274235:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99d13a3a8000) has no exports 00000020:00000080:0.0:1788361576.274256:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361576.274272:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361576.274279:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe20dc 00000020:00000080:0.0:1788361576.274284:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d140d58800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361576.274292:0:86320:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d006aa8800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788361576.274297:0:86320:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d006aa8800 3 00000020:01000004:0.0:1788361576.274314:0:86320:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d006aa8800 from lustre-MDT0000 00000020:00000080:0.0:1788361576.274349:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361576.274354:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788361576.274357:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d10608d800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788361576.274360:0:86320:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10608d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788361576.274367:0:86320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788361576.274401:0:86320:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788361576.274405:0:86320:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788361576.274409:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788361576.274412:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361576.274415:0:86320:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788361576.274426:0:86320:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d006c8c000 1f5c0251-1795-40ef-8392-cb147010b7b5 192.168.204.35@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361576.274434:0:86320:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d005034000 c8a6f36d-efb9-41cf-af98-5917323f2b0d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361576.274439:0:86320:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff99d001c619c0) has exports, disconnecting them 00000020:00080000:0.0:1788361576.274444:0:86320:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.35@tcp (ffff99d006c8c000), last request at 1788361559 00000020:00000080:0.0:1788361576.274470:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe225d 00000020:00010000:0.0:1788361576.274476:0:86320:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d006c8c000: total 2 00000100:00080000:0.0:1788361576.274480:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d006c8d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361576.274498:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d006c8c000): rc 0 00000020:00080000:0.0:1788361576.274502:0:86320:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d005034000), last request at 1788361556 00000020:00000080:0.0:1788361576.274549:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe207a 00000020:00010000:0.0:1788361576.274552:0:86320:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d005034000: total 2 00000100:00080000:0.0:1788361576.274555:0:86320:0:(import.c:65:import_set_state_nolock()) ffff99d005037000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361576.274565:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d005034000): rc 0 00000020:00080000:0.0:1788361576.274569:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99d001c619c0) has no exports 00000100:00100000:0.0:1788361576.274632:0:85011:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d136de8a00:85011] 2 exiting: rc = 0 00000020:00010000:0.0:1788361576.274753:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d006c8c000: total 2 00010000:00010000:0.0:1788361576.274778:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d006c8c000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788361576.274815:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aac200/0x1b69fa8920fe2279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d12 expref: 5 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.274866:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1364d2400/0x1b69fa8920fe226b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d04 expref: 4 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.274882:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe2264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710cfd expref: 3 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.274894:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1364d3e00/0x1b69fa8920fe2272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d0b expref: 2 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.274905:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d006c8c000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788361576.274926:0:8455:0:(genops.c:906:class_export_put()) final put ffff99d006c8c000/1f5c0251-1795-40ef-8392-cb147010b7b5 00000020:00010000:0.0:1788361576.274931:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d005034000: total 3 00010000:00010000:0.0:1788361576.274948:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d005034000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788361576.274964:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1364d2200/0x1b69fa8920fe21e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21df expref: 14 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.274975:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715da00/0x1b69fa8920fe2248 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2241 expref: 13 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.274989:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1364d3800/0x1b69fa8920fe21d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21d1 expref: 12 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275002:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe2256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe224f expref: 11 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275028:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe21f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21ed expref: 10 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275039:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21fb expref: 9 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275050:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c600/0x1b69fa8920fe2210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2209 expref: 8 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275061:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715de00/0x1b69fa8920fe221e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2217 expref: 7 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275071:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe21ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21a7 expref: 6 pid: 85011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275082:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe21bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21b5 expref: 5 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275095:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715d800/0x1b69fa8920fe223a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2233 expref: 4 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275107:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe21ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe21c3 expref: 3 pid: 85008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275117:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fa00/0x1b69fa8920fe222c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2225 expref: 2 pid: 85010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361576.275127:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d005034000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788361576.275139:0:8455:0:(genops.c:906:class_export_put()) final put ffff99d005034000/c8a6f36d-efb9-41cf-af98-5917323f2b0d 00010000:00010000:0.0:1788361576.275144:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361576.275152:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361576.275154:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361576.275161:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361576.275465:0:85008:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d002d5e000:85008] 0 exiting: rc = 1 00000100:00100000:1.0:1788361576.275544:0:85010:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d122c10400:85010] 1 exiting: rc = 0 00000100:00100000:0.0:1788361576.275635:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275645:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275652:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275658:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275665:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275671:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275679:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275686:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275692:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275698:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275703:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275710:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275716:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275723:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275729:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275736:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275743:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275749:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275755:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275761:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275768:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275774:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275780:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275787:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275793:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275799:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275805:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275812:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275817:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275842:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275849:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275855:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275872:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275878:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275885:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275891:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275897:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275903:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275909:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275915:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275921:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275927:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275933:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275940:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275946:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275952:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275957:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275963:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275970:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275976:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275983:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.275990:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276002:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276009:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276015:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276020:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276026:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276034:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276041:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276047:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276052:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276058:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276065:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361576.276071:0:86320:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788361576.276697:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d001c6a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788361576.276706:0:79303:0:(genops.c:906:class_export_put()) final put ffff99d106088800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361576.276709:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d106088800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788361576.276722:0:79303:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361576.276789:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0057f1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788361576.276794:0:79303:0:(genops.c:906:class_export_put()) final put ffff99d140d5f000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788361576.276796:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d5f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788361576.276799:0:79303:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361576.276854:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d58800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788361576.276861:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8c000/1f5c0251-1795-40ef-8392-cb147010b7b5 for MGS 00000020:00000080:0.0:1788361576.276902:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005034000/c8a6f36d-efb9-41cf-af98-5917323f2b0d for MGS 00000020:00000080:0.0:1788361576.276914:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006c8d000 for MGS 00000020:00000080:0.0:1788361576.276918:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d005037000 for MGS 00000020:01000000:0.0:1788361576.277012:0:86320:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d0055fe3c0 - data ffff99d0019b5bd0/ffff99d003b20800 00000020:01000000:0.0:1788361576.277158:0:86320:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d1055f15a0 - data ffff99d12cbbabd0/ffff99d137c8b400 00000020:00000080:0.0:1788361576.277792:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2073 00000020:00000080:0.0:1788361576.277800:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d141651800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361576.277979:0:86320:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d006aa8800 from MGS, refs=2 00000020:01000004:0.0:1788361576.277984:0:86320:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d006aa8800 2 00000020:01000004:0.0:1788361576.277988:0:86320:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d006aa8800 from MGS 00000020:00000080:0.0:1788361576.278020:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361576.278028:0:86320:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788361576.278031:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d141651000/MGS 00000020:00000080:0.0:1788361576.278033:0:86320:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141651000/MGS for MGS 00000020:01000000:0.0:1788361576.278043:0:86320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788361576.278118:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788361576.278123:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361576.278135:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361576.278143:0:86320:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d10f55a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361576.278149:0:86320:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99d10531cd40) has exports, disconnecting them 00000020:00080000:0.0:1788361576.278155:0:86320:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d10f55a000), last request at 1788361556 00000020:00000080:0.0:1788361576.278167:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe218b 00000020:00080000:0.0:1788361576.278185:0:86320:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d10f55a000): rc 0 00000020:00000080:0.0:1788361576.278191:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d10f55a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788361576.278258:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141651800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361576.278977:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f55a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788361576.279878:0:86320:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788361576.279884:0:86320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361576.279889:0:86320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788361576.279896:0:86320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361576.279920:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d005034800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788361576.280059:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361576.280070:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788361576.280074:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d136442800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788361576.280077:0:86320:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136442800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788361576.280093:0:86320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788361576.280174:0:86320:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d006aa8800 1 00000020:00000080:1.0:1788361576.280180:0:86320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2065 00000020:00000080:1.0:1788361576.280185:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d141654000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788361576.280194:0:86320:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788361576.280202:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141654000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361576.280210:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361576.280215:0:86320:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788361576.280218:0:86320:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d00381b380) has no exports 00000020:00000080:1.0:1788361576.332379:0:86320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361576.332397:0:86320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788361576.332404:0:86320:0:(genops.c:906:class_export_put()) final put ffff99d006aaa800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361576.332411:0:86320:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006aaa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788361576.332426:0:86320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788361576.332665:0:86320:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d006aa9800 00000020:02000400:1.0:1788361576.332735:0:86320:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788361576.534387:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361577.303880:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429751552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361577.303982:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.304007:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429751680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361577.304059:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429752064:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.304082:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361577.304126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.304139:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429752192:0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.304163:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429752576:0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.304190:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429751424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361577.304191:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361577.304212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.304236:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429752704:0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.304266:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361577.304282:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751552 00000100:00100000:2.0:1788361577.304293:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751552 00000100:00100000:3.0:1788361577.304312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361577.304328:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429751936:0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.304378:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:0.0:1788361577.304379:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361577.304392:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3652:x1875230429751552:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361577.304397:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752064 00000100:00100000:3.0:1788361577.304406:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752064 00000100:00100000:0.0:1788361577.304414:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429752448:0@lo:400:kworker.0 00000020:00080000:2.0:1788361577.304415:0:23938:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361577.304455:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361577.304502:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788361577.304503:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752192 00000100:00100000:0.0:1788361577.304515:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429751808:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.304516:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752192 00000100:00100000:2.0:1788361577.304517:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3652:x1875230429751552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (539us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361577.304533:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:3.0:1788361577.304555:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751936 00000100:00100000:3.0:1788361577.304561:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751936 00000400:00000100:0.0:1788361577.304567:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429751808 offset 0 length 224: 4 00000100:00100000:2.0:1788361577.304568:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752448 00000100:00100000:2.0:1788361577.304576:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752448 00000100:00100000:3.0:1788361577.304607:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1788361577.304618:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:3.0:1788361577.304628:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429752064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.304632:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429752320:0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.304700:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.304710:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429752064:12345-0@lo:400:kworker.0 Request processed in 89us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361577.304722:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429752832:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.304723:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1788361577.304757:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752320 00000100:00100000:3.0:1788361577.304764:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752320 00000100:00100000:2.0:1788361577.304775:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3651:x1875230429752448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.304781:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788361577.304792:0:23938:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788361577.304803:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752832 00000100:00100000:3.0:1788361577.304810:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752832 00000100:00100000:3.0:1788361577.304875:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1788361577.304887:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3651:x1875230429752448:12345-0@lo:400:kworker.0 Request processed in 259us (431us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361577.304888:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429752320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.304909:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:2.0:1788361577.304944:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751680 00000100:00100000:2.0:1788361577.304950:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751680 00000100:00100000:3.0:1788361577.304960:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429752320:12345-0@lo:400:kworker.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361577.304971:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1788361577.304998:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1788361577.305000:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751424 00000100:00100000:2.0:1788361577.305007:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751424 00000100:00100000:3.0:1788361577.305008:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1875230429752192:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788361577.305020:0:66128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361577.305051:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1788361577.305065:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429751680:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361577.305076:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1875230429752192:12345-0@lo:400:kworker.0 Request processed in 63us (880us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361577.305086:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1788361577.305104:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1788361577.305113:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875230429751936:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788361577.305116:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000020:00080000:3.0:1788361577.305124:0:66128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361577.305153:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1788361577.305168:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429751424:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361577.305177:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875230429751936:12345-0@lo:400:kworker.0 Request processed in 60us (798us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361577.305188:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429751680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (1107us total) trans 0 rc 0/0 00002000:00000024:0.0:1788361577.305191:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361577.305215:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1788361577.305222:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788361577.305252:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429751424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361577.305259:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788361577.305267:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1788361577.305271:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3651:x1875230429752832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361577.305283:0:80345:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788361577.305289:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752576 00000100:00100000:3.0:1788361577.305306:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752576 00000100:00100000:2.0:1788361577.305336:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3651:x1875230429752832:12345-0@lo:400:kworker.0 Request processed in 63us (555us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361577.305346:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1788361577.305375:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752704 00000100:00100000:3.0:1788361577.305382:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752704 00000100:00100000:1.0:1788361577.305387:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1788361577.305404:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429752576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.305428:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00080000:2.0:1788361577.305428:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361577.305445:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429752704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361577.305446:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361577.305452:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361577.305455:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429752576:12345-0@lo:400:kworker.0 Request processed in 57us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361577.305465:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1788361577.305495:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429752704:12345-0@lo:400:kworker.0 Request processed in 56us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361577.305501:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:2.0:1788361577.305557:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429752064:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.305569:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429751680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361577.305592:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429752576:0@lo:400:kworker.0 00000100:00080000:3.0:1788361577.305596:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361577.305603:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361577.305608:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:02020000:2.0:1788361577.305615:0:3652:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788361577.305618:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361577.305622:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361577.305629:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2601 00000100:00080000:2.0:1788361577.305630:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788361577.305638:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361577.305641:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00080000:2.0:1788361577.305647:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361577.305654:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2601 00000100:00100000:3.0:1788361577.305667:0:3653:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa5c00 x1875230429752960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361577.305746:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429752960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788361577.305782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.305882:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429752192:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.305896:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429752704:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.305941:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429752320:0@lo:400:kworker.0 00000100:00080000:3.0:1788361577.305954:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361577.305963:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361577.305967:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361577.305970:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361577.305974:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2601 00000100:00080000:3.0:1788361577.305979:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361577.305994:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c6d880 x1875230429753088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361577.306057:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429753088:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361577.306083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361577.306125:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429752960 00000100:00100000:1.0:1788361577.306130:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429752960 00000100:00100000:1.0:1788361577.306156:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753088 00000100:00100000:1.0:1788361577.306167:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753088 00000100:00100000:1.0:1788361577.306196:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00080000:2.0:1788361577.306199:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361577.306209:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429752960:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788361577.306228:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361577.306237:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1365cb800 x1875230429753216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361577.306289:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429752960:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 81us (502us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361577.306310:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1788361577.306333:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1788361577.306344:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429753088:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788361577.306363:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361577.306392:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429752832:0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.306423:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429753088:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 79us (336us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361577.306432:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429751424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361577.306434:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00080000:3.0:1788361577.306456:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361577.306460:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361577.306463:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361577.306466:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361577.306469:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2601 00000100:00080000:3.0:1788361577.306474:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361577.306493:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c6c000 x1875230429753344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361577.306505:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429751936:0@lo:400:kworker.0 00000100:00080000:3.0:1788361577.306518:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361577.306522:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99d106904000 already not connected (conn 30, was 29): CONNECTING 00000100:00100000:3.0:1788361577.306528:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429752448:0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.306541:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429753216:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788361577.306589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361577.306656:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753216 00000100:00100000:1.0:1788361577.306664:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753216 00000100:00100000:3.0:1788361577.306670:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429753344:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361577.306693:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1788361577.306699:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429753216:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788361577.306710:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361577.306718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361577.306753:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429753216:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 54us (167us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361577.306758:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00080000:3.0:1788361577.306762:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361577.306768:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361577.306773:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429753088:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361577.306774:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753344 00000100:00100000:1.0:1788361577.306780:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753344 00000100:00080000:3.0:1788361577.306786:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361577.306791:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361577.306795:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429752960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788361577.306803:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1788361577.306809:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429753344:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788361577.306816:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788361577.306848:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361577.306854:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361577.306857:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429753344:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 47us (140us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361577.306861:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429753216:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361577.306865:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:3.0:1788361577.306884:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361577.306889:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361577.306893:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429753344:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1788361577.558275:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361578.583030:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361579.607218:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788361580.424200:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406973824 offset 0 length 224: 4 00000100:00100000:3.0:1788361580.424261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361580.424294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361580.424324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361580.424364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361580.424774:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974080 00000100:00100000:1.0:1788361580.424798:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974080 00000100:00080000:3.0:1788361580.424940:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361580.424966:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973952 00000100:00100000:1.0:1788361580.424972:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973952 00000100:00100000:3.0:1788361580.425002:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 799 00000100:00100000:3.0:1788361580.425025:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406974080:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361580.425110:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406974080:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 95us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361580.425154:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974336 00000100:00100000:2.0:1788361580.425161:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974336 00000100:00100000:2.0:1788361580.425217:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974208 00000100:00100000:2.0:1788361580.425222:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974208 00000100:00100000:2.0:1788361580.425268:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1804 00000100:00100000:2.0:1788361580.425281:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406974336:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361580.425350:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406974336:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 73us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361580.425359:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1804 00000100:00100000:2.0:1788361580.425383:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1805 00000100:00100000:2.0:1788361580.425392:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406974208:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:0.0:1788361580.425421:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361580.425427:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361580.425443:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406974208:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361580.425451:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1805 00000100:00100000:3.0:1788361580.428717:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 799 00000100:00100000:3.0:1788361580.428794:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1080 00000100:00100000:3.0:1788361580.428805:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1875230406973952:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:3.0:1788361580.428816:0:66128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:3.0:1788361580.429281:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1875230406973952:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 474us (4952us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361580.429290:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1080 00000100:00100000:0.0:1788361580.431953:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361580.432056:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974464 00000100:00100000:1.0:1788361580.432068:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974464 00000100:00100000:1.0:1788361580.432178:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1081 00000100:00100000:1.0:1788361580.432189:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875230406974464:12345-192.168.204.35@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1788361580.432218:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361580.432318:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875230406974464:12345-192.168.204.35@tcp:38:ptlrpcd_01_01.0 Request processed in 129us (375us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361580.432326:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1081 00010000:00010000:0.0:1788361580.630731:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361581.654440:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361581.911745:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361581.911754:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d136ca5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361581.912047:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136ca5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788361581.912416:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d105495000 for lustre-OST0001 00000001:00100000:0.0:1788361581.912469:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361581.912473:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d003822000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361581.912545:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d003822000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788361581.912645:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d003825000 for lustre-OST0000 00000001:00100000:3.0:1788361581.914968:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788361581.914984:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411437 is committed 00000020:00000080:3.0:1788361581.914989:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d139ff7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361581.915059:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d139ff7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788361581.915268:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d139ff4800 for lustre-MDT0001 00000100:00100000:0.0:1788361582.422425:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788361582.422443:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788361582.422443:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429753472:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788361582.422450:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361582.422454:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788361582.422461:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429753600:0@lo:400:kworker.0 00000100:00080000:3.0:1788361582.422462:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2617 00000100:00080000:3.0:1788361582.422470:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361582.422479:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361582.422530:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002239500 x1875230429753728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361582.422597:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361582.422600:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361582.422602:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788361582.422850:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361582.422861:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429753984:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788361582.422904:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2617 00000100:00080000:3.0:1788361582.422907:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361582.422910:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361582.422925:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002239880 x1875230429754112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361582.423062:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361582.423065:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361582.423067:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361582.423074:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2617 00000100:00080000:3.0:1788361582.423077:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361582.423081:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361582.423098:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d134ae6d80 x1875230429754368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361582.423119:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361582.423122:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361582.423124:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361582.423127:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2617 00000100:00080000:3.0:1788361582.423130:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361582.423133:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361582.423142:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d134ae7800 x1875230429754752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361582.423165:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429753856:0@lo:400:kworker.0 00000400:00000100:2.0:1788361582.423542:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429753600 offset 0 length 224: 4 00000100:00100000:2.0:1788361582.423585:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429754496:0@lo:400:kworker.0 00000100:00100000:2.0:1788361582.423618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361582.423778:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361582.423808:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361582.423818:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429754240:0@lo:400:kworker.0 00000100:00100000:0.0:1788361582.424566:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753984 00000100:00100000:0.0:1788361582.424574:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753984 00000100:00100000:0.0:1788361582.424629:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753472 00000100:00100000:0.0:1788361582.424633:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753472 00000100:00100000:0.0:1788361582.424654:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1788361582.424663:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429753984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788361582.424693:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361582.425043:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1788361582.425054:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429753472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361582.425084:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361582.425114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361582.425243:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429753472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 190us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361582.425252:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1788361582.425269:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429753984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 605us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361582.425278:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1788361582.425285:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754496 00000100:00100000:2.0:1788361582.425290:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754496 00000100:00100000:0.0:1788361582.425309:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753856 00000100:00100000:0.0:1788361582.425314:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753856 00000100:00080000:1.0:1788361582.425315:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361582.425322:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361582.425326:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361582.425330:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:0.0:1788361582.425360:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1788361582.425369:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429753856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361582.425384:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429753472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361582.425408:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429753856:12345-0@lo:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361582.425416:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1788361582.425433:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429753728:0@lo:38:kworker.0 00000100:00100000:2.0:1788361582.425475:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429754496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.425534:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429753856:0@lo:400:kworker.0 00000100:00100000:2.0:1788361582.425540:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429754496:12345-0@lo:400:kworker.0 Request processed in 201us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.425546:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429754624:0@lo:400:kworker.0 00000100:00100000:2.0:1788361582.425552:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1788361582.425590:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429754496:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.425625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.425666:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754624 00000100:00100000:3.0:1788361582.425670:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754624 00000100:00100000:3.0:1788361582.425707:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:3.0:1788361582.425713:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429754624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.425746:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429754624:12345-0@lo:400:kworker.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.425752:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:3.0:1788361582.425774:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429754624:0@lo:400:kworker.0 00000100:00100000:1.0:1788361582.425855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361582.425876:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429754112:0@lo:38:kworker.0 00000100:00100000:1.0:1788361582.425900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361582.425915:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429754368:0@lo:38:kworker.0 00000100:00100000:3.0:1788361582.426011:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429753728 00000100:00100000:0.0:1788361582.426024:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.426065:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429753728 00000100:00100000:0.0:1788361582.426066:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d118597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429753984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361582.426090:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754112 00000100:00100000:3.0:1788361582.426094:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754112 00000100:00100000:0.0:1788361582.426104:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754240 00000100:00100000:0.0:1788361582.426111:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754240 00000100:00100000:3.0:1788361582.426115:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1788361582.426121:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429753728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361582.426137:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361582.426151:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:0.0:1788361582.426160:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429754240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.426172:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429753728:12345-0@lo:38:kworker.0 Request processed in 50us (315us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361582.426179:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1788361582.426192:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1788361582.426195:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429754112:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361582.426216:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361582.426244:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429754112:12345-0@lo:38:kworker.0 Request processed in 46us (342us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361582.426251:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00080000:2.0:1788361582.426281:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361582.426315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361582.426857:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429754240:12345-0@lo:400:kworker.0 Request processed in 698us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361582.426865:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1788361582.427324:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429754752:0@lo:38:kworker.0 00000100:00100000:2.0:1788361582.427354:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754368 00000100:00100000:1.0:1788361582.427365:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361582.427370:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754368 00000100:00080000:1.0:1788361582.427407:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361582.427425:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361582.427430:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429753728:0@lo:38:kworker.0 00000100:00100000:2.0:1788361582.427437:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:2.0:1788361582.427449:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429754368:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1788361582.427461:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361582.427469:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361582.427472:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429754112:0@lo:38:kworker.0 00010000:00020000:2.0:1788361582.427480:0:8448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361582.427575:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429754368:12345-0@lo:38:kworker.0 Request processed in 121us (1253us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361582.427576:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429754240:0@lo:400:kworker.0 00000100:00080000:1.0:1788361582.427593:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361582.427607:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361582.427608:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1788361582.427620:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429754368:0@lo:38:kworker.0 00000100:00100000:0.0:1788361582.427729:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754752 00000100:00100000:0.0:1788361582.427736:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754752 00000100:00100000:0.0:1788361582.427773:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1788361582.427778:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429754752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788361582.427789:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361582.427855:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429754752:12345-0@lo:38:kworker.0 Request processed in 75us (492us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361582.427861:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:1.0:1788361582.427999:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361582.428005:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361582.428009:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429754752:0@lo:38:kworker.0 00010000:00010000:0.0:1788361582.678121:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361583.702067:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361584.726725:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788361585.544969:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406974592 offset 0 length 224: 4 00000100:00100000:0.0:1788361585.545008:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361585.545043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361585.545195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361585.545280:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974976 00000100:00100000:1.0:1788361585.545298:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974976 00000100:00100000:2.0:1788361585.545357:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974848 00000100:00100000:3.0:1788361585.545373:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406975104 00000100:00100000:3.0:1788361585.545380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406975104 00000100:00100000:1.0:1788361585.545429:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1808 00000100:00100000:2.0:1788361585.545434:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974848 00000100:00100000:1.0:1788361585.545447:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406974976:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:0.0:1788361585.545463:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361585.545470:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361585.545473:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361585.545500:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 802 00000100:00100000:2.0:1788361585.545514:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406974848:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361585.545582:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406974976:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 138us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361585.545602:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406974848:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 89us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361585.545857:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 802 00000100:00100000:3.0:1788361585.546199:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1809 00000100:00100000:3.0:1788361585.546217:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d109064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406975104:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361585.546267:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d109064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406975104:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361585.546274:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1809 00000100:00100000:1.0:1788361585.546387:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1808 00000100:00100000:0.0:1788361585.549326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361585.549456:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406974720 00000100:00100000:2.0:1788361585.549469:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406974720 00000100:00100000:2.0:1788361585.549519:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1085 00000100:00100000:2.0:1788361585.549528:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230406974720:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:2.0:1788361585.549553:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361585.549643:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230406974720:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 113us (328us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361585.549652:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1085 00010000:00010000:2.0:1788361585.750101:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361586.774674:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361587.543041:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429754880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361587.543140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.543191:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361587.543199:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361587.543230:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.543316:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429754880 00000100:00100000:1.0:1788361587.543342:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429754880 00000100:00100000:2.0:1788361587.543365:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755008 00000100:00100000:2.0:1788361587.543372:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755008 00000100:00100000:1.0:1788361587.543411:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:1.0:1788361587.543423:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429754880:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361587.543429:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1788361587.543444:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429755008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361587.543462:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788361587.543473:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788361587.543598:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361587.543603:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361587.543607:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361587.543613:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2622 00000100:00080000:3.0:1788361587.543617:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361587.543623:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361587.543647:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d134ae7800 x1875230429755264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361587.543672:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361587.543675:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361587.543676:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361587.543680:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2622 00000100:00080000:3.0:1788361587.543682:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361587.543685:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361587.543697:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d110606d80 x1875230429755520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361587.543714:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361587.543718:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361587.543719:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361587.543723:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2622 00000100:00080000:3.0:1788361587.543732:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361587.543736:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361587.543749:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002239500 x1875230429755776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361587.543758:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361587.543762:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361587.543764:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361587.543767:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2622 00000100:00080000:3.0:1788361587.543769:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361587.543772:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361587.543783:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002238e00 x1875230429755904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361587.543805:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429755392:0@lo:400:kworker.0 00000100:00100000:1.0:1788361587.544050:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429754880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 627us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361587.544059:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1788361587.544227:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429755008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 788us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361587.544236:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1788361587.544269:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429755136:0@lo:400:kworker.0 00000400:00000100:2.0:1788361587.544298:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429755136 offset 0 length 224: 4 00000100:00100000:1.0:1788361587.544403:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429755264:0@lo:38:kworker.0 00000100:00100000:1.0:1788361587.544444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.544472:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429755520:0@lo:38:kworker.0 00000100:00100000:1.0:1788361587.544503:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.544526:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429755776:0@lo:38:kworker.0 00000100:00100000:1.0:1788361587.544558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.544581:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429755904:0@lo:38:kworker.0 00000100:00100000:1.0:1788361587.544612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.544650:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755776 00000100:00100000:1.0:1788361587.544656:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755776 00000100:00100000:1.0:1788361587.544685:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:1.0:1788361587.544691:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429755776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361587.544711:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361587.544756:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429755776:12345-0@lo:38:kworker.0 Request processed in 64us (198us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361587.544764:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:1.0:1788361587.544793:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361587.544803:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429755648:0@lo:400:kworker.0 00000100:00100000:1.0:1788361587.544860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361587.544910:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755264 00000100:00100000:1.0:1788361587.544915:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755264 00000100:00100000:1.0:1788361587.545055:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755520 00000100:00100000:1.0:1788361587.545061:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755520 00000100:00100000:1.0:1788361587.545089:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755904 00000100:00100000:1.0:1788361587.545092:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755904 00000100:00100000:1.0:1788361587.545126:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755648 00000100:00100000:1.0:1788361587.545129:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755648 00000100:00100000:1.0:1788361587.545177:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1788361587.545188:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429755648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361587.545249:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429755648:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361587.545257:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1788361587.545282:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788361587.545291:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429755264:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361587.545306:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361587.545349:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429755264:12345-0@lo:38:kworker.0 Request processed in 58us (903us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361587.545356:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788361587.545377:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1788361587.545382:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429755520:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361587.545391:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361587.545436:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429755520:12345-0@lo:38:kworker.0 Request processed in 50us (931us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361587.545444:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1788361587.545466:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788361587.545480:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429755904:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361587.545492:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361587.545534:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429755904:12345-0@lo:38:kworker.0 Request processed in 53us (922us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361587.545541:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788361587.545867:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429755648:0@lo:400:kworker.0 00000100:00080000:0.0:1788361587.545871:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361587.545880:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361587.545884:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361587.545925:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361587.545932:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361587.545935:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429755264:0@lo:38:kworker.0 00000100:00080000:1.0:1788361587.545959:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361587.545964:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361587.545967:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429755520:0@lo:38:kworker.0 00000100:00080000:1.0:1788361587.545990:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361587.545994:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361587.545997:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429755776:0@lo:38:kworker.0 00000100:00080000:1.0:1788361587.546023:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361587.546029:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361587.546037:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429755904:0@lo:38:kworker.0 00000100:00100000:1.0:1788361587.546153:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361587.546186:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429754880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361587.549379:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361587.549663:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429755392 00000100:00100000:2.0:1788361587.549679:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429755392 00000100:00100000:2.0:1788361587.549887:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1788361587.549902:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361587.550066:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429755392:12345-0@lo:400:kworker.0 Request processed in 167us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361587.550089:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1788361587.550116:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429755392:0@lo:400:kworker.0 00000100:00080000:1.0:1788361587.550480:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788361587.799294:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361588.822106:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361589.847191:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361590.665263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361590.665401:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406975360 00000100:00100000:2.0:1788361590.665412:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406975360 00000100:00100000:2.0:1788361590.665473:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1089 00000100:00100000:2.0:1788361590.665484:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230406975360:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:2.0:1788361590.665508:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361590.665574:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230406975360:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 92us (321us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361590.665582:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1089 00000100:00100000:0.0:1788361590.665777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361590.665892:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406975488 00000100:00100000:1.0:1788361590.665898:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406975488 00000100:00100000:1.0:1788361590.665958:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 805 00000100:00100000:1.0:1788361590.665965:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406975488:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361590.666005:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406975488:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 41us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361590.666012:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 805 00000100:00080000:2.0:1788361590.666667:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:3.0:1788361590.668057:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406975232 offset 0 length 224: 4 00000100:00100000:3.0:1788361590.668209:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361590.668247:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361590.668670:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406975616 00000100:00100000:0.0:1788361590.668678:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406975616 00000100:00100000:0.0:1788361590.668737:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406975744 00000100:00100000:0.0:1788361590.668740:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406975744 00000100:00100000:2.0:1788361590.668754:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1810 00000100:00080000:3.0:1788361590.668809:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361590.668814:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361590.668967:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406975616:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361590.669062:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406975616:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 100us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361590.669073:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1810 00000100:00100000:0.0:1788361590.669137:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1811 00000100:00100000:0.0:1788361590.669151:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406975744:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361590.670816:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406975744:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1663us (2561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361590.670848:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1811 00010000:00010000:0.0:1788361590.870296:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361591.894865:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361592.662119:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429756032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361592.662130:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429756160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361592.662193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.662229:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756160 00000100:00100000:1.0:1788361592.662236:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.662237:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756160 00000100:00080000:2.0:1788361592.662279:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361592.662285:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756032 00000100:00100000:1.0:1788361592.662291:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756032 00000100:00100000:3.0:1788361592.662309:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1788361592.662321:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429756160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788361592.662350:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361592.662378:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1788361592.662388:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429756032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788361592.662405:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361592.662410:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429756160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.662419:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:2.0:1788361592.662449:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429756032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361592.662452:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361592.662469:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1788361592.662498:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429756032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361592.662499:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429756160:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788361592.662972:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361592.662977:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361592.662981:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361592.662986:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2627 00000100:00080000:2.0:1788361592.662991:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361592.663007:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361592.663009:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361592.663022:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137404e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.663032:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c7f100 x1875230429756416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788361592.663049:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429756288 offset 0 length 224: 4 00000100:00080000:2.0:1788361592.663067:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361592.663072:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361592.663074:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361592.663078:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2627 00000100:00080000:2.0:1788361592.663082:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361592.663087:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361592.663094:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429756416:0@lo:38:kworker.0 00000100:00100000:2.0:1788361592.663103:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1170ded80 x1875230429756672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361592.663117:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429756544:0@lo:400:kworker.0 00000100:00080000:2.0:1788361592.663125:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788361592.663132:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361592.663133:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361592.663138:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361592.663143:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2627 00000100:00080000:2.0:1788361592.663146:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361592.663151:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361592.663161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.663166:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137684e00 x1875230429756928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361592.663169:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429756672:0@lo:38:kworker.0 00000100:00080000:2.0:1788361592.663188:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361592.663191:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361592.663194:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361592.663198:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2627 00000100:00100000:1.0:1788361592.663203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361592.663205:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361592.663211:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361592.663213:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361592.663223:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.663229:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10ec44000 x1875230429757056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361592.663242:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429756928:0@lo:38:kworker.0 00000100:00100000:3.0:1788361592.663255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.663280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.663313:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429757056:0@lo:38:kworker.0 00000100:00100000:2.0:1788361592.663317:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756416 00000100:00100000:2.0:1788361592.663322:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756416 00000100:00100000:3.0:1788361592.663325:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756928 00000100:00100000:3.0:1788361592.663332:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756928 00000100:00100000:2.0:1788361592.663350:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756544 00000100:00100000:1.0:1788361592.663355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.663356:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756544 00000100:00100000:3.0:1788361592.663364:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:3.0:1788361592.663371:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429756928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361592.663394:0:8448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361592.663397:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756672 00000100:00100000:1.0:1788361592.663401:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429756800 00000100:00100000:2.0:1788361592.663402:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756672 00000100:00100000:1.0:1788361592.663408:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429756800 00000100:00100000:2.0:1788361592.663418:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757056 00000100:00100000:2.0:1788361592.663422:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757056 00000100:00100000:2.0:1788361592.663443:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1788361592.663444:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429756928:12345-0@lo:38:kworker.0 Request processed in 69us (161us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361592.663454:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429756544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.663455:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:2.0:1788361592.663508:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429756544:12345-0@lo:400:kworker.0 Request processed in 57us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.663515:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1788361592.663525:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429756800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.663532:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1788361592.663552:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1788361592.663569:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1788361592.663570:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429756416:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361592.663573:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429756800:12345-0@lo:400:kworker.0 Request processed in 43us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.663579:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429756672:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361592.663589:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361592.663590:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00010000:00020000:2.0:1788361592.663594:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361592.663615:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1788361592.663622:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429757056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361592.663633:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361592.663639:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429756416:12345-0@lo:38:kworker.0 Request processed in 71us (510us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361592.663648:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1788361592.663653:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429756672:12345-0@lo:38:kworker.0 Request processed in 74us (450us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361592.663669:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1788361592.663678:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429757056:12345-0@lo:38:kworker.0 Request processed in 54us (335us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361592.663686:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:2.0:1788361592.663693:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361592.663719:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.663729:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429756544:0@lo:400:kworker.0 00000100:00080000:1.0:1788361592.663774:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361592.663780:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361592.663784:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429757056:0@lo:38:kworker.0 00000100:00080000:1.0:1788361592.663793:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361592.663797:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361592.663800:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429756928:0@lo:38:kworker.0 00000100:00080000:1.0:1788361592.663809:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361592.663812:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361592.663815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429756672:0@lo:38:kworker.0 00000100:00080000:1.0:1788361592.663850:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361592.663854:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361592.663856:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429756416:0@lo:38:kworker.0 00000020:01000004:0.0:1788361592.690286:0:86938:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361592.690294:0:86938:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788361592.690297:0:86938:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788361592.690465:0:86938:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d136443800 00000020:01000004:0.0:1788361592.690489:0:86938:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788361592.690507:0:86938:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788361592.690521:0:86938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d10531b380) 00000020:00000080:0.0:1788361592.690539:0:86938:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788361592.759375:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788361592.761094:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.762451:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.763414:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.763757:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.764426:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.764930:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.765393:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.765759:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.766166:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.766398:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.766675:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.766881:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.767503:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.767754:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.768126:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.768387:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.768849:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.769079:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.769341:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.769536:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.769881:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.770089:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.770311:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.770503:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.770689:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.770971:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.771286:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.771711:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.772044:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.772250:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.772411:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.772563:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788361592.772744:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788361592.773504:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.776934:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788361592.777611:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788361592.778040:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788361592.778258:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788361592.778472:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.778703:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788361592.778948:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.779765:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.780442:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.780889:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.781062:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788361592.781359:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.783495:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.784090:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.784773:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.785551:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.785959:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788361592.786169:0:86938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788361592.786596:0:86938:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788361592.786933:0:86938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788361592.786942:0:86938:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361592.786953:0:86938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2607 00000020:01000004:2.0:1788361592.786959:0:86938:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788361592.786979:0:86938:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788361592.786984:0:86938:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d136443800 from MGS 00000020:01000004:2.0:1788361592.786986:0:86938:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788361592.787005:0:86938:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d006a04d40) 00000020:00000080:2.0:1788361592.787018:0:86938:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788361592.787085:0:86938:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d136443800 from MGS, refs=2 00080000:01000000:2.0:1788361592.787090:0:86938:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361592.787095:0:86938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2615 00010000:00010000:2.0:1788361592.787180:0:86938:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788361592.791624:0:86938:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788361592.792276:0:86942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788361592.792354:0:86938:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788361592.792387:0:86938:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361592.793028:0:86938:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788361592.793347:0:86938:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361592.793550:0:86938:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788361592.793557:0:86938:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788361592.794146:0:86938:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788361592.794153:0:86938:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788361592.796041:0:86938:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788361592.796052:0:86938:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788361592.797133:0:86938:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788361592.797151:0:86938:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788361592.797152:0:86938:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788361592.797155:0:86938:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1788361592.797160:0:86938:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788361592.797165:0:86938:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788361592.797168:0:86938:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788361592.797170:0:86938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788361592.797179:0:86938:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d110607b80 x1875230429751808/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361592.797234:0:86938:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d120e8b480 x1875230429753600/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361592.797252:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429751808:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.797255:0:86938:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d134ae4a80 x1875230429755136/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361603 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361592.797265:0:86938:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d137404e00 x1875230429756288/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788361592.797272:0:86938:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788361592.797275:0:86938:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788361592.797276:0:86938:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788361592.797300:0:86938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1788361592.797338:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137404e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429756288:0@lo:400:kworker.0 00000100:00100000:0.0:1788361592.797361:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361592.797375:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429753600:0@lo:400:kworker.0 10000000:01000000:3.0:1788361592.797448:0:86938:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788361592.797460:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797467:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797471:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788361592.797486:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797494:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0ea00/0x1b69fa8920fe2241 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2248 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797508:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797512:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797525:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797529:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797532:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1364d2e00/0x1b69fa8920fe21a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe21ae expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797540:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797544:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797547:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797549:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797551:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1364d3600/0x1b69fa8920fe21c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe21ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797557:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797560:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797563:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797566:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797568:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d13715d200/0x1b69fa8920fe21ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe21f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797574:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797586:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797589:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797592:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797595:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0e000/0x1b69fa8920fe21fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2202 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797600:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797604:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797606:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797608:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797610:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0ec00/0x1b69fa8920fe2217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe221e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797615:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797618:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797621:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797623:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797625:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d13715cc00/0x1b69fa8920fe2225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe222c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797636:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797640:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797642:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797644:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797646:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1364d2000/0x1b69fa8920fe224f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2256 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797652:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797656:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797659:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797661:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797663:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1364d3000/0x1b69fa8920fe21b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe21bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797670:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797674:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797677:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361592.797683:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797686:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1364d2800/0x1b69fa8920fe21d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe21d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797695:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797698:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797701:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361592.797703:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797706:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d13715d600/0x1b69fa8920fe21df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe21e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797713:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797717:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797720:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361592.797723:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797726:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0f000/0x1b69fa8920fe2209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2210 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.797734:0:86938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361592.797737:0:86938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.797746:0:86938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361592.797750:0:86938:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361592.797754:0:86938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe223a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361592.797770:0:86938:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99d1054f2000 already not connected (conn 48, was 0): DISCONN 00000100:00080000:3.0:1788361592.797773:0:86938:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361592.797777:0:86938:0:(import.c:510:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 2596 00000100:00080000:3.0:1788361592.797783:0:86938:0:(import.c:624:import_select_connection()) MGC192.168.204.135@tcp: import ffff99d1054f2000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361592.797805:0:86938:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117945180 x1875230429757184/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361592.797844:0:86938:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788361592.797870:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429757184:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788361592.797931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.798012:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757184 00000100:00100000:1.0:1788361592.798019:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757184 00000100:00100000:1.0:1788361592.798085:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361592.798094:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875230429757184:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788361592.798116:0:86943:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo t0 exp 0000000000000000 cur 2632 last 0 00000020:00000080:1.0:1788361592.798148:0:86943:0:(genops.c:1406:class_connect()) connect: client c8a6f36d-efb9-41cf-af98-5917323f2b0d, cookie 0x1b69fa8920fe261c 00000100:00080000:1.0:1788361592.798264:0:86943:0:(import.c:65:import_set_state_nolock()) ffff99d13fd12800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361592.798314:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:3649:x1875230429757184:12345-0@lo:250:mount.lustre.0 Request processed in 220us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.798320:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361592.798338:0:3649:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 25 00000100:00080000:2.0:1788361592.798345:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361592.798350:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361592.798352:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361592.798354:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361592.798355:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361592.798371:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361592.798380:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429757184:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788361592.798400:0:86938:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788361592.798407:0:86938:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:3.0:1788361592.798412:0:48377:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.135@tcp 10000000:01000000:3.0:1788361592.798428:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788361592.798431:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361592.798433:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361592.798434:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361592.798435:0:86938:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788361592.798436:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361592.798440:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361592.798442:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 10000000:01000000:1.0:1788361592.798442:0:86938:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:3.0:1788361592.798445:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361592.798449:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361592.798450:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788361592.798484:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788361592.798491:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788361592.798493:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361592.798495:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361592.798496:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361592.798497:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361592.798498:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361592.798499:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361592.798500:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361592.798507:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361592.798508:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788361592.798523:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788361592.798528:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788361592.798530:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361592.798531:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788361592.798533:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361592.798534:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361592.798535:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000040:01000000:1.0:1788361592.798536:0:86938:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361592.798537:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361592.798540:0:48377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361592.798543:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361592.798544:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:1.0:1788361592.798562:0:86938:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000000:3.0:1788361592.798564:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000020:01000004:1.0:1788361592.798567:0:86938:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361592.798570:0:86938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361592.798571:0:86938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361592.798573:0:86938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361592.798574:0:86938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361592.798576:0:86938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361592.798577:0:86938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361592.798579:0:86938:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361592.798580:0:86938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361592.798581:0:86938:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361592.798584:0:86938:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000100:00100000:3.0:1788361592.798586:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:01000004:1.0:1788361592.798587:0:86938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361592.798591:0:86938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361592.798592:0:86938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361592.798593:0:86938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361592.798595:0:86938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361592.798596:0:86938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1788361592.798596:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429757312:0@lo:253:kworker.0 00000020:01000004:1.0:1788361592.798597:0:86938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361592.798599:0:86938:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:3.0:1788361592.798601:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429757568:0@lo:253:kworker.0 00000020:01000004:1.0:1788361592.798601:0:86938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361592.798603:0:86938:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361592.798618:0:86938:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788361592.798629:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429757696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361592.798648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.798661:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.798673:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429757440:0@lo:253:kworker.0 00000100:00100000:3.0:1788361592.798699:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757312 00000100:00100000:3.0:1788361592.798703:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757312 00000100:00100000:2.0:1788361592.798705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.798724:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757568 00000100:00100000:3.0:1788361592.798728:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757568 00000100:00100000:0.0:1788361592.798738:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757440 00000100:00100000:0.0:1788361592.798744:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757440 00000100:00100000:3.0:1788361592.798746:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361592.798756:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3652:x1875230429757312:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1788361592.798769:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 20000000:01000000:3.0:1788361592.798778:0:86946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1788361592.798778:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3651:x1875230429757568:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788361592.798819:0:86943:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:3.0:1788361592.799082:0:86947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788361592.799159:0:86946:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 107 00000100:00100000:1.0:1788361592.799403:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.799420:0:86945:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1788361592.799426:0:86945:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788361592.799434:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.799582:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757696 00000100:00100000:3.0:1788361592.799587:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757696 00000100:00100000:1.0:1788361592.799633:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361592.799640:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3653:x1875230429757440:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788361592.799657:0:86948:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788361592.801896:0:86949:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788361592.801903:0:86949:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788361592.801905:0:86949:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788361592.801908:0:86949:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788361592.802101:0:86949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788361592.802281:0:86946:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361592.802336:0:86943:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361592.804807:0:86943:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361592.804931:0:86943:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788361592.804936:0:86946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788361592.805043:0:86947:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788361592.805048:0:86947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788361592.805069:0:86947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805081:0:86947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361592.805098:0:86947:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050945s 00010000:00010000:3.0:1788361592.805102:0:86947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805107:0:86947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805111:0:86947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805115:0:86947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805119:0:86947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0fe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361592.805122:0:86947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805127:0:86947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805136:0:86947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805140:0:86947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.805144:0:86947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe2623 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361592.805270:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429757568:12345-0@lo:253:kworker.0 Request processed in 6490us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.805280:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361592.805319:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361592.805327:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:86938:x1875230429757696:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361592.805361:0:86943:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361592.805364:0:86943:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361592.805366:0:86943:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788361592.805372:0:86943:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1788361592.805449:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361592.805458:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788361592.805459:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361592.805460:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361592.805461:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361592.805463:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361592.805464:0:3651:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361592.805466:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361592.805467:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361592.805471:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429757568:0@lo:253:kworker.0 00000100:00100000:0.0:1788361592.810972:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:86938:x1875230429757696:12345-0@lo:253:mount.lustre.0 Request processed in 5635us (11558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.810988:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361592.811042:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429757696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361592.811060:0:86938:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788361592.811063:0:86938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361592.811065:0:86938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361592.811066:0:86938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361592.811067:0:86938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361592.811068:0:86938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361592.811069:0:86938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361592.811071:0:86938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361592.811072:0:86938:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361592.811073:0:86938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361592.811075:0:86938:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788361592.811096:0:86938:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d136443800 from lustre-MDT0000 10000000:01000000:1.0:1788361592.811127:0:86938:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788361592.811130:0:86938:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788361592.811139:0:86938:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d136443800 10000000:01000000:1.0:1788361592.811143:0:86938:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788361592.811147:0:86938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99d136443800 10000000:01000000:1.0:1788361592.811150:0:86938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788361592.811153:0:86938:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d136443800 from 1 10000000:01000000:1.0:1788361592.811156:0:86938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788361592.811188:0:86938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.811197:0:86938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.811206:0:86938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361592.811243:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429757824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361592.811278:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.811319:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.811412:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757824 00000100:00100000:3.0:1788361592.811418:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757824 00000100:00100000:3.0:1788361592.811458:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361592.811467:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:86938:x1875230429757824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361592.811478:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361592.811491:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0f000/0x1b69fa8920fe2631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe262a expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811512:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0f000/0x1b69fa8920fe2631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe262a expref: 8 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361592.811514:0:86946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00010000:00010000:3.0:1788361592.811526:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0f000/0x1b69fa8920fe2631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe262a expref: 8 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361592.811527:0:86946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788361592.811542:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0f000, rc 0) 00000100:00100000:3.0:1788361592.811579:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:86938:x1875230429757824:12345-0@lo:101:mount.lustre.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.811586:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:3.0:1788361592.811609:0:86947:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788361592.811613:0:86947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788361592.811623:0:86947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811642:0:86947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361592.811651:0:86947:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050945s 00010000:00010000:3.0:1788361592.811655:0:86947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811662:0:86947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811670:0:86947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811676:0:86947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811681:0:86947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0ec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361592.811684:0:86947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811691:0:86947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811700:0:86947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811709:0:86947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.811715:0:86947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2638 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361592.811772:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3652:x1875230429757312:12345-0@lo:253:kworker.0 Request processed in 13017us (13122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.811790:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1788361592.811808:0:3652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788361592.811811:0:3652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361592.811819:0:3652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361592.811840:0:3652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361592.811842:0:3652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361592.811843:0:3652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361592.811844:0:3652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361592.811846:0:3652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361592.811847:0:3652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788361592.811851:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429757312:0@lo:253:kworker.0 00000100:00100000:1.0:1788361592.812079:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429757824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361592.812091:0:86938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.812098:0:86938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361592.812108:0:86938:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788361592.812118:0:86938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.812122:0:86938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361592.812126:0:86938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788361592.812129:0:86938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361592.812133:0:86938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d136443800 10000000:01000000:1.0:1788361592.812135:0:86938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788361592.812139:0:86938:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788361592.812142:0:86938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361592.812158:0:86938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.812166:0:86938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.812180:0:86938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361592.812193:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429757952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361592.812226:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.812252:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5180 going to sleep for 11 seconds 20000000:01000000:1.0:1788361592.812274:0:86948:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788361592.812339:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429757952 00000100:00100000:3.0:1788361592.812344:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429757952 00000100:00100000:3.0:1788361592.812371:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361592.812376:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:86938:x1875230429757952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361592.812381:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361592.812388:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0e000/0x1b69fa8920fe2646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe263f expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.812398:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0e000/0x1b69fa8920fe2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe263f expref: 8 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.812404:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0e000/0x1b69fa8920fe2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe263f expref: 8 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.812408:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e000, rc 0) 00000100:00100000:3.0:1788361592.812435:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:86938:x1875230429757952:12345-0@lo:101:mount.lustre.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.812440:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361592.812482:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429757952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361592.812495:0:86938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361592.812504:0:86938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361592.812555:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429758080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361592.812584:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.812610:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758080 00000100:00100000:2.0:1788361592.812611:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1039293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.812615:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758080 00000100:00100000:3.0:1788361592.812656:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361592.812664:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:86938:x1875230429758080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361592.812787:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429758080:12345-0@lo:501:mount.lustre.0 Request processed in 125us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.812794:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361592.812845:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429758080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361592.812874:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429758208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361592.812917:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.812941:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1039293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.812949:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758208 00000100:00100000:3.0:1788361592.812954:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758208 00000100:00100000:3.0:1788361592.812987:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361592.813006:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429758208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361592.813665:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429758208:12345-0@lo:503:mount.lustre.0 Request processed in 670us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.813670:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361592.813710:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429758208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361592.814308:0:86950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10ec47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86950:1875230429758336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361592.814350:0:86950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.814378:0:86950:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0022426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.814385:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758336 00000100:00100000:3.0:1788361592.814391:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758336 00000100:00100000:3.0:1788361592.814425:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361592.814430:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86950:x1875230429758336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.815517:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86950:x1875230429758336:12345-0@lo:502:llog_process_th.0 Request processed in 1083us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.815525:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361592.815609:0:86950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10ec47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86950:1875230429758336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361592.815655:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361592.815667:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361592.815669:0:86950:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361592.815675:0:86950:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788361592.815686:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361592.815700:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d006a019c0) 00000020:00000080:2.0:1788361592.815722:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788361592.815729:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788361592.815917:0:86950:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788361592.815926:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2654 00000020:00000080:2.0:1788361592.816177:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788361592.816182:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361592.816186:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361592.816187:0:86950:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361592.816190:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361592.816194:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361592.816195:0:86950:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788361592.816211:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361592.816219:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d006a03380) 00000020:00000080:2.0:1788361592.816231:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788361592.816236:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788361592.816237:0:86950:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788361592.816240:0:86950:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788361592.816246:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361592.816289:0:86950:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d136443800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788361592.816307:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d006a00000) 00000020:00000080:2.0:1788361592.816318:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788361592.816379:0:86950:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788361592.816385:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2669 00000020:00000080:2.0:1788361592.816456:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788361592.816462:0:86950:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788361592.816466:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b69fa8920fe2670 00080000:01000000:2.0:1788361592.816471:0:86950:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788361592.816474:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2677 20000000:01000000:1.0:1788361592.818384:0:86948:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361592.818404:0:86948:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788361592.818567:0:86947:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788361592.818573:0:86947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788361592.818595:0:86947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818612:0:86947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361592.818622:0:86947:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050945s 00010000:00010000:3.0:1788361592.818626:0:86947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818634:0:86947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818642:0:86947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818661:0:86947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818668:0:86947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0fe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361592.818672:0:86947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818679:0:86947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818693:0:86947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818701:0:86947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.818707:0:86947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fe00/0x1b69fa8920fe267e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361592.819120:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3653:x1875230429757440:12345-0@lo:253:kworker.0 Request processed in 19476us (20409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.819130:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1788361592.819296:0:3653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361592.819300:0:3653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361592.819301:0:3653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361592.819302:0:3653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361592.819303:0:3653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361592.819305:0:3653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361592.819307:0:3653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361592.819308:0:3653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361592.819310:0:3653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361592.819313:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429757440:0@lo:253:kworker.0 00010000:00010000:2.0:1788361592.856244:0:86950:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788361592.856379:0:86950:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: ec302d84-8f96-49d3-8682-aefc474f8448 idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:2.0:1788361592.856419:0:86950:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:2.0:1788361592.856447:0:86950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:2.0:1788361592.856553:0:86950:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788361592.856607:0:86950:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d137d92600: xid 1875230406970752, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:2.0:1788361592.856617:0:86950:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d137d92900: xid 1875230406970496, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:2.0:1788361592.857145:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d136cb0000) 00000020:00000080:2.0:1788361592.857167:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788361592.857242:0:86950:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788361592.857250:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe269a 00000020:00000080:0.0:1788361592.857630:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361592.860336:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b69fa8920fe26a1 00000020:00000080:0.0:1788361592.860892:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788361592.860904:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361592.860910:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.860914:0:86950:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788361592.860918:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361592.860921:0:86950:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788361592.860923:0:86950:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361592.860924:0:86950:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361592.860926:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361592.860928:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.860930:0:86950:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361592.860933:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361592.860937:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.860939:0:86950:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788361592.860944:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788361592.861005:0:86950:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788361592.861022:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361592.861026:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.861027:0:86950:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788361592.861030:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361592.861034:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.861036:0:86950:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788361592.861039:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361592.861044:0:86950:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:0.0:1788361592.861074:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361592.861087:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d10531cd40) 00000020:00000080:0.0:1788361592.861105:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788361592.861110:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788361592.861167:0:86950:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788361592.861173:0:86950:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788361592.861180:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe26af 00010000:00080000:0.0:1788361592.861216:0:86950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d1055ae800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788361592.865163:0:86950:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788361592.866085:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361592.866095:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788361592.866124:0:86950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788361592.866143:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe26b6 00000100:00080000:0.0:1788361592.866152:0:86950:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361592.866157:0:86950:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99d1055ae800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361592.866204:0:86950:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c91180 x1875230429758464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361592.866238:0:86950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788361592.866306:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361592.866311:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.866313:0:86950:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788361592.866316:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361592.866319:0:86950:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788361592.866321:0:86950:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361592.866322:0:86950:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361592.866324:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361592.866327:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.866328:0:86950:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361592.866331:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361592.866335:0:86950:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788361592.866339:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361592.866346:0:86950:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788361592.866351:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361592.866355:0:86950:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:0.0:1788361592.866380:0:86950:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788361592.866383:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361592.866395:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d1053199c0) 00000020:00000080:0.0:1788361592.866411:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788361592.866416:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788361592.866480:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429758464:0@lo:38:llog_process_th.0 00000004:00080000:0.0:1788361592.866489:0:86950:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788361592.866496:0:86950:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788361592.866503:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe26c4 00010000:00080000:0.0:1788361592.866534:0:86950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d11e634800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00000100:00100000:2.0:1788361592.866602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.866676:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758464 00000100:00100000:1.0:1788361592.866686:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758464 00000100:00100000:1.0:1788361592.866736:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00010000:00010000:0.0:1788361592.866739:0:86950:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788361592.866748:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429758464:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788361592.866775:0:23938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2632 last 0 00000020:00000080:1.0:1788361592.866812:0:23938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe26cb 00000004:00100000:1.0:1788361592.866851:0:23938:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788361592.866947:0:23938:0:(import.c:65:import_set_state_nolock()) ffff99d00541f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361592.867054:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429758464:12345-0@lo:38:llog_process_th.0 Request processed in 308us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.867062:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000040:01000000:0.0:1788361592.867607:0:86950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788361592.867634:0:86950:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788361592.867645:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361592.867660:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1788361592.867671:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788361592.867679:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788361592.867683:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1055ae800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361592.867702:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429758464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361592.867814:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361592.867865:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429758592:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788361592.867890:0:86950:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000100:00100000:2.0:1788361592.867918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.868042:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758592 00000100:00100000:3.0:1788361592.868049:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758592 00000100:00100000:3.0:1788361592.868096:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:3.0:1788361592.868105:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ec44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429758592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788361592.868135:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:3.0:1788361592.868187:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ec44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429758592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.868195:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1788361592.868228:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429758592:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788361592.869202:0:86950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361592.869240:0:86950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:0.0:1788361592.871741:0:86950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:0.0:1788361592.872296:0:86956:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1788361592.872301:0:86956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788361592.872481:0:86956:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1788361592.872498:0:86956:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788361592.872619:0:86956:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:0.0:1788361592.872623:0:86956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788361592.873499:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361592.873510:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361592.873747:0:86950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788361592.873811:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe26d2 00000100:00080000:3.0:1788361592.873965:0:86950:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361592.873972:0:86950:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d11e634800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361592.874126:0:86950:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d110607b80 x1875230429758720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361592.874149:0:86950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788361592.874176:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429758720:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788361592.874268:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788361592.874270:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788361592.874275:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.874278:0:86950:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788361592.874282:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361592.874285:0:86950:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788361592.874287:0:86950:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361592.874289:0:86950:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361592.874291:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361592.874294:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.874295:0:86950:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361592.874299:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361592.874303:0:86950:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788361592.874307:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.874309:0:86950:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788361592.874312:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361592.874325:0:86950:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000100:00100000:2.0:1788361592.874337:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758720 00000100:00100000:2.0:1788361592.874345:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758720 00000020:01000000:3.0:1788361592.874350:0:86950:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788361592.874355:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361592.874368:0:86950:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99d001c619c0) 00000100:00100000:2.0:1788361592.874380:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874 00000020:00000080:3.0:1788361592.874386:0:86950:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788361592.874394:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788361592.874394:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3649:x1875230429758720:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788361592.874420:0:26166:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2632 last 0 00000020:00000080:2.0:1788361592.874450:0:26166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe26e0 00002000:00100000:2.0:1788361592.874464:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d105492800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788361592.874468:0:26166:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000004:00080000:3.0:1788361592.874470:0:86950:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00002000:00100000:2.0:1788361592.874471:0:26166:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00080000:01000000:3.0:1788361592.874477:0:86950:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788361592.874486:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe26e7 00010000:00080000:3.0:1788361592.874523:0:86950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d116c07800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00002000:00080000:2.0:1788361592.874541:0:26166:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361592.874565:0:26166:0:(import.c:65:import_set_state_nolock()) ffff99d136d1a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361592.874630:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429758720:12345-0@lo:8:llog_process_th.0 Request processed in 236us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.874640:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874 00000100:00100000:2.0:1788361592.874681:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361592.874689:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788361592.874697:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00010000:3.0:1788361592.874698:0:86950:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00080000:2.0:1788361592.874703:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788361592.874708:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d11e634800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788361592.874807:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429758848:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788361592.874846:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788361592.874853:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429758720:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361592.874861:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788361592.874879:0:86956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788361592.874895:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758848 00000100:00100000:1.0:1788361592.874900:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758848 00000100:00080000:2.0:1788361592.874930:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:01000000:3.0:1788361592.874943:0:86950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:2.0:1788361592.874945:0:86956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2632884121634ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788361592.874954:0:86956:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788361592.874958:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000040:01000000:3.0:1788361592.874959:0:86950:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788361592.874967:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429758848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361592.874988:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361592.875045:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429758848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.875052:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000040:00080000:3.0:1788361592.875066:0:86950:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:1.0:1788361592.875089:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429758848:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788361592.877173:0:86950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361592.877206:0:86950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:2.0:1788361592.877686:0:86950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000040:00080000:2.0:1788361592.878077:0:86958:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:2.0:1788361592.878081:0:86958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788361592.878188:0:86958:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1788361592.878204:0:86958:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788361592.878594:0:86958:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:2.0:1788361592.878597:0:86958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788361592.878719:0:86939:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:3.0:1788361592.879158:0:86950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361592.879167:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361592.879196:0:86950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788361592.879214:0:86950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe26ee 00000100:00080000:3.0:1788361592.879273:0:86950:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361592.879278:0:86950:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d116c07800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361592.879308:0:86950:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d110607b80 x1875230429758976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361592.879326:0:86950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788361592.879354:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429758976:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788361592.879424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.879521:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429758976 00000100:00100000:1.0:1788361592.879528:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429758976 00000100:00100000:1.0:1788361592.879590:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875 00000100:00100000:1.0:1788361592.879596:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3649:x1875230429758976:12345-0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788361592.879598:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361592.879602:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.879608:0:86950:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788361592.879612:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361592.879615:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.879616:0:86950:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361592.879619:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00010000:00080000:1.0:1788361592.879622:0:26162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2632 last 0 00000020:00000080:3.0:1788361592.879629:0:86950:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361592.879632:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361592.879634:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.879635:0:86950:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361592.879638:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361592.879640:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.879641:0:86950:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361592.879645:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:00000080:1.0:1788361592.879649:0:26162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe26f5 00002000:00100000:1.0:1788361592.879662:0:26162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d005419800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788361592.879665:0:26162:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788361592.879668:0:26162:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788361592.879670:0:86950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86950:1875230429759104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.879713:0:86950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788361592.879726:0:26162:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788361592.879737:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759104 00000100:00100000:3.0:1788361592.879740:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759104 00000100:00080000:1.0:1788361592.879750:0:26162:0:(import.c:65:import_set_state_nolock()) ffff99d10f55a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361592.879768:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361592.879773:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:86950:x1875230429759104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361592.879800:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429758976:12345-0@lo:8:llog_process_th.0 Request processed in 203us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.879807:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875 00000100:00100000:3.0:1788361592.879877:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:86950:x1875230429759104:12345-0@lo:502:llog_process_th.0 Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.879885:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361592.879914:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361592.879921:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1788361592.879926:0:86950:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d006902780 going to sleep for 11 seconds 00000100:00080000:1.0:1788361592.879927:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361592.879931:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788361592.879933:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c07800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361592.879936:0:86950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86950:1875230429759104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361592.879956:0:86950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361592.879974:0:86950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361592.879976:0:86950:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788361592.879980:0:86950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:1.0:1788361592.879981:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361592.880002:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429758976:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788361592.880033:0:86958:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:3.0:1788361592.880042:0:86938:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788361592.880062:0:86938:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:1.0:1788361592.880067:0:86958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2632889244019ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788361592.880073:0:86958:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1788361592.880082:0:86938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.880098:0:86938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361592.880112:0:86938:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d136443800 from 1 10000000:01000000:3.0:1788361592.880115:0:86938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361592.880137:0:86938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361592.880139:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429759232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788361592.880145:0:86938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.880154:0:86938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361592.880164:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.880165:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361592.880188:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.880200:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d006902780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.880235:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759232 00000100:00100000:3.0:1788361592.880239:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759232 00000100:00100000:3.0:1788361592.880276:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1788361592.880283:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429759232:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788361592.880288:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788361592.880301:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361592.880346:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429759232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.880352:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1788361592.880369:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759360 00000100:00100000:3.0:1788361592.880372:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759360 00000100:00100000:1.0:1788361592.880389:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429759232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361592.880403:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361592.880409:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:86938:x1875230429759360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361592.880417:0:86946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361592.880435:0:86946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe26fc expref: -99 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.880454:0:86946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 9 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.880464:0:86946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 9 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.880472:0:86946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0ec00, rc 0) 00000100:00100000:3.0:1788361592.880508:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429759360:12345-0@lo:101:mount.lustre.0 Request processed in 98us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.880514:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361592.880652:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361592.880669:0:86938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.880678:0:86938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361592.881188:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759488:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788361592.881223:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.881257:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.881260:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759488 00000100:00100000:3.0:1788361592.881265:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759488 00000100:00100000:3.0:1788361592.881297:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361592.881303:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429759488:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788361592.881317:0:86945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788361592.881333:0:86945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788361592.881337:0:86945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788361592.881340:0:86945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788361592.881342:0:86945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 110 00000100:00100000:3.0:1788361592.881425:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429759488:12345-0@lo:256:mount.lustre.0 Request processed in 122us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.881432:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361592.881867:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759488:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1788361592.882345:0:86939:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:1.0:1788361592.882420:0:86938:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361592.882484:0:86938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.882504:0:86938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361592.882512:0:86938:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d136443800 from 1 10000000:01000000:1.0:1788361592.882515:0:86938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361592.882544:0:86938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.882562:0:86938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.882571:0:86938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361592.882586:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361592.882621:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.882660:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361592.882715:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759616 00000100:00100000:0.0:1788361592.882720:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759616 00000100:00100000:0.0:1788361592.882788:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361592.882805:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:86938:x1875230429759616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361592.882816:0:86946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361592.882854:0:86946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a83a00/0x1b69fa8920fe2711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe270a expref: -99 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.882873:0:86946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a83a00/0x1b69fa8920fe2711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe270a expref: 10 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.882883:0:86946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a83a00/0x1b69fa8920fe2711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe270a expref: 10 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.882891:0:86946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a83a00, rc 0) 00000100:00100000:0.0:1788361592.882927:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86938:x1875230429759616:12345-0@lo:101:mount.lustre.0 Request processed in 123us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.882933:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361592.882949:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361592.882962:0:86938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.882971:0:86938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361592.883040:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361592.883063:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.883122:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.883164:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759744 00000100:00100000:3.0:1788361592.883169:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759744 00000100:00100000:3.0:1788361592.883200:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361592.883206:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86938:x1875230429759744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361592.883379:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86938:x1875230429759744:12345-0@lo:501:mount.lustre.0 Request processed in 172us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.883386:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361592.883469:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361592.883498:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361592.883536:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.883560:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361592.883575:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429759872 00000100:00100000:0.0:1788361592.883580:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429759872 00000100:00100000:0.0:1788361592.883609:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361592.883615:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004717850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86938:x1875230429759872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361592.883705:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004717850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86938:x1875230429759872:12345-0@lo:503:mount.lustre.0 Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.883712:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361592.883900:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429759872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361592.884240:0:86960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86960:1875230429760000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.884268:0:86960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.884369:0:86960:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361592.884393:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760000 00000100:00100000:0.0:1788361592.884396:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760000 00000100:00100000:0.0:1788361592.884439:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361592.884444:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86960:x1875230429760000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361592.884732:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86960:x1875230429760000:12345-0@lo:502:llog_process_th.0 Request processed in 282us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.884748:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361592.884766:0:86960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86960:1875230429760000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361592.884793:0:86960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361592.884803:0:86960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361592.884805:0:86960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788361592.884818:0:86960:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d136443800 00000020:00000080:1.0:1788361592.884845:0:86960:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361592.884855:0:86960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361592.884857:0:86960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361592.884858:0:86960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788361592.884862:0:86960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361592.884865:0:86960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361592.884866:0:86960:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788361592.884870:0:86960:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d136443800 00000020:00000080:1.0:1788361592.884872:0:86960:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788361592.884946:0:86960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86960:1875230429760128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361592.884978:0:86960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.885016:0:86960:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361592.885577:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760128 00000100:00100000:0.0:1788361592.885584:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760128 00000100:00100000:0.0:1788361592.885621:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361592.885630:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86960:x1875230429760128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361592.885737:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86960:x1875230429760128:12345-0@lo:502:llog_process_th.0 Request processed in 108us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.885745:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361592.885766:0:86960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134ae4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86960:1875230429760128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361592.885792:0:86960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361592.885797:0:86960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361592.885799:0:86960:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788361592.885804:0:86960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788361592.886092:0:86938:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788361592.886120:0:86938:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361592.886190:0:86938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.886202:0:86938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361592.886255:0:86938:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788361592.886259:0:86938:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d136443800 10000000:01000000:0.0:1788361592.886262:0:86938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d136443800 10000000:01000000:0.0:1788361592.886267:0:86938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361592.886272:0:86938:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d136443800 from 1 10000000:01000000:0.0:1788361592.886276:0:86938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361592.886313:0:86938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.886321:0:86938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.886331:0:86938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361592.886356:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429760256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361592.886390:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361592.886421:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d121060b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.887034:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760256 00000100:00100000:3.0:1788361592.887040:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760256 00000100:00100000:3.0:1788361592.887089:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361592.887099:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:86938:x1875230429760256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361592.887112:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361592.887126:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0ea00/0x1b69fa8920fe271f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2718 expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.887150:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0ea00/0x1b69fa8920fe271f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2718 expref: 11 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.887161:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0ea00/0x1b69fa8920fe271f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2718 expref: 11 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.887170:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0ea00, rc 0) 00000100:00100000:3.0:1788361592.887212:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429760256:12345-0@lo:101:mount.lustre.0 Request processed in 115us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.887219:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361592.887259:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429760256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361592.887273:0:86938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361592.887307:0:86938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361592.887364:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429760384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361592.887386:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.887404:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361592.887415:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760384 00000100:00100000:1.0:1788361592.887420:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760384 00000100:00100000:1.0:1788361592.887451:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361592.887457:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429760384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361592.887553:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429760384:12345-0@lo:501:mount.lustre.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.887558:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361592.887638:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429760384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361592.887671:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429760512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361592.887714:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361592.887739:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d121060b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.887740:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760512 00000100:00100000:3.0:1788361592.887745:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760512 00000100:00100000:3.0:1788361592.887765:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361592.887770:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429760512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361592.887883:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429760512:12345-0@lo:503:mount.lustre.0 Request processed in 111us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.887892:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361592.887905:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429760512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361592.889253:0:86962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86962:1875230429760640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.889327:0:86962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.889356:0:86962:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361592.889470:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760640 00000100:00100000:0.0:1788361592.889476:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760640 00000100:00100000:0.0:1788361592.889526:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361592.889535:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86962:x1875230429760640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361592.889648:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86962:x1875230429760640:12345-0@lo:502:llog_process_th.0 Request processed in 113us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.889656:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361592.889751:0:86962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86962:1875230429760640:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788361592.889807:0:86962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788361592.889842:0:86962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99d001c60000) 00000020:00000080:3.0:1788361592.889867:0:86962:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788361592.890038:0:86962:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d136443800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361592.890043:0:86962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d136443800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361592.890046:0:86962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d136443800 4 00010000:00080000:3.0:1788361592.890076:0:86962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d137ea5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361592.891782:0:86962:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788361592.891936:0:86962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788361592.891984:0:86962:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361592.892004:0:86962:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b69fa8920fe272d 00000100:00080000:3.0:1788361592.892013:0:86962:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361592.892019:0:86962:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d137ea5000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361592.892053:0:86962:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1012ad880 x1875230429760768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361592.892077:0:86962:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788361592.892108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429760768:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361592.892199:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.892270:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760768 00000100:00100000:1.0:1788361592.892277:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760768 00000100:00100000:1.0:1788361592.892309:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1788361592.892316:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429760768:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361592.892375:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429760768:12345-0@lo:38:llog_process_th.0 Request processed in 57us (175us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361592.892381:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1788361592.892416:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361592.892423:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361592.892428:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361592.892432:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429760768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361592.892560:0:86962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86962:1875230429760896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.892610:0:86962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.892634:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429760896 00000100:00100000:3.0:1788361592.892638:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429760896 00000100:00100000:3.0:1788361592.892665:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788361592.892671:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86962:x1875230429760896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.892766:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86962:x1875230429760896:12345-0@lo:502:llog_process_th.0 Request processed in 94us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.892772:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788361592.892810:0:86962:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.892848:0:86962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86962:1875230429760896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.892883:0:86962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86962:1875230429761024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361592.892912:0:86962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.892937:0:86962:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361592.892957:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761024 00000100:00100000:1.0:1788361592.892962:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761024 00000100:00100000:1.0:1788361592.893010:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788361592.893019:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86962:x1875230429761024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361592.893106:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86962:x1875230429761024:12345-0@lo:502:llog_process_th.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.893115:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361592.893128:0:86962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86962:1875230429761024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788361592.893152:0:86962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788361592.893602:0:86938:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788361592.893627:0:86938:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361592.893651:0:86938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.893662:0:86938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361592.893726:0:86938:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788361592.893729:0:86938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361592.893730:0:86938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361592.893731:0:86938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361592.893733:0:86938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361592.893734:0:86938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361592.893736:0:86938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361592.893737:0:86938:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361592.893739:0:86938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361592.893741:0:86938:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361592.893744:0:86938:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788361592.893747:0:86938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361592.893748:0:86938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361592.893750:0:86938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361592.893751:0:86938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361592.893752:0:86938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361592.893753:0:86938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361592.893754:0:86938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361592.893755:0:86938:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361592.893756:0:86938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361592.893758:0:86938:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361592.893773:0:86938:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788361592.893785:0:86938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429761152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361592.893848:0:86938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.893865:0:86938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ffb5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361592.893969:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761152 00000100:00100000:3.0:1788361592.893982:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761152 00000100:00100000:3.0:1788361592.894023:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361592.894031:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004f63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429761152:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361592.894050:0:86946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788361592.894062:0:86946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788361592.899373:0:86946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361592.899394:0:86946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788361592.899417:0:86947:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361592.899423:0:86947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361592.899445:0:86947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.899462:0:86947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.899518:0:86947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.899570:0:86947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.899585:0:86947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 2732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361592.899600:0:86947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:86947:1875230429761280:0@lo:104: 00000100:00100000:0.0:1788361592.899682:0:86947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361592.899730:0:86947:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361592.899843:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004f63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:86938:x1875230429761152:12345-0@lo:253:mount.lustre.0 Request processed in 5792us (5973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.899855:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361592.899958:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761280 00000100:00100000:1.0:1788361592.899964:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761280 00000100:00100000:1.0:1788361592.900007:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788361592.900015:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:86947:x1875230429761280:12345-0@lo:104: 00010000:00010000:1.0:1788361592.900028:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361592.900072:0:86938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:86938:1875230429761152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361592.900086:0:86938:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361592.900090:0:86938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361592.900092:0:86938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361592.900094:0:86938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:1.0:1788361592.900095:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:01000004:3.0:1788361592.900096:0:86938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361592.900097:0:86938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361592.900099:0:86938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361592.900100:0:86938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361592.900102:0:86938:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361592.900104:0:86938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1788361592.900104:0:86947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:86947:1875230429761280:0@lo:104: 00000020:01000004:3.0:1788361592.900107:0:86938:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788361592.900112:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:86947:x1875230429761280:12345-0@lo:104: Request processed in 95us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.900121:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000020:02000000:3.0:1788361592.900122:0:86938:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788361592.900122:0:86947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900146:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361592.900208:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900218:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0fe00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361592.900221:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900230:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361592.900297:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361592.900303:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361592.900339:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900346:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361592.900371:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900379:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe26fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2703 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361592.900392:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429761408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361592.900397:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361592.900400:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361592.900402:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361592.900425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.900463:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761408 00000100:00100000:1.0:1788361592.900469:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761408 00010000:00010000:1.0:1788361592.900485:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 2732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361592.900521:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1788361592.900529:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3650:x1875230429761408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361592.900540:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361592.900546:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 2732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900558:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 2732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900572:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe2703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe26fc expref: 11 pid: 86946 timeout: 2732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900595:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900604:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361592.900615:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001193179s 00010000:00010000:0.0:1788361592.900620:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900696:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900705:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900712:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900718:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a83800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361592.900721:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900728:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900746:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361592.900757:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361592.900762:0:86947:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900770:0:86947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361592.900775:0:86947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a83800/0x1b69fa8920fe2734 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361592.900799:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:3650:x1875230429761408:12345-0@lo:103:ldlm_bl.0 Request processed in 269us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361592.900807:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1788361592.901154:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429761408:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788361592.907016:0:86938:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411366 00000040:01000000:1.0:1788361592.907366:0:86938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788361592.907409:0:86968:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411366 00000020:00080000:3.0:1788361592.907413:0:86968:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411366 00000040:01000000:3.0:1788361592.907589:0:86969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361592.907594:0:86938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788361592.907867:0:86970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86970:1875230429761536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361592.907956:0:86970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.908088:0:86970:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9a80 going to sleep for 11 seconds 00000040:01000000:1.0:1788361592.908124:0:86938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:2.0:1788361592.908135:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761536 00000100:00100000:2.0:1788361592.908144:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761536 00000040:00080000:1.0:1788361592.908156:0:86938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361592.908197:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:2.0:1788361592.908207:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86970:x1875230429761536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361592.908274:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86970:x1875230429761536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 69us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.908282:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1788361592.908353:0:86970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86970:1875230429761536:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788361592.908383:0:86970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788361592.908406:0:86970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86970:1875230429761664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361592.908434:0:86970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.908491:0:86970:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002cc3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361592.908527:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761664 00000040:00080000:0.0:1788361592.908529:0:86969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361592.908532:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761664 00000100:00100000:2.0:1788361592.908601:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:2.0:1788361592.908609:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86970:x1875230429761664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361592.908709:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86970:x1875230429761664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.908715:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:3.0:1788361592.908813:0:86970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86970:1875230429761664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361592.908891:0:86970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86970:1875230429761792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361592.908914:0:86970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.908930:0:86970:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002cc3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361592.908973:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761792 00000100:00100000:2.0:1788361592.908977:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761792 00000100:00100000:2.0:1788361592.909014:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:2.0:1788361592.909020:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86970:x1875230429761792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361592.909066:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86970:x1875230429761792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.909072:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00100000:3.0:1788361592.909121:0:86970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86970:1875230429761792:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788361592.909154:0:86970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788361592.912596:0:86938:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788361592.912621:0:86938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788361592.912726:0:86938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361592.920901:0:86969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788361592.920990:0:86969:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00010000:2.0:1788361592.921211:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361592.923657:0:86970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788361592.923746:0:86970:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788361592.923751:0:86970:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788361592.923791:0:86938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788361592.924584:0:86938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788361592.924699:0:86938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788361592.924811:0:86938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788361592.925475:0:86938:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:1.0:1788361592.928280:0:86938:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:3.0:1788361592.929641:0:86971:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 86971 00010000:02000000:3.0:1788361592.929655:0:86971:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788361592.929658:0:86971:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788361592.929661:0:86971:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788361592.929934:0:86938:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788361592.929956:0:86938:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788361592.929986:0:86938:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788361592.930021:0:86938:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788361592.931062:0:86938:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788361592.931334:0:86938:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788361593.942056:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788361594.710951:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361594.710970:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d136443800 from 111 10000000:01000000:3.0:1788361594.710976:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361594.711027:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.711040:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.711052:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.711082:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429761920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.711152:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.711194:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.711362:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429761920 00000100:00100000:0.0:1788361594.711370:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429761920 00000100:00100000:0.0:1788361594.711422:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361594.711433:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:6520:x1875230429761920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.711446:0:86943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361594.711459:0:86943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a82a00/0x1b69fa8920fe2742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe273b expref: -99 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.711481:0:86943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a82a00/0x1b69fa8920fe2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe273b expref: 11 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.711492:0:86943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a82a00/0x1b69fa8920fe2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe273b expref: 11 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.711500:0:86943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a82a00, rc 0) 00000100:00100000:0.0:1788361594.711549:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429761920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.711556:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361594.711943:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429761920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.711980:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.711991:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.712046:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.712078:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.712118:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.712286:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762048 00000100:00100000:1.0:1788361594.712292:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762048 00000100:00100000:1.0:1788361594.712325:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361594.712332:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429762048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788361594.712346:0:86945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788361594.712361:0:86945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788361594.712365:0:86945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 111 00000100:00100000:1.0:1788361594.712455:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429762048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.712463:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361594.713945:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361594.714027:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361594.714036:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.714047:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361594.714057:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361594.714060:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 52 10000000:01000000:3.0:1788361594.714062:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361594.714095:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.714102:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.714110:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.714142:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.714190:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.714231:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.714650:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762176 00000100:00100000:1.0:1788361594.714657:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762176 00000100:00100000:1.0:1788361594.714707:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788361594.714717:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429762176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.714728:0:86948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361594.714742:0:86948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139db5c00/0x1b69fa8920fe2750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2749 expref: -99 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.714763:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139db5c00/0x1b69fa8920fe2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2749 expref: 12 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.714772:0:86948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139db5c00/0x1b69fa8920fe2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2749 expref: 12 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.714781:0:86948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5c00, rc 0) 00000100:00100000:1.0:1788361594.714849:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429762176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.714856:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361594.714946:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.714970:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.714979:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.715038:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.715065:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.715094:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.715145:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762304 00000100:00100000:0.0:1788361594.715150:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762304 00000100:00100000:0.0:1788361594.715184:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361594.715191:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1046f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429762304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.715359:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1046f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429762304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.715378:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361594.715429:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.715455:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.715494:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.715508:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.715523:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762432 00000100:00100000:0.0:1788361594.715527:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762432 00000100:00100000:0.0:1788361594.715557:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361594.715562:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1046f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429762432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.715624:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1046f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429762432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.715631:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361594.715650:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361594.716644:0:87175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788361594.716811:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788361594.716857:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361594.716866:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.716876:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361594.716893:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361594.716895:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 108 10000000:01000000:3.0:1788361594.716898:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361594.716923:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.716932:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.716941:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.716968:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.717009:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.717036:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.717097:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762560 00000100:00100000:1.0:1788361594.717102:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762560 00000100:00100000:1.0:1788361594.717138:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361594.717146:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429762560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.717157:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361594.717169:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139db4000/0x1b69fa8920fe275e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2757 expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.717198:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139db4000/0x1b69fa8920fe275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2757 expref: 13 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.717209:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139db4000/0x1b69fa8920fe275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2757 expref: 13 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.717217:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4000, rc 0) 00000100:00100000:1.0:1788361594.717254:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429762560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.717260:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361594.717261:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.717273:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.717282:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.717330:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.717363:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.717380:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.717394:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762688 00000100:00100000:0.0:1788361594.717397:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762688 00000100:00100000:0.0:1788361594.717422:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361594.717430:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429762688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361594.717443:0:86943:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361594.717460:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361594.717463:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788361594.717467:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788361594.717474:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788361594.717476:0:86943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:0.0:1788361594.717547:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429762688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.717554:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361594.717585:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361594.717653:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361594.717659:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.717668:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.717674:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788361594.717677:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788361594.717679:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361594.717693:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.717701:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.717708:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.717719:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.717746:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.717756:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361594.717989:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762816 00000100:00100000:3.0:1788361594.717994:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762816 00000100:00100000:3.0:1788361594.718028:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361594.718036:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429762816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.718043:0:86946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361594.718052:0:86946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe276c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2765 expref: -99 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.718067:0:86946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2765 expref: 14 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.718076:0:86946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2765 expref: 14 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.718094:0:86946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0ec00, rc 0) 00000100:00100000:3.0:1788361594.718124:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429762816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361594.718131:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788361594.718206:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.718223:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.718232:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.718279:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.718305:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.718334:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361594.718377:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429762944 00000100:00100000:3.0:1788361594.718382:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429762944 00000100:00100000:3.0:1788361594.718440:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361594.718448:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429762944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.718571:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429762944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361594.718578:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788361594.718646:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429762944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.718673:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.718716:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.718738:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361594.718772:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763072 00000100:00100000:3.0:1788361594.718776:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763072 00000100:00100000:3.0:1788361594.718863:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361594.718870:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429763072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.720039:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429763072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1167us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.720048:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361594.720100:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361594.720869:0:87176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788361594.720923:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788361594.720943:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788361594.720952:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.720977:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.721001:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788361594.721004:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d002df9000 from 1 10000000:01000000:0.0:1788361594.721007:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361594.721036:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721044:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721054:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.721074:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.721115:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.721149:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.721167:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763200 00000100:00100000:0.0:1788361594.721171:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763200 00000100:00100000:0.0:1788361594.721204:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361594.721212:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429763200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.721223:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361594.721234:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a83e00/0x1b69fa8920fe277a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2773 expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721254:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a83e00/0x1b69fa8920fe277a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2773 expref: 15 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721265:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a83e00/0x1b69fa8920fe277a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2773 expref: 15 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721284:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a83e00, rc 0) 00000100:00100000:0.0:1788361594.721316:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429763200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.721323:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361594.721358:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.721372:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721382:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.721396:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788361594.721400:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721406:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.721413:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361594.721415:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d002df9000 from 7 10000000:01000000:0.0:1788361594.721417:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361594.721431:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721438:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721445:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.721463:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.721486:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.721500:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.721513:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763328 00000100:00100000:0.0:1788361594.721516:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763328 00000100:00100000:0.0:1788361594.721537:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788361594.721543:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429763328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.721549:0:86943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361594.721558:0:86943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a83400/0x1b69fa8920fe2788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2781 expref: -99 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721570:0:86943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a83400/0x1b69fa8920fe2788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2781 expref: 16 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721579:0:86943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a83400/0x1b69fa8920fe2788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2781 expref: 16 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.721586:0:86943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a83400, rc 0) 00000100:00100000:0.0:1788361594.721624:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429763328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.721630:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361594.721787:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.721800:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.721807:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361594.721877:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.721904:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361594.721933:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11eebbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.723089:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763456 00000100:00100000:0.0:1788361594.723099:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763456 00000100:00100000:0.0:1788361594.723140:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361594.723147:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429763456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.723279:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429763456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.723290:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361594.723386:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.723423:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.723466:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.723493:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.723504:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763584 00000100:00100000:1.0:1788361594.723511:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763584 00000100:00100000:1.0:1788361594.723544:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788361594.723553:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429763584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.723646:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429763584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.723653:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361594.723728:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361594.725667:0:87177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361594.727067:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361594.727102:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361594.727114:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.727126:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361594.727135:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361594.727138:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 52 10000000:01000000:1.0:1788361594.727141:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361594.727183:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.727191:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.727201:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361594.727224:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.727288:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361594.727583:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11eebb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.728242:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763712 00000100:00100000:0.0:1788361594.728250:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763712 00000100:00100000:0.0:1788361594.728307:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788361594.728317:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14207c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429763712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.728330:0:86946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361594.728344:0:86946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a83200/0x1b69fa8920fe2796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe278f expref: -99 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.728368:0:86946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a83200/0x1b69fa8920fe2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe278f expref: 17 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.728380:0:86946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a83200/0x1b69fa8920fe2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe278f expref: 17 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.728389:0:86946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a83200, rc 0) 00000100:00100000:0.0:1788361594.728539:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14207c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429763712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.728547:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361594.728650:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.728665:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.728675:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361594.728740:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.728768:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361594.728797:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11eebb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.728856:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763840 00000100:00100000:0.0:1788361594.728866:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763840 00000100:00100000:0.0:1788361594.728891:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361594.728899:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429763840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.729024:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429763840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.729031:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361594.729061:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.729089:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.729125:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.729143:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.729352:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429763968 00000100:00100000:1.0:1788361594.729357:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429763968 00000100:00100000:1.0:1788361594.729384:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361594.729390:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429763968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.729481:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429763968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.729488:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361594.729586:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429763968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361594.730671:0:87178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788361594.730849:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788361594.730874:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361594.730885:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.730896:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.730907:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788361594.730910:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788361594.730913:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361594.730947:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.730954:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.730987:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.731009:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.731054:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.731094:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.731155:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764096 00000100:00100000:1.0:1788361594.731161:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764096 00000100:00100000:1.0:1788361594.731202:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361594.731211:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429764096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.731222:0:86943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361594.731234:0:86943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139db5e00/0x1b69fa8920fe27a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe279d expref: -99 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.731254:0:86943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139db5e00/0x1b69fa8920fe27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe279d expref: 18 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.731271:0:86943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139db5e00/0x1b69fa8920fe27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe279d expref: 18 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.731280:0:86943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5e00, rc 0) 00000100:00100000:1.0:1788361594.731314:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429764096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.731321:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361594.731597:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.731614:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.731623:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.731674:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.731700:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.731751:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.731776:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764224 00000100:00100000:1.0:1788361594.731779:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764224 00000100:00100000:1.0:1788361594.731848:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361594.731855:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429764224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.731996:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429764224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.732004:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361594.732022:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.732051:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.732087:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361594.732119:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764352 00000100:00100000:1.0:1788361594.732123:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764352 00000100:00100000:0.0:1788361594.732126:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.732151:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788361594.732159:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429764352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.732750:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429764352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 591us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.732757:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788361594.732879:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361594.733691:0:87179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788361594.733892:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788361594.733911:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788361594.733920:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.733950:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.733970:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361594.733972:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0021f9800 from 7 10000000:01000000:0.0:1788361594.733975:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361594.734005:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.734014:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.734024:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.734042:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.734084:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.734154:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.734229:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764480 00000100:00100000:1.0:1788361594.734234:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764480 00000100:00100000:1.0:1788361594.734298:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361594.734306:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429764480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.734323:0:86946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361594.734334:0:86946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139db5200/0x1b69fa8920fe27b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe27ab expref: -99 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.734353:0:86946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139db5200/0x1b69fa8920fe27b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe27ab expref: 19 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.734363:0:86946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139db5200/0x1b69fa8920fe27b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe27ab expref: 19 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.734370:0:86946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5200, rc 0) 00000100:00100000:1.0:1788361594.734409:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429764480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.734416:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788361594.734488:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.734506:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.734515:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.734563:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.734592:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.734607:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.734625:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764608 00000100:00100000:0.0:1788361594.734629:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764608 00000100:00100000:0.0:1788361594.734659:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788361594.734666:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429764608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.734762:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429764608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.734768:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361594.734990:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.735019:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.735059:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.735115:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.735145:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764736 00000100:00100000:1.0:1788361594.735149:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764736 00000100:00100000:1.0:1788361594.735178:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788361594.735184:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d003042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429764736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.735300:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d003042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429764736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.735306:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788361594.735447:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361594.736637:0:87180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788361594.736693:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788361594.736714:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361594.736723:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.736732:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361594.736741:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361594.736744:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 52 10000000:01000000:3.0:1788361594.736746:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361594.736772:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.736780:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.736789:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.736805:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.738054:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.738100:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.738212:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764864 00000100:00100000:0.0:1788361594.738220:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764864 00000100:00100000:0.0:1788361594.738264:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361594.738279:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429764864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.738293:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361594.738306:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a82600/0x1b69fa8920fe27c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe27b9 expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.738329:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a82600/0x1b69fa8920fe27c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe27b9 expref: 20 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.738340:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a82600/0x1b69fa8920fe27c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe27b9 expref: 20 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.738348:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a82600, rc 0) 00000100:00100000:0.0:1788361594.738386:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429764864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.738392:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788361594.738647:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.738662:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.738671:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.738731:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.738759:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.738782:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361594.739133:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429764992 00000100:00100000:2.0:1788361594.739138:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429764992 00000100:00100000:2.0:1788361594.739208:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788361594.739216:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429764992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361594.739335:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429764992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361594.739343:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361594.739396:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429764992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.739423:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.739459:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.739563:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.739592:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765120 00000100:00100000:0.0:1788361594.739596:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765120 00000100:00100000:0.0:1788361594.739653:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361594.739660:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429765120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.739737:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429765120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.739743:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361594.739811:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361594.741118:0:87183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788361594.741235:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788361594.741259:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361594.741268:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361594.741279:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361594.741297:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788361594.741300:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788361594.741303:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361594.741331:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361594.741339:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361594.741347:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361594.741365:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361594.741403:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361594.741441:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0040e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.741578:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765248 00000100:00100000:1.0:1788361594.741584:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765248 00000100:00100000:1.0:1788361594.741648:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361594.741656:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429765248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.741666:0:86943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361594.741678:0:86943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139db4200/0x1b69fa8920fe27ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe27c7 expref: -99 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.741705:0:86943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139db4200/0x1b69fa8920fe27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe27c7 expref: 21 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.741713:0:86943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139db4200/0x1b69fa8920fe27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe27c7 expref: 21 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.741721:0:86943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4200, rc 0) 00000100:00100000:1.0:1788361594.741766:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429765248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361594.741772:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361594.741847:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.741860:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.741869:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361594.741911:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.741936:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.742094:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361594.742130:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765376 00000100:00100000:2.0:1788361594.742135:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765376 00000100:00100000:2.0:1788361594.742159:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788361594.742165:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429765376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361594.742272:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429765376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361594.742279:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788361594.742390:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.742415:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.742450:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.742500:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361594.742529:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765504 00000100:00100000:2.0:1788361594.742533:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765504 00000100:00100000:2.0:1788361594.742589:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361594.742596:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429765504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.744624:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429765504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2025us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.744635:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361594.744709:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361594.745646:0:87186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788361594.745805:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788361594.745862:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361594.745874:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.745894:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361594.745904:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361594.745907:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d137d28000 from 7 10000000:01000000:0.0:1788361594.745910:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361594.745946:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.745955:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.745977:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.745999:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.746052:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361594.746146:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765632 00000100:00100000:3.0:1788361594.746152:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765632 00000100:00100000:0.0:1788361594.746196:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361594.746401:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361594.746412:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429765632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.746424:0:86943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361594.746437:0:86943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe27dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe27d5 expref: -99 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.746459:0:86943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe27dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe27d5 expref: 22 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.746471:0:86943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe27dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe27d5 expref: 22 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.746480:0:86943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e800, rc 0) 00000100:00100000:3.0:1788361594.746516:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429765632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361594.746523:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361594.746554:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.746575:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.746585:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.746641:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.746673:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.746702:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361594.746704:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765760 00000100:00100000:3.0:1788361594.746709:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765760 00000100:00100000:3.0:1788361594.746749:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361594.746755:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429765760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361594.747064:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429765760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361594.747073:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361594.747094:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.747135:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.747177:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.747214:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361594.747341:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429765888 00000100:00100000:2.0:1788361594.747353:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429765888 00000100:00100000:2.0:1788361594.747396:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788361594.747405:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429765888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361594.747501:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429765888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361594.747509:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361594.747751:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429765888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361594.749634:0:87187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361594.749720:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361594.749746:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361594.749757:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.749768:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361594.749776:0:6520:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788361594.749779:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99d1349b4d40 from 1 10000000:01000000:1.0:1788361594.749782:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788361594.749812:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.749835:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.749846:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361594.749878:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429766016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.749937:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361594.749984:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361594.751187:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766016 00000100:00100000:0.0:1788361594.751194:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766016 00000100:00100000:0.0:1788361594.751247:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361594.751257:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429766016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.751269:0:86948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361594.751284:0:86948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d134a82c00/0x1b69fa8920fe27ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe27e3 expref: -99 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.751303:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d134a82c00/0x1b69fa8920fe27ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe27e3 expref: 23 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.751313:0:86948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d134a82c00/0x1b69fa8920fe27ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe27e3 expref: 23 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.751321:0:86948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d134a82c00, rc 0) 00000100:00100000:0.0:1788361594.751372:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429766016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361594.751380:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361594.751464:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429766016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361594.751480:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.751490:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361594.751509:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361594.751514:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.751522:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361594.751530:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788361594.751532:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:1.0:1788361594.751535:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788361594.751554:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.751562:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361594.751570:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361594.751601:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429766144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.751632:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361594.751671:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361594.751727:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766144 00000100:00100000:3.0:1788361594.751732:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766144 00000100:00100000:3.0:1788361594.751769:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361594.751776:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429766144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361594.751783:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361594.751793:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe27f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe27f1 expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.751809:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe27f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe27f1 expref: 24 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.751819:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe27f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe27f1 expref: 24 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361594.751858:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0fc00, rc 0) 00000100:00100000:3.0:1788361594.751903:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429766144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361594.751910:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361594.751937:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110607b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429766144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361594.751951:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.751976:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361594.752030:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429766272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361594.752075:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361594.752106:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361594.752359:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766272 00000100:00100000:1.0:1788361594.752364:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766272 00000100:00100000:1.0:1788361594.752438:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788361594.752446:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429766272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361594.752529:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429766272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (452us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361594.752537:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361594.752770:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429766272:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788361594.752808:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361594.752814:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361594.752845:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788361594.910745:0:87222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788361594.967331:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788361595.402662:0:87274:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788361595.403012:0:87274:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788361595.784158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361595.784414:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406975872 00000100:00100000:3.0:1788361595.784424:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406975872 00000100:00100000:3.0:1788361595.784511:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:3.0:1788361595.784520:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2411:x1875230406975872:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:3.0:1788361595.784528:0:86945:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:3.0:1788361595.784581:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2411:x1875230406975872:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 63us (431us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361595.784587:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:3.0:1788361595.786497:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361595.786706:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976256 00000100:00100000:1.0:1788361595.786714:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976256 00000100:00100000:1.0:1788361595.786780:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 808 00000100:00100000:1.0:1788361595.786791:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406976256:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361595.786889:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406976256:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 100us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361595.786897:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 808 00000100:00080000:2.0:1788361595.787108:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361595.787973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361595.788009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361595.788043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361595.788095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361595.788221:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976000 00000100:00100000:3.0:1788361595.788229:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976000 00000100:00100000:2.0:1788361595.788247:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976128 00000100:00100000:2.0:1788361595.788254:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976128 00000100:00100000:3.0:1788361595.788263:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788361595.788270:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2408:x1875230406976000:12345-192.168.204.35@tcp:250:ptlrpcd_01_00.0 00000100:00100000:2.0:1788361595.788285:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1094 00000100:00100000:2.0:1788361595.788294:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230406976128:12345-192.168.204.35@tcp:38:kworker.0 00010000:00080000:3.0:1788361595.788298:0:86943:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1f5c0251-1795-40ef-8392-cb147010b7b5@192.168.204.35@tcp t0 exp 0000000000000000 cur 2635 last 0 00010000:00080000:2.0:1788361595.788315:0:66126:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'ec302d84-8f96-49d3-8682-aefc474f8448' at ffff99d13fd9e800, cookie 0x1b69fa8920fe2685 00010000:00080000:2.0:1788361595.788322:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp recovering/t103079215109 exp ffff99d13fd9e800 cur 2635 last 1788361592 00000020:00000080:3.0:1788361595.788328:0:86943:0:(genops.c:1406:class_connect()) connect: client 1f5c0251-1795-40ef-8392-cb147010b7b5, cookie 0x1b69fa8920fe27ff 00010000:02000400:2.0:1788361595.788332:0:66126:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788361595.788339:0:66126:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788361595.788362:0:66126:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788361595.788419:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976384 00000100:00100000:0.0:1788361595.788425:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976384 00000100:00100000:0.0:1788361595.788469:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976512 00000100:00100000:0.0:1788361595.788473:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976512 00000100:00100000:0.0:1788361595.788507:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4876 00000100:00100000:0.0:1788361595.788516:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:ec302d84-8f96-49d3-8682-aefc474f8448+5:2408:x1875230406976384:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:0.0:1788361595.788539:0:26170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe22f7 00000100:00080000:3.0:1788361595.788545:0:86943:0:(import.c:65:import_set_state_nolock()) ffff99d11e630000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788361595.788546:0:26170:0:(import.c:65:import_set_state_nolock()) ffff99d136ec1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361595.788590:0:26170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968746 00000100:00100000:3.0:1788361595.788596:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+5:2408:x1875230406976000:12345-192.168.204.35@tcp:250:ptlrpcd_01_00.0 Request processed in 323us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361595.788606:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00080000:2.0:1788361595.788631:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d141654000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361595.788667:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406976128:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 373us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361595.788675:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1094 00000100:00100000:2.0:1788361595.788708:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4877 00000100:00100000:2.0:1788361595.788718:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+5:2408:x1875230406976512:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:2.0:1788361595.788733:0:26171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe22fe 00000100:00080000:2.0:1788361595.788741:0:26171:0:(import.c:65:import_set_state_nolock()) ffff99d136ec7800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788361595.788744:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230406976384:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 227us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361595.788754:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4876 00010000:00010000:0.0:1788361595.788794:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361595.788812:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361595.788815:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788361595.788858:0:26171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968747 00000100:00100000:2.0:1788361595.788969:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230406976512:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 253us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361595.788977:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4877 00010000:00010000:2.0:1788361595.788999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361595.791028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361595.791116:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406971520 00000100:00100000:0.0:1788361595.791126:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406971520 00000100:00100000:0.0:1788361595.791167:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1095 00000100:00100000:0.0:1788361595.791176:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406971520:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00080000:0.0:1788361595.791195:0:66127:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:0.0:1788361595.791219:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406971520:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 44us (196us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361595.791226:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1095 00010000:00080000:3.0:1788361595.791319:0:86971:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:3.0:1788361595.840692:0:87324:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788361595.840985:0:87324:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788361595.990415:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361597.014373:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361597.782111:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361597.782124:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361597.782147:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429766400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361597.782150:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429766528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361597.782245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361597.783199:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766528 00000100:00100000:0.0:1788361597.783210:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766528 00000100:00100000:2.0:1788361597.783243:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361597.783303:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766400 00000100:00100000:2.0:1788361597.783309:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766400 00000100:00100000:1.0:1788361597.783724:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1788361597.783738:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429766528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361597.783770:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361597.783855:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429766528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361597.783863:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1788361597.783949:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:0.0:1788361597.784034:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429766528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361597.784036:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429766400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788361597.784079:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361597.784138:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429766400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361597.784145:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:0.0:1788361597.784874:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429766400:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788361597.785491:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361597.785497:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361597.833410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361597.833608:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976768 00000100:00100000:2.0:1788361597.833623:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976768 00000100:00100000:2.0:1788361597.833698:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:2.0:1788361597.833710:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f5c0251-1795-40ef-8392-cb147010b7b5+5:42333:x1875230406976768:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361597.833738:0:86948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361597.833766:0:86948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137158800/0x1b69fa8920fe2806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d66 expref: -99 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361597.833806:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137158800/0x1b69fa8920fe2806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d66 expref: 6 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361597.833843:0:86948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137158800/0x1b69fa8920fe2806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d66 expref: 6 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361597.833870:0:86948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137158800, rc 0) 00000100:00100000:2.0:1788361597.833963:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406976768:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 254us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361597.833971:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788361597.836355:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361597.836702:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976896 00000100:00100000:1.0:1788361597.836768:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976896 00000100:00100000:1.0:1788361597.836923:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788361597.836935:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1184b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406976896:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788361597.836967:0:86943:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788361597.836997:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788361597.837001:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788361597.837005:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788361597.837008:0:86943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788361597.837011:0:86943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:1.0:1788361597.838841:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1184b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406976896:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 1878us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361597.838859:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:2.0:1788361597.841034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361597.841119:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977024 00000100:00100000:3.0:1788361597.841131:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977024 00000100:00100000:3.0:1788361597.841197:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788361597.841209:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406977024:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361597.841229:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361597.841265:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe280d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d6d expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361597.841297:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe280d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d6d expref: 7 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361597.841307:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe280d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d6d expref: 7 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361597.841315:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0e600, rc 0) 00000100:00100000:3.0:1788361597.841365:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230406977024:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 159us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361597.841370:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788361597.842932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361597.843136:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977152 00000100:00100000:0.0:1788361597.843146:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977152 00000100:00100000:0.0:1788361597.843207:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:0.0:1788361597.843218:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230406977152:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361597.843604:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406977152:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 387us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361597.843613:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:0.0:1788361597.846044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361597.846146:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977280 00000100:00100000:3.0:1788361597.846158:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977280 00000100:00100000:3.0:1788361597.846325:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1788361597.846337:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406977280:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361597.846506:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406977280:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 172us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361597.846512:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:2.0:1788361597.850693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361597.850981:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977408 00000100:00100000:0.0:1788361597.850995:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977408 00000100:00100000:0.0:1788361597.851128:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361597.851141:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406977408:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361597.851181:0:86946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361597.851206:0:86946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d74 expref: -99 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361597.851255:0:86946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d74 expref: 9 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361597.851269:0:86946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d74 expref: 9 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361597.851280:0:86946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d400, rc 0) 00000100:00100000:0.0:1788361597.851363:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406977408:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 225us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361597.851371:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361597.853263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361597.853452:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977536 00000100:00100000:2.0:1788361597.853463:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977536 00000100:00100000:2.0:1788361597.853578:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788361597.853590:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406977536:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361597.853790:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406977536:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 203us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361597.853799:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788361597.856224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361597.856571:0:86943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977664 00000100:00100000:1.0:1788361597.856584:0:86943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977664 00000100:00100000:1.0:1788361597.856715:0:86943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:1.0:1788361597.856728:0:86943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406977664:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361597.856971:0:86943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406977664:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 245us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361597.856981:0:86943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:0.0:1788361597.863138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361597.864409:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977792 00000100:00100000:3.0:1788361597.864424:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977792 00000100:00100000:2.0:1788361597.864660:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:2.0:1788361597.864672:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406977792:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361597.864692:0:86945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361597.864725:0:86945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137158a00/0x1b69fa8920fe281b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d7b expref: -99 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361597.864762:0:86945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137158a00/0x1b69fa8920fe281b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d7b expref: 10 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361597.864777:0:86945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137158a00/0x1b69fa8920fe281b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d7b expref: 10 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361597.864809:0:86945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137158a00, rc 0) 00000100:00100000:2.0:1788361597.864912:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406977792:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 241us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361597.864920:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788361597.866509:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361597.868257:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406977920 00000100:00100000:1.0:1788361597.868283:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406977920 00000100:00100000:1.0:1788361597.868369:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788361597.868383:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406977920:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361597.868534:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406977920:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 155us (2030us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361597.868543:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00010000:00010000:0.0:1788361598.038092:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361598.294201:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429766656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361598.294320:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.294398:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766656 00000100:00100000:2.0:1788361598.294414:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766656 00000100:00080000:1.0:1788361598.294443:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361598.294447:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361598.294450:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361598.294455:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2632 00000100:00080000:1.0:1788361598.294458:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788361598.294463:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361598.294481:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a0a680 x1875230429766912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361598.294511:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361598.294513:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361598.294515:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361598.294518:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2632 00000100:00080000:1.0:1788361598.294520:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1788361598.294526:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00080000:1.0:1788361598.294528:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361598.294543:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429766656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361598.294552:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a08380 x1875230429767168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361598.294567:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361598.294569:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361598.294571:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361598.294574:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2632 00000100:00080000:1.0:1788361598.294575:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788361598.294577:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361598.294585:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a0aa00 x1875230429767424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00000024:2.0:1788361598.294602:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00080000:1.0:1788361598.294605:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361598.294611:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361598.294612:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361598.294614:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2632 00000100:00080000:1.0:1788361598.294616:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788361598.294619:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361598.294624:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a0a300 x1875230429767808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361598.294641:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788361598.294643:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361598.294644:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361598.294648:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d137ea5000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361598.294656:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a0b480 x1875230429768192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361598.294688:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429766912:0@lo:38:kworker.0 00000100:00100000:2.0:1788361598.294698:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429766656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.294709:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:1.0:1788361598.294726:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.294747:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429767168:0@lo:38:kworker.0 00000100:00100000:1.0:1788361598.294761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.294772:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429767424:0@lo:38:kworker.0 00000100:00100000:2.0:1788361598.294793:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766912 00000100:00100000:1.0:1788361598.294794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.294805:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766912 00000100:00100000:1.0:1788361598.294812:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429767808:0@lo:38:kworker.0 00000100:00100000:1.0:1788361598.294863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.294865:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767168 00000100:00100000:2.0:1788361598.294871:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767168 00000100:00100000:1.0:1788361598.294883:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429768192:0@lo:38:kworker.0 00000100:00100000:2.0:1788361598.294907:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767808 00000100:00100000:2.0:1788361598.294913:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767808 00000100:00100000:1.0:1788361598.294917:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.294935:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768192 00000100:00100000:2.0:1788361598.294941:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768192 00000100:00100000:2.0:1788361598.294960:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1788361598.294971:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429766912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788361598.294985:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1788361598.294993:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429767168:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788361598.295018:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2638 last 0 00010000:00080000:2.0:1788361598.295024:0:67579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2638 last 0 00000020:00000080:1.0:1788361598.295081:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b69fa8920fe2822 00000020:00000080:2.0:1788361598.295093:0:67579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe2829 00000004:00100000:1.0:1788361598.295095:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:2.0:1788361598.295110:0:67579:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788361598.295133:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1788361598.295140:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429767808:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361598.295162:0:66127:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2638 last 0 00000100:00080000:2.0:1788361598.295171:0:67579:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1788361598.295200:0:66127:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1b69fa8920fe2830 00000004:00100000:0.0:1788361598.295214:0:66127:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361598.295251:0:66127:0:(import.c:65:import_set_state_nolock()) ffff99d006c89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361598.295254:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429766912:12345-0@lo:38:kworker.0 Request processed in 284us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.295266:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1788361598.295296:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788361598.295304:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429768192:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361598.295316:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429767040:0@lo:400:kworker.0 00000100:00080000:1.0:1788361598.295317:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d005037800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361598.295324:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875230429767808:12345-0@lo:38:kworker.0 Request processed in 180us (458us total) trans 0 rc 0/0 00010000:00080000:2.0:1788361598.295326:0:67579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2638 last 0 00000100:00100000:0.0:1788361598.295344:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788361598.295357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.295359:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875230429767168:12345-0@lo:38:kworker.0 Request processed in 367us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.295368:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000020:00000080:2.0:1788361598.295371:0:67579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b69fa8920fe2837 00000100:00100000:3.0:1788361598.295375:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429767936:0@lo:400:kworker.0 00000004:00100000:2.0:1788361598.295384:0:67579:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788361598.295387:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767040 00000100:00100000:0.0:1788361598.295400:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767040 00000100:00100000:1.0:1788361598.295405:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767424 00000100:00100000:1.0:1788361598.295411:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767424 00000100:00080000:2.0:1788361598.295418:0:67579:0:(import.c:65:import_set_state_nolock()) ffff99d141652000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361598.295445:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.295445:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:1.0:1788361598.295453:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429767424:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361598.295471:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00010000:00080000:1.0:1788361598.295473:0:8449:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d13fd98800, cookie 0x1b69fa8920fe268c 00000100:00100000:0.0:1788361598.295485:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429767040:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788361598.295487:0:8449:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d13fd98800 cur 2638 last 1788361592 00000100:00100000:3.0:1788361598.295490:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788361598.295493:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429768192:12345-0@lo:38:kworker.0 Request processed in 184us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.295500:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429766784:0@lo:400:kworker.0 00000004:00100000:1.0:1788361598.295508:0:8449:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788361598.295520:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00080000:1.0:1788361598.295541:0:8449:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361598.295556:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361598.295562:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429767040:12345-0@lo:400:kworker.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361598.295572:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1788361598.295603:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429767424:12345-0@lo:38:kworker.0 Request processed in 146us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.295610:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1788361598.295612:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429767680:0@lo:400:kworker.0 00000100:00080000:0.0:1788361598.295616:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788361598.295628:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d004a0a680 x1875230429766912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361598.295651:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.295657:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429767552:0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.295666:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429766784 00000100:00080000:2.0:1788361598.295670:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00100000:0.0:1788361598.295673:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429766784 00000100:00100000:1.0:1788361598.295695:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361598.295699:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429767040:0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.295728:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788361598.295733:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429766656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361598.295739:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429766784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.295741:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767936 00000100:00100000:1.0:1788361598.295744:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788361598.295747:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767936 00000100:00100000:1.0:1788361598.295752:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429767296:0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.295780:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767680 00000100:00100000:3.0:1788361598.295783:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767680 00000100:00100000:1.0:1788361598.295783:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361598.295796:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429766784:12345-0@lo:400:kworker.0 Request processed in 60us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.295802:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767552 00000100:00100000:0.0:1788361598.295806:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788361598.295807:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767552 00000100:00100000:1.0:1788361598.295807:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429768064:0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.295876:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1788361598.295878:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361598.295884:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429767936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.295925:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768064 00000100:00100000:1.0:1788361598.295930:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1788361598.295930:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768064 00000100:00100000:3.0:1788361598.295935:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429767936:12345-0@lo:400:kworker.0 Request processed in 51us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.295944:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1788361598.295945:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.295959:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1788361598.295966:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429767552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.295972:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:1.0:1788361598.295981:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429767680:12345-0@lo:400:kworker.0 Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361598.295984:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429768064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.295996:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1788361598.295998:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429767552:12345-0@lo:400:kworker.0 Request processed in 34us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.296004:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00010000:00080000:3.0:1788361598.296020:0:86971:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788361598.296025:0:86971:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 103079215109 00000100:00100000:1.0:1788361598.296030:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429767552:0@lo:400:kworker.0 00000020:00080000:3.0:1788361598.296031:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.296034:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00000100:00100000:0.0:1788361598.296039:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429768064:12345-0@lo:400:kworker.0 Request processed in 57us (157us total) trans 0 rc 0/0 00010000:00080000:3.0:1788361598.296048:0:86971:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215109) 00000100:00100000:1.0:1788361598.296050:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429768064:0@lo:400:kworker.0 00000020:00080000:3.0:1788361598.296052:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:0.0:1788361598.296053:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00010000:00080000:3.0:1788361598.296062:0:86971:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406971520 t103079215109 from 192.168.204.35@tcp req@ffff99d007351f80 x1875230406971520/t0(103079215109) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:656/0 lens 528/0 e 0 to 0 dl 1788361606 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361598.296079:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361598.296082:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361598.296098:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429766784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.296118:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429767680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.296131:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429767936:0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.296151:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429767296 00000100:00100000:0.0:1788361598.296157:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429767296 00000100:00080000:1.0:1788361598.296184:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361598.296196:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1788361598.296204:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429767296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.296254:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429767296:12345-0@lo:400:kworker.0 Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361598.296260:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:3.0:1788361598.296274:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429767296:0@lo:400:kworker.0 00000100:00080000:2.0:1788361598.296638:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d004a0a680 x1875230429766912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361623 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361598.296650:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361598.296655:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361598.296660:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788361598.296667:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429766912:0@lo:38:kworker.0 00010000:00080000:2.0:1788361598.296691:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d004a08380 x1875230429767168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361598.296704:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000004:00080000:3.0:1788361598.296981:0:86971:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 869us 00000100:00080000:2.0:1788361598.297807:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d004a08380 x1875230429767168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361623 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361598.297898:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361598.297903:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361598.297908:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788361598.297913:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429767168:0@lo:38:kworker.0 00000100:00080000:2.0:1788361598.297950:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1788361598.297961:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788361598.297967:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788361598.297969:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:2.0:1788361598.297974:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d106904000 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:2.0:1788361598.297978:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788361598.298424:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429767424:0@lo:38:kworker.0 00010000:00080000:2.0:1788361598.298459:0:87337:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00080000:3.0:1788361598.298462:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d004a0a300 x1875230429767808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361598.298466:0:87337:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788361598.298478:0:87337:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788361598.298486:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1788361598.299302:0:87337:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1788361598.300428:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d004a0a300 x1875230429767808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361623 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361598.300441:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788361598.300446:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361598.300451:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788361598.300456:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429767808:0@lo:38:kworker.0 00010000:00080000:3.0:1788361598.300491:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d004a0b480 x1875230429768192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361598.300506:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:3.0:1788361598.300513:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361598.300517:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361598.300519:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361598.300523:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429768192:0@lo:38:kworker.0 00000100:00100000:3.0:1788361598.300575:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429768320:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788361598.300633:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.300850:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768320 00000100:00100000:2.0:1788361598.300858:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768320 00000100:00100000:2.0:1788361598.301041:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1788361598.301051:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429768320:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788361598.301068:0:8448:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d007352680 x1875230429768320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1788361609 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361598.301080:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429768320:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (447us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361598.301088:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00010000:00010000:3.0:1788361598.309212:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309234:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309248:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309261:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309268:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309274:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309649:0:86971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309658:0:86971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309664:0:86971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309670:0:86971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361598.309674:0:86971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309691:0:86971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309703:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1421fc500) 00010000:00010000:3.0:1788361598.309706:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361598.309716:0:86971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309722:0:86971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe283e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361598.309738:0:86971:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a32ffc68 reply state 0000000037e32f70 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309749:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.309755:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d1421fca00) 00010000:00010000:3.0:1788361598.309761:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361598.309764:0:86971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788361598.309911:0:86971:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788361598.309930:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.309933:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:3.0:1788361598.309937:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.309939:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000001:00080000:2.0:1788361598.312525:0:86939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215109 is committed 00010000:00010000:3.0:1788361598.312581:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.312590:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.312602:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.312606:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0e400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361598.312609:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.312614:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.312627:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d1421fca00) 00010000:00010000:3.0:1788361598.312629:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361598.312632:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.312636:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2845 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361598.313331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361598.313406:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972032 00000100:00100000:2.0:1788361598.313415:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972032 00000100:00100000:2.0:1788361598.313475:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1100 00000100:00100000:2.0:1788361598.313486:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406972032:12345-192.168.204.35@tcp:36:rm.0 00010000:00080000:2.0:1788361598.313506:0:66128:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:2.0:1788361598.313523:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406972032:12345-192.168.204.35@tcp:36:rm.0 Request processed in 40us (195us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361598.313530:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1100 00000020:00080000:3.0:1788361598.313574:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.313578:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:3.0:1788361598.313581:0:86971:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:3.0:1788361598.313583:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.313590:0:86971:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406972032 t103079215110 from 192.168.204.35@tcp req@ffff99d007350700 x1875230406972032/t0(103079215110) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:659/0 lens 512/0 e 0 to 0 dl 1788361609 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788361598.313657:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313667:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313680:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313688:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313692:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313696:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313774:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313782:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.313789:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314115:0:86971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314124:0:86971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314130:0:86971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314135:0:86971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a82e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361598.314139:0:86971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314152:0:86971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314163:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99d119daa500) 00010000:00010000:3.0:1788361598.314166:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361598.314170:0:86971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314176:0:86971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d134a82e00/0x1b69fa8920fe285a lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314195:0:86971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314201:0:86971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314206:0:86971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314211:0:86971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361598.314214:0:86971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314220:0:86971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314258:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1421fc600) 00010000:00010000:3.0:1788361598.314260:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361598.314263:0:86971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314278:0:86971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe284c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361598.314289:0:86971:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eaebafeb reply state 00000000745df30b transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314302:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.314308:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d1421fc700) 00010000:00010000:3.0:1788361598.314311:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361598.314314:0:86971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788361598.314381:0:86971:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788361598.314394:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.314397:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:3.0:1788361598.314400:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361598.314402:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000100:00100000:3.0:1788361598.316139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361598.316241:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972544 00000100:00100000:0.0:1788361598.316251:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972544 00000100:00100000:0.0:1788361598.316334:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1101 00000100:00100000:0.0:1788361598.316345:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406972544:12345-192.168.204.35@tcp:101:touch.0 00010000:00080000:0.0:1788361598.316362:0:66901:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:0.0:1788361598.316419:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406972544:12345-192.168.204.35@tcp:101:touch.0 Request processed in 76us (287us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361598.316427:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1101 00000020:00080000:1.0:1788361598.316476:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.316480:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:1.0:1788361598.316484:0:86971:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:1.0:1788361598.316487:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.316496:0:86971:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406972544 t103079215111 from 192.168.204.35@tcp req@ffff99d007350380 x1875230406972544/t0(103079215111) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:659/0 lens 752/0 e 0 to 0 dl 1788361609 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788361598.316518:0:86971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361598.316545:0:86971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2861 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d5f expref: -99 pid: 86971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.316960:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.316976:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.316990:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317005:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317013:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317020:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361598.317461:0:86971:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x1b69fa8920fe25f2 00000004:00080000:1.0:1788361598.317464:0:86971:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x1b69fa8920fe25f2 in new mfd 00010000:00010000:1.0:1788361598.317472:0:86971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317477:0:86971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317481:0:86971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317484:0:86971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361598.317487:0:86971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317493:0:86971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317502:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d008133f00) 00010000:00010000:1.0:1788361598.317504:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361598.317507:0:86971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317512:0:86971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2868 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361598.317523:0:86971:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006be0e81a reply state 000000003c6b4e5a transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317533:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317548:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99d008133900) 00010000:00010000:1.0:1788361598.317550:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361598.317553:0:86971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361598.317578:0:86971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2861 lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 10 pid: 86971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317589:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d008133f00) 00010000:00010000:1.0:1788361598.317591:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361598.317595:0:86971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2861 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d5f expref: 10 pid: 86971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.317610:0:86971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4600, rc 0) 00010000:00080000:1.0:1788361598.317812:0:86971:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788361598.317844:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.317847:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:1.0:1788361598.317851:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.317853:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:1.0:1788361598.336338:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361598.336602:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406972800 00000100:00100000:2.0:1788361598.336615:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406972800 00000100:00100000:2.0:1788361598.336677:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1102 00000100:00100000:2.0:1788361598.336688:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230406972800:12345-192.168.204.35@tcp:36:touch.0 00010000:00080000:2.0:1788361598.336708:0:66126:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:2.0:1788361598.336782:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230406972800:12345-192.168.204.35@tcp:36:touch.0 Request processed in 95us (453us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361598.336790:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1102 00000020:00080000:1.0:1788361598.336840:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.336844:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1788361598.336848:0:86971:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1788361598.336851:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.336859:0:86971:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406972800 t103079215112 from 192.168.204.35@tcp req@ffff99d13ffa3100 x1875230406972800/t0(103079215112) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:659/0 lens 488/0 e 0 to 0 dl 1788361609 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788361598.336977:0:86971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.337014:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.337027:0:86971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361598.337160:0:86971:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de863f49 reply state 00000000850a30d1 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.337173:0:86971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.337180:0:86971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d008133f00) 00010000:00010000:1.0:1788361598.337183:0:86971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361598.337186:0:86971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788361598.337272:0:86971:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788361598.337285:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.337287:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1788361598.337290:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.337292:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1788361598.340194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361598.340505:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406973184 00000100:00100000:1.0:1788361598.340521:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406973184 00000100:00100000:1.0:1788361598.340590:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:1.0:1788361598.340602:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+12:2408:x1875230406973184:12345-192.168.204.35@tcp:35:touch.0 00010000:00080000:1.0:1788361598.340630:0:66130:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:1.0:1788361598.340659:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+12:2408:x1875230406973184:12345-192.168.204.35@tcp:35:touch.0 Request processed in 60us (482us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361598.340666:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 219 00000020:00080000:2.0:1788361598.341059:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361598.341064:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:2.0:1788361598.341068:0:86971:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:2.0:1788361598.341071:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361598.341081:0:86971:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406973184 t103079215113 from 192.168.204.35@tcp req@ffff99d007353800 x1875230406973184/t0(103079215113) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:659/0 lens 392/0 e 0 to 0 dl 1788361609 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361598.341382:0:86971:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361598.341398:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361598.341401:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:2.0:1788361598.341404:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361598.341416:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:3.0:1788361598.346423:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361598.346494:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978048 00000100:00100000:0.0:1788361598.346504:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978048 00000100:00100000:0.0:1788361598.346620:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 811 00000100:00100000:0.0:1788361598.346633:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230406978048:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788361598.346661:0:66127:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d007352a00 x1875230406978048/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:659/0 lens 224/0 e 0 to 0 dl 1788361609 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361598.346692:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230406978048:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 Request processed in 63us (279us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361598.346699:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 811 00000020:00080000:1.0:1788361598.346753:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.346757:0:86971:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:1.0:1788361598.346761:0:86971:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788361598.346764:0:86971:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361598.346769:0:86971:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788361598.346772:0:86971:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788361598.346942:0:86971:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:3.0:1788361598.349070:0:86939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:3.0:1788361598.349079:0:86939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788361598.349150:0:86939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00000001:00080000:1.0:1788361598.349259:0:86971:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788361598.349297:0:86971:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788361598.349310:0:86971:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d007352680 x1875230429768320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1788361609 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788361598.349437:0:86971:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.35@tcp: req@ffff99d007352a00 x1875230406978048/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:659/0 lens 224/0 e 0 to 0 dl 1788361609 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788361598.349519:0:86971:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:2.0:1788361598.349839:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349852:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349860:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349867:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361598.349882:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349899:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349920:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d1421fc700) 00010000:00010000:2.0:1788361598.349923:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361598.349928:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349939:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2853 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349968:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349975:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.349981:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350002:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361598.350005:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350012:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350020:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99d008133900) 00010000:00010000:2.0:1788361598.350023:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361598.350026:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350032:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe286f lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350048:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350054:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350060:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350065:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361598.350068:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350074:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350094:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d008133f00) 00010000:00010000:2.0:1788361598.350096:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361598.350099:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.350105:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe287d lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361598.350597:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788361598.350608:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d117282a00 x1875230429768320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361614 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361598.350618:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d117282a00 x1875230429768320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361614 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361598.350633:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361598.350649:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788361598.350656:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000110d6fbb): req@ffff99d1365c9180 x1875230429751552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361593 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361598.350679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429768320:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788361598.350806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361598.350868:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429751552 00000100:00100000:3.0:1788361598.350876:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429751552 00000100:00100000:3.0:1788361598.350934:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:3.0:1788361598.350944:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429751552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788361598.350975:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:3.0:1788361598.351017:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429751552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.351023:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:0.0:1788361598.351108:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429751552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361598.351129:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361598.351140:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429768448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361598.351170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.351212:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768448 00000100:00100000:2.0:1788361598.351217:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768448 00000100:00100000:2.0:1788361598.351267:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:2.0:1788361598.351276:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429768448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788361598.351291:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:2.0:1788361598.351333:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429768448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.351340:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:0.0:1788361598.351347:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429768448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361598.354448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361598.354500:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406976640 00000100:00100000:3.0:1788361598.354512:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406976640 00000100:00100000:3.0:1788361598.354560:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1103 00000100:00100000:3.0:1788361598.354579:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406976640:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361598.354608:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:3.0:1788361598.354693:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406976640:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.354701:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1103 00000100:00100000:0.0:1788361598.356615:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361598.356964:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978176 00000100:00100000:2.0:1788361598.356973:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978176 00000100:00100000:2.0:1788361598.357036:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1104 00000100:00100000:2.0:1788361598.357047:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406978176:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361598.357075:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:2.0:1788361598.357136:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406978176:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 91us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.357142:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1104 00000100:00080000:0.0:1788361598.357200:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361598.361123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361598.364005:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978304 00000100:00100000:2.0:1788361598.364025:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978304 00000100:00100000:2.0:1788361598.364079:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4878 00000100:00100000:2.0:1788361598.364116:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1875230406978304:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:2.0:1788361598.364155:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2638 last 0 00000020:00000080:2.0:1788361598.364194:0:8440:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe2884 00002000:00100000:2.0:1788361598.364206:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d141657000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788361598.364218:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788361598.364352:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361598.364385:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99d141656000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361598.364463:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406978304:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 346us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.364584:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4878 00000100:00100000:3.0:1788361598.367030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361598.367155:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978432 00000100:00100000:2.0:1788361598.367166:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978432 00000100:00100000:2.0:1788361598.367228:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1462 00000100:00100000:2.0:1788361598.367238:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406978432:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361598.367263:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361598.367320:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406978432:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.367328:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1462 00000004:00000080:1.0:1788361598.367533:0:86971:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa08886d3e10 00100000:10000000:1.0:1788361598.367542:0:86971:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788361598.368187:0:86957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:0.0:1788361598.368223:0:86957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86957:1875230429768576:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361598.368270:0:86957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361598.368294:0:86957:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d92600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361598.368311:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768576 00000100:00100000:0.0:1788361598.368315:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768576 00000100:00100000:0.0:1788361598.368344:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1788361598.368351:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:86957:x1875230429768576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788361598.368372:0:15123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -593 00002000:02000040:0.0:1788361598.368376:0:15123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1793) 00000004:00080000:2.0:1788361598.368657:0:86959:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1788361598.368682:0:86959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86959:1875230429768704:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361598.368713:0:86959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.368732:0:86959:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d006902a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361598.368746:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768704 00000100:00100000:2.0:1788361598.368750:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768704 00000100:00100000:2.0:1788361598.368779:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880 00000100:00100000:2.0:1788361598.368795:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:86959:x1875230429768704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788361598.368812:0:26166:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -95 00002000:02000040:2.0:1788361598.368815:0:26166:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1793) 00000100:00080000:3.0:1788361598.368968:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788361598.370580:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:1.0:1788361598.370590:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361598.370594:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d002090800/ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:1.0:1788361598.370676:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361598.370723:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002090800/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0000 00000020:00000080:3.0:1788361598.370958:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136ec1800 for lustre-OST0000 00000100:00100000:3.0:1788361598.372791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361598.372939:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978560 00000100:00100000:1.0:1788361598.372949:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978560 00000100:00100000:1.0:1788361598.372998:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4881 00000100:00100000:1.0:1788361598.373006:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2408:x1875230406978560:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:1.0:1788361598.373041:0:26162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2638 last 0 00000020:00000080:1.0:1788361598.373069:0:26162:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe288b 00002000:00100000:1.0:1788361598.373082:0:26162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d10608f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361598.373105:0:26162:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788361598.373184:0:26162:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361598.373218:0:26162:0:(import.c:65:import_set_state_nolock()) ffff99d106089000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361598.373281:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406978560:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 274us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.373289:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4881 00000100:00100000:3.0:1788361598.378749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361598.378864:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978688 00000100:00100000:1.0:1788361598.378875:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978688 00000100:00080000:3.0:1788361598.378938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361598.378963:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1463 00000100:00100000:1.0:1788361598.378973:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406978688:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361598.379001:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361598.379072:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:66663:x1875230406978688:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.379078:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1463 00000001:00100000:1.0:1788361598.379443:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:1.0:1788361598.379449:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361598.379453:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d136ec5000/ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:1.0:1788361598.379471:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361598.379955:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136ec5000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0001 00000020:00000080:3.0:1788361598.380009:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136ec7800 for lustre-OST0001 00002000:00010000:0.0:1788361598.381557:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.381569:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381585:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.381590:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.381597:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381612:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381642:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381649:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381668:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.381682:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.381688:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.381696:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ce00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.381701:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.381723:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.381741:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.381750:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfc9670/0x1b69fa8920fe2892 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.381769:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.381772:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.381773:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361598.381774:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.381782:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381790:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.381794:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.381798:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381807:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381815:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381849:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381882:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361598.381903:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361598.381908:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381915:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ca00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361598.381918:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381927:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381939:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381947:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b581684b/0x1b69fa8920fe2899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.381961:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.381963:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.381965:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.382009:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.382014:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382022:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.382030:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.382035:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382044:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382053:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382060:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382075:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361598.382085:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361598.382089:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382097:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361598.382101:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382109:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382120:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382143:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c1c99f/0x1b69fa8920fe28a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382157:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.382159:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.382161:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.382206:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.382211:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382219:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.382222:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.382226:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382235:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382243:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382251:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382274:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.382295:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.382301:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382308:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.382311:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382317:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.382318:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.382329:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382333:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382348:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.382353:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.382357:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382383:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e33f21/0x1b69fa8920fe28a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382384:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382405:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382412:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.382414:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382415:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.382418:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.382433:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.382442:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.382447:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382455:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.382458:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382465:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382476:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382482:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dd01663/0x1b69fa8920fe28ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382493:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.382494:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.382502:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.382656:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.382662:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382670:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.382673:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.382677:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382697:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382706:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382714:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382796:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.382810:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.382816:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382845:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715da00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.382850:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382859:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382881:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382899:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079cf8b21/0x1b69fa8920fe28b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.382917:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.382919:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.382921:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.382924:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.382931:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382939:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.382942:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.382945:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382953:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382959:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382977:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.382993:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.383009:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.383015:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383023:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.383027:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.383033:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.383040:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383051:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.383054:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.383062:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383063:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383082:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383087:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383098:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383101:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f384612b/0x1b69fa8920fe28bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383116:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383125:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383129:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.383132:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383133:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361598.383143:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.383147:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383156:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383167:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.383171:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361598.383175:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3bccef0/0x1b69fa8920fe28c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383179:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383200:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383202:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383204:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383210:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.383360:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.383363:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.383367:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383377:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383386:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383393:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383409:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.383436:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.383442:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.383450:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361598.383451:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715de00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.383457:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383460:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383476:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383478:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.383486:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.383495:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383498:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383510:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383512:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086187288/0x1b69fa8920fe28ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383537:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383540:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383542:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.383543:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383551:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383566:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.383572:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.383577:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383590:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.383594:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383602:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.383605:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.383616:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383620:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383633:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.383637:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361598.383639:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000671c1ba2/0x1b69fa8920fe28d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383642:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383659:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383662:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383666:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383668:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.383671:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383680:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383707:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.383727:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.383732:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383740:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.383745:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.383747:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.383757:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383759:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383767:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.383775:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.383783:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383787:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383796:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383798:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f6eb2b/0x1b69fa8920fe28d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.383818:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383846:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.383846:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383850:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.383853:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.383957:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.383958:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.383965:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383973:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.383976:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383985:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.383996:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384003:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c4ed7dd/0x1b69fa8920fe28df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.384003:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.384014:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384029:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.384038:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.384042:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384050:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384057:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384064:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384078:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361598.384089:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361598.384094:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384095:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384099:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384102:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384105:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715cc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361598.384111:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384118:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384128:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384146:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe28e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384160:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384164:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.384207:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.384213:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384221:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.384224:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.384228:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384238:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384246:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384254:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384269:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.384290:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.384296:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384303:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.384307:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.384313:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361598.384315:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384322:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384330:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384333:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.384341:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361598.384345:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16a1ff5/0x1b69fa8920fe28ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384347:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384367:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384370:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384373:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384375:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384380:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384389:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384403:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.384410:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.384414:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384433:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.384437:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.384439:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.384449:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384452:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384470:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:1.0:1788361598.384475:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384475:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.384485:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384490:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe28f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384506:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384509:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384511:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384512:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384522:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384529:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384543:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.384550:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.384555:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384563:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166bc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.384566:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384574:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.384582:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.384592:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384595:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384606:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:1.0:1788361598.384611:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe28fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384612:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.384621:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384631:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.384634:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384634:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.384636:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.384645:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.384664:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.385770:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.385775:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.385783:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.385792:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.385797:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.385806:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.385819:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.385840:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66be677/0x1b69fa8920fe2902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.385867:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.385869:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.385871:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.385892:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.385899:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.385909:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.385912:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.385917:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.385926:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.385935:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.385942:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.385956:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.385968:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.385975:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.385983:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.385988:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.385994:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361598.385996:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386002:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386010:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386031:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.386035:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.386039:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386049:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386057:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386065:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386077:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.386080:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d97241f7/0x1b69fa8920fe2909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386096:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.386100:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386107:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a800 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:0.0:1788361598.386116:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361598.386121:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386123:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386139:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386141:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.386149:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.386150:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.386159:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386161:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386178:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060fa4789/0x1b69fa8920fe2910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386179:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386200:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.386202:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.386204:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.386218:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386226:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386239:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.386249:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.386255:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386263:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.386266:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386275:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.386278:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.386287:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386292:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386297:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.386303:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.386312:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386316:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f09d99b3/0x1b69fa8920fe2917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386330:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386337:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.386341:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.386342:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386343:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361598.386353:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.386378:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361598.386386:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361598.386391:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386398:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361598.386401:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386408:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386418:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386425:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f2f897/0x1b69fa8920fe291e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.386435:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.386437:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361598.386443:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361598.387428:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.387436:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387445:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.387449:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.387453:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387462:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387470:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387476:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387486:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361598.387507:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.387513:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387522:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=2638s v=(0 0) 00002000:00010000:0.0:1788361598.387524:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.387525:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.387528:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387529:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387535:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.387541:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387544:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.387548:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387549:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387557:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387558:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387566:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387572:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387618:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788361598.387623:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788361598.387659:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.387664:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387671:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=2638s v=(0 0) 00002000:00010000:2.0:1788361598.387673:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.387674:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.387677:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387678:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387684:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.387687:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387692:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.387696:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387707:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387708:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387710:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361598.387720:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387722:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387725:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361598.387743:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.387745:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387750:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387757:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.387761:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.387768:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387769:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387771:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788361598.387792:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.387795:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.387796:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387800:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387810:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c32d9a16/0x1b69fa8920fe2925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.387810:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.387817:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.387818:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387850:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361598.387855:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387863:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.387863:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387865:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.387868:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.387872:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387873:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387876:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387898:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387902:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387915:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387921:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387944:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd704cd0/0x1b69fa8920fe292c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387947:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387964:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361598.387969:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.387975:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166aa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.387980:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.387980:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361598.388001:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388013:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388020:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788361598.388022:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e020fbc/0x1b69fa8920fe2933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.388034:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388041:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388045:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361598.388051:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388052:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=2638s v=(0 0) 00002000:00010000:0.0:1788361598.388058:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388061:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.388067:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388069:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166ae00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.388069:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388076:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388086:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388087:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.388094:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.388097:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388099:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388100:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388118:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388120:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388121:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388131:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788361598.388145:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388146:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f86a585/0x1b69fa8920fe293a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.388164:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.388166:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388170:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388172:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788361598.388176:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788361598.388177:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388190:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.388192:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.388195:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.388197:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388201:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.388210:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388213:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388219:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388232:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.388234:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388235:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388235:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.388242:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388254:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388260:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388262:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388263:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788361598.388276:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6347bb/0x1b69fa8920fe2941 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388299:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.388301:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.388305:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788361598.388307:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388308:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388310:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388321:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.388321:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788361598.388324:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.388325:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.388329:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388332:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388347:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388351:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.388355:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361598.388365:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388368:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388377:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.388379:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388386:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.388387:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce382276/0x1b69fa8920fe294f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388394:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388394:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388405:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788361598.388405:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388414:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388428:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388434:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788361598.388439:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.388442:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388450:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388461:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788361598.388462:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166ba00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.388465:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.388468:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388471:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.388480:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388484:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.388494:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388498:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388504:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388508:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388509:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388511:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.388518:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.388525:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388526:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388528:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec908cfc/0x1b69fa8920fe2948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388542:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388549:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788361598.388552:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388553:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788361598.388554:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388571:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388572:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.388580:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388585:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788361598.388586:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388593:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388612:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.388617:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388617:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1788361598.388618:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388625:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388627:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388640:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.388642:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388644:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388650:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.388657:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388658:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388664:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a892fa23/0x1b69fa8920fe2956 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388670:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388671:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388685:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388687:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788361598.388692:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788361598.388694:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388698:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388710:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788361598.388712:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.388718:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.388719:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388729:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388732:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.388745:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.388747:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.388755:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.388756:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388758:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388760:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388768:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.388775:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.388785:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dade276a/0x1b69fa8920fe295d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388786:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388786:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388806:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.388806:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388847:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388864:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1788361598.388869:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788361598.388874:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388882:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.388896:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388904:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.388916:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.388917:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388927:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388932:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dbaaee7/0x1b69fa8920fe2964 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388941:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.388947:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.388952:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388954:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788361598.388960:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388968:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.388971:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166be00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.388977:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.388982:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389009:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389013:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389032:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788361598.389035:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389045:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075db3c6f/0x1b69fa8920fe296b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389062:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788361598.389066:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389072:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158e00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361598.389075:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.389076:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389087:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389090:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389107:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.389112:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389112:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.389118:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389123:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eaac8b/0x1b69fa8920fe2972 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389136:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389157:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389166:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788361598.389167:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389171:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389185:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.389185:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788361598.389192:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389201:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389219:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389226:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000485e5ef5/0x1b69fa8920fe2979 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.389229:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.389240:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389244:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788361598.389249:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389263:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.389264:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.389269:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389271:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.389281:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389300:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389302:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389320:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389325:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389332:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389337:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf223632/0x1b69fa8920fe2980 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389349:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788361598.389357:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788361598.389362:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389368:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.389371:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389379:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389391:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.389391:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.389402:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389406:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c127336d/0x1b69fa8920fe2987 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389419:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.389425:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.389434:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389444:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788361598.389445:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389451:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389461:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.389466:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389474:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389477:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389494:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389500:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389506:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788361598.389512:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021daeffe/0x1b69fa8920fe298e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389529:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788361598.389533:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389541:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.389545:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389565:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.389566:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.389576:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389583:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389586:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.389594:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.389597:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6959960/0x1b69fa8920fe2995 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389600:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389618:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389622:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788361598.389625:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389627:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389643:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389645:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.389651:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389661:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389679:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788361598.389682:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389691:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff30adb9/0x1b69fa8920fe299c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.389720:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.389721:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788361598.389727:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389729:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389748:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.389751:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.389753:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389755:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.389765:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389770:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389780:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389785:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389791:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389798:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9c8c926/0x1b69fa8920fe29aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389804:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389816:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788361598.389817:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788361598.389841:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389851:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137158600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.389854:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389873:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389883:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389902:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dc4e648/0x1b69fa8920fe29b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.389905:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.389915:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389920:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788361598.389923:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.389925:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389937:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.389939:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.389942:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389946:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389952:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389965:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389967:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.389987:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e25d7b02/0x1b69fa8920fe29b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.389988:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390003:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390026:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788361598.390030:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361598.390034:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390041:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137159a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390044:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390052:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390062:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.390065:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.390068:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e0ec0d2/0x1b69fa8920fe29bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390073:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390082:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788361598.390084:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.390087:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390090:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.390101:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.390101:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390105:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390123:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390138:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390141:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390149:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390167:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b807bfba/0x1b69fa8920fe29c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390172:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390180:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.390185:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390185:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361598.390195:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390198:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390206:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390216:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390222:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d8dfc68/0x1b69fa8920fe29cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.390230:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.390241:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390249:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361598.390252:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.390253:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390258:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.390267:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390268:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390274:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390285:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390288:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390305:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390309:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390320:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390323:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7a0f72/0x1b69fa8920fe29d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390343:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361598.390348:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.390352:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390360:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390363:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.390381:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.390383:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390390:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390399:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390401:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390405:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.390412:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.390421:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390424:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c121f65/0x1b69fa8920fe29db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390425:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390433:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390450:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361598.390452:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390458:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390459:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.390466:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390470:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361598.390479:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390483:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390491:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361598.390497:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.390502:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390504:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.390505:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.390512:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390526:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066e259ce/0x1b69fa8920fe29e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390526:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:0.0:1788361598.390527:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.390534:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361598.390534:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.390539:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390539:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390553:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390554:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390565:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361598.390577:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390579:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390585:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361598.390586:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361598.390587:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390590:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390600:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361598.390604:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166ac00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390609:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390618:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390631:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.390632:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.390642:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390646:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ec2aa57/0x1b69fa8920fe29a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390659:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.390664:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.390668:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390671:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361598.390678:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390682:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390691:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.390696:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390697:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390715:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390734:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390745:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361598.390752:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390761:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2095731/0x1b69fa8920fe29e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390779:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361598.390783:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.390784:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.390794:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390795:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785fc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390802:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390808:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.390816:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.390819:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390841:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.390853:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390874:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390883:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000042bfe91/0x1b69fa8920fe29f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390956:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.390960:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390968:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.390972:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390980:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390992:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.390999:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049aec644/0x1b69fa8920fe29f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391019:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361598.391024:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391032:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.391037:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361598.391042:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.391061:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391073:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391086:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e13d04c/0x1b69fa8920fe29fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391103:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.391106:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.391110:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361598.391116:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391125:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391147:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361598.391183:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.391188:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391196:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.391204:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.391208:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391218:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391227:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391235:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391246:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361598.391262:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.391275:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.391281:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.391287:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bee00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.391290:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391292:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391308:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.391312:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391313:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.391322:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391331:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391340:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391353:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391361:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361598.391395:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.391399:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391413:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.391416:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.391418:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391421:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391438:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391460:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009583fbcd/0x1b69fa8920fe2a05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391461:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391484:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391492:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361598.391512:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361598.391517:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.391523:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.391530:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.391532:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391536:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391560:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.391561:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391566:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.391576:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391584:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391588:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391603:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014c50f03/0x1b69fa8920fe2a0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391606:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391624:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391630:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361598.391632:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361598.391635:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391644:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.391655:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391665:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.391666:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.391677:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391684:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391686:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.391694:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.391702:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe2a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391703:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391724:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391729:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.391734:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391754:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.391758:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391760:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391781:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391783:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391803:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361598.391807:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391816:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0123eaf/0x1b69fa8920fe2a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391869:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.391872:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391880:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.391895:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.391897:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.391908:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391912:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391926:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.391930:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.391934:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391935:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391947:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007643093a/0x1b69fa8920fe2a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391970:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391974:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361598.391981:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.391984:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.391998:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.392002:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392004:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392047:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392047:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361598.392062:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392071:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038714eb0/0x1b69fa8920fe2a28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.392086:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.392088:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361598.392094:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392095:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392118:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361598.392119:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:3.0:1788361598.392122:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392124:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.392133:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392137:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392151:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392156:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392164:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392169:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c67945e/0x1b69fa8920fe2a2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392179:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392196:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361598.392208:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361598.392213:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392221:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.392225:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392235:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361598.392245:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361598.392248:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392252:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392266:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392269:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.392278:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361598.392282:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361598.392284:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392285:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.392289:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.392299:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361598.392299:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392310:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392318:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392337:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361598.392370:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.392375:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392381:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.392383:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.392388:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392395:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392403:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392415:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392426:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361598.392462:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361598.392466:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392473:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=2638s v=(0 0) 00010000:00010000:2.0:1788361598.392476:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361598.392480:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392487:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392494:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392500:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361598.392507:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361598.392908:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361598.392914:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392922:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.392931:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392939:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392950:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392957:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe2a3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392973:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361598.392977:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788361598.392982:0:26166:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00010000:00010000:3.0:1788361598.392986:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eac00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.392990:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.392998:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.393009:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.393017:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064dee490/0x1b69fa8920fe2a44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.393038:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361598.393042:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.393049:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361598.393054:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.393064:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361598.393075:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361598.393078:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:86959:x1875230429768704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24279us (24359us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361598.393085:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012fefa7d/0x1b69fa8920fe2a4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361598.393097:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880 00010000:00010000:3.0:1788361598.393108:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.393113:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.393116:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361598.393123:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361598.393154:0:86959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86959:1875230429768704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788361598.393169:0:86959:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1788361598.393250:0:86959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86959:1875230429768960:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361598.393270:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429768832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361598.393287:0:86959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.393319:0:86959:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103979480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361598.393320:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768960 00000100:00100000:3.0:1788361598.393325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361598.393328:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768960 00000100:00100000:2.0:1788361598.393365:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429768832 00000100:00100000:2.0:1788361598.393368:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429768832 00000100:00100000:0.0:1788361598.393371:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4882 00000100:00100000:0.0:1788361598.393378:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:86959:x1875230429768960:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361598.393393:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1788361598.393399:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429768832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361598.393409:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00080000:0.0:1788361598.393411:0:26160:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:2.0:1788361598.393439:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429768832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.393445:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00010000:00010000:2.0:1788361598.393485:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361598.393494:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361598.393521:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429768832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361598.395349:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:86959:x1875230429768960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1966us (2058us total) trans 4294968748 rc 0/0 00000100:00100000:0.0:1788361598.395361:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4882 00000100:00100000:2.0:1788361598.395567:0:86959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86959:1875230429768960:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788361598.395584:0:86959:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00002000:00080000:1.0:1788361598.396174:0:15123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:1.0:1788361598.396237:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:86957:x1875230429768576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27885us (27964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.396244:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1788361598.396314:0:86957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86957:1875230429768576:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361598.396325:0:86957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:0.0:1788361598.396396:0:86957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1365cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86957:1875230429769216:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361598.396405:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429769088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361598.396435:0:86957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361598.396448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361598.396493:0:86957:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361598.396500:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769088 00000100:00100000:2.0:1788361598.396507:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769088 00000100:00100000:1.0:1788361598.396538:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769216 00000100:00100000:1.0:1788361598.396544:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769216 00000100:00100000:1.0:1788361598.396586:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4883 00000100:00100000:2.0:1788361598.396595:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788361598.396597:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:86957:x1875230429769216:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361598.396608:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429769088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361598.396633:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00080000:1.0:1788361598.396635:0:26171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:2.0:1788361598.396681:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429769088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361598.396690:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1788361598.396718:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429769088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361598.398032:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:86957:x1875230429769216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1435us (1594us total) trans 4294968747 rc 0/0 00000100:00100000:1.0:1788361598.398040:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4883 00000100:00100000:0.0:1788361598.398053:0:86957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1365cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86957:1875230429769216:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361598.398066:0:86957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00000001:00100000:3.0:1788361598.808437:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788361599.062484:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361600.086017:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361600.903491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361600.903543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361600.903567:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978816 00000100:00100000:0.0:1788361600.903569:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361600.903577:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978816 00000100:00100000:0.0:1788361600.903591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361600.903613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361600.903630:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:3.0:1788361600.903640:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2411:x1875230406978816:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361600.903648:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979072 00000100:00100000:0.0:1788361600.903651:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979072 00000100:00100000:0.0:1788361600.903701:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406978944 00000100:00100000:0.0:1788361600.903705:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406978944 00000100:00100000:3.0:1788361600.903708:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2411:x1875230406978816:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361600.903720:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 812 00000100:00100000:3.0:1788361600.903726:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:2.0:1788361600.903760:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406979072:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361600.903771:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979328 00000100:00100000:3.0:1788361600.903777:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979328 00000100:00100000:3.0:1788361600.903814:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979200 00000100:00100000:3.0:1788361600.903818:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979200 00000100:00100000:2.0:1788361600.903866:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406979072:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361600.903894:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1816 00000100:00100000:3.0:1788361600.903902:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406979328:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361600.903940:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406979328:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361600.903946:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1816 00000100:00100000:3.0:1788361600.903958:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1817 00000100:00100000:3.0:1788361600.903964:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406979200:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361600.903988:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406979200:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361600.903994:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1817 00000100:00080000:3.0:1788361600.904009:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361600.904013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361600.904015:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361600.904024:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361600.904277:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 812 00000100:00100000:2.0:1788361600.904314:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 813 00000100:00100000:2.0:1788361600.904324:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406978944:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361600.904378:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406978944:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 56us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361600.904386:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 813 00000001:02000400:0.0:1788361601.072629:0:87519:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788361601.114487:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361601.834804:0:87568:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788361602.134723:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361602.902304:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429769344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361602.902429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361602.902615:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429769472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361602.902652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361602.902679:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769344 00000100:00100000:3.0:1788361602.902702:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769344 00000100:00100000:2.0:1788361602.902715:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769472 00000100:00100000:2.0:1788361602.902721:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769472 00000100:00100000:3.0:1788361602.902783:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00080000:0.0:1788361602.902792:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361602.902808:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1365c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429769344:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788361602.902811:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788361602.902877:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361602.902957:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1788361602.902966:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429769472:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361602.902969:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1365c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429769344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361602.902980:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00002000:00000024:2.0:1788361602.902989:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361602.903034:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429769472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361602.903050:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1788361602.903166:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429769344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361602.903273:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429769472:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788361603.158214:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361603.276930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361603.277113:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979456 00000100:00100000:1.0:1788361603.277124:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979456 00000100:00100000:1.0:1788361603.277249:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1105 00000100:00100000:1.0:1788361603.277261:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:67135:x1875230406979456:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361603.277280:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788361603.277282:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361603.277303:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2a52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d82 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361603.277373:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2a59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361603.277387:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361603.277584:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361603.277632:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361603.277636:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361603.277660:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361603.277683:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2a52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d82 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361603.277700:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2a59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d82 expref: 7 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361603.277708:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d008133e00) 00010000:00010000:1.0:1788361603.277712:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361603.277715:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5000, rc 0) 00000100:00100000:1.0:1788361603.277775:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:67135:x1875230406979456:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 517us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.277782:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1105 00000100:00100000:0.0:1788361603.282253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361603.282612:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979584 00000100:00100000:3.0:1788361603.282623:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979584 00000100:00100000:3.0:1788361603.282688:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1106 00000100:00100000:3.0:1788361603.282698:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+7:67135:x1875230406979584:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361603.282735:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:3.0:1788361603.283029:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+7:67135:x1875230406979584:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 332us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361603.283038:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1106 00000100:00100000:3.0:1788361603.285871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361603.285986:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979712 00000100:00100000:0.0:1788361603.285996:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979712 00000100:00100000:0.0:1788361603.286113:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1107 00000100:00100000:0.0:1788361603.286124:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:67135:x1875230406979712:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361603.286164:0:66128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361603.286239:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:67135:x1875230406979712:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361603.286248:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1107 00000100:00080000:3.0:1788361603.286355:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361603.292269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361603.292390:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979840 00000100:00100000:0.0:1788361603.292398:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979840 00000100:00100000:0.0:1788361603.292486:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1468 00000100:00100000:0.0:1788361603.292495:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67135:x1875230406979840:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361603.292519:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361603.292585:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67135:x1875230406979840:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 92us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361603.292589:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1468 00000100:00080000:3.0:1788361603.292678:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361603.294188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361603.294280:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406979968 00000100:00100000:3.0:1788361603.294288:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406979968 00000100:00100000:3.0:1788361603.294392:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1469 00000100:00100000:3.0:1788361603.294401:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67135:x1875230406979968:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788361603.294441:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361603.294490:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67135:x1875230406979968:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 90us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361603.294498:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1469 00000100:00080000:0.0:1788361603.294864:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361603.313758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361603.313951:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406980096 00000100:00100000:2.0:1788361603.313963:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406980096 00000100:00100000:2.0:1788361603.314024:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1108 00000100:00100000:2.0:1788361603.314035:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+7:67151:x1875230406980096:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361603.314055:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361603.314075:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2a60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d89 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314139:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314153:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314164:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314179:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314187:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314193:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314294:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe2a75 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314322:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe2a75 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314330:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe2a75 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361603.314371:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788361603.314376:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361603.314401:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe2a75 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314415:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314421:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314426:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314432:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314437:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361603.314441:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314447:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314459:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d008133e00) 00010000:00010000:2.0:1788361603.314467:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361603.314472:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314478:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314494:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314500:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314506:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314510:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361603.314512:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314517:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314524:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99d006cd7d00) 00010000:00010000:2.0:1788361603.314526:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361603.314528:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314533:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe2a6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314562:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2a60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d89 expref: 9 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314589:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe2a75 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d89 expref: 8 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.314596:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d006cd7900) 00010000:00010000:2.0:1788361603.314598:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361603.314614:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ebc00, rc 0) 00000100:00100000:2.0:1788361603.314683:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:67151:x1875230406980096:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 650us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361603.314690:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1108 00000100:00100000:1.0:1788361603.317199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361603.318415:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406980352 00000100:00100000:3.0:1788361603.318428:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406980352 00000100:00100000:3.0:1788361603.318698:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1109 00000100:00100000:3.0:1788361603.318711:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:67151:x1875230406980352:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361603.318732:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361603.318770:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe2a7c lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d90 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.318896:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.318910:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.318929:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.318945:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.318953:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.318960:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319058:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319066:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 2/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319073:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319079:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0e400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361603.319083:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319091:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319103:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d006cd7900) 00010000:00010000:3.0:1788361603.319107:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361603.319111:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319118:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0e400/0x1b69fa8920fe2a83 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319132:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319137:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319143:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319153:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361603.319157:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319163:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319170:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99d1421fc500) 00010000:00010000:3.0:1788361603.319173:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361603.319176:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319182:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f800/0x1b69fa8920fe2a8a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319215:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe2a7c lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d90 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319226:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d006cd7900) 00010000:00010000:3.0:1788361603.319228:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361603.319232:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f600/0x1b69fa8920fe2a7c lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d90 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.319241:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d140d0f600, rc 0) 00000100:00100000:3.0:1788361603.319319:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:67151:x1875230406980352:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 611us (2127us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361603.319326:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1109 00000100:00100000:0.0:1788361603.322706:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361603.323479:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406980608 00000100:00100000:2.0:1788361603.323490:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406980608 00000100:00100000:2.0:1788361603.323600:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1110 00000100:00100000:2.0:1788361603.323612:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:67151:x1875230406980608:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361603.323634:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361603.323654:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d97 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361603.323764:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788361603.323943:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2a91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d97 expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.323957:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d008133e00) 00010000:00010000:2.0:1788361603.323960:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361603.323964:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d97 expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361603.323999:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb600, rc 0) 00000100:00100000:2.0:1788361603.324063:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+9:67151:x1875230406980608:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 453us (1365us total) trans 107374182401 rc 301/301 00000100:00100000:2.0:1788361603.324071:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1110 00000100:00100000:1.0:1788361603.326021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361603.326126:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406980736 00000100:00100000:3.0:1788361603.326148:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406980736 00000100:00100000:3.0:1788361603.326199:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1111 00000100:00100000:3.0:1788361603.326209:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+9:67151:x1875230406980736:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:3.0:1788361603.326276:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326293:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326305:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326322:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326330:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326337:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326405:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326414:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326421:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361603.326461:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361603.326473:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326494:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326500:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326506:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326513:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326520:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0f400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361603.326524:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326531:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326543:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99d006cd7900) 00010000:00010000:3.0:1788361603.326546:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361603.326552:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326558:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d140d0f400/0x1b69fa8920fe2a9f lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326571:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326577:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326590:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326596:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfa00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361603.326599:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326606:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326614:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99d1421fc600) 00010000:00010000:3.0:1788361603.326617:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361603.326620:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326626:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2aa6 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326640:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326646:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326652:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326657:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361603.326660:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326675:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326683:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99d1421fca00) 00010000:00010000:3.0:1788361603.326686:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361603.326688:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361603.326693:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe2aad lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361603.326759:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+9:67151:x1875230406980736:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 552us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361603.326767:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1111 00000100:00100000:3.0:1788361603.330030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361603.330307:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406980992 00000100:00100000:1.0:1788361603.330319:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406980992 00000100:00100000:1.0:1788361603.330410:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:1.0:1788361603.330437:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a29c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+9:67151:x1875230406980992:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788361603.330661:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a29c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:67151:x1875230406980992:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 226us (640us total) trans 107374182402 rc 0/0 00000100:00100000:1.0:1788361603.330670:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:3.0:1788361603.414113:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429769600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361603.414192:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361603.414589:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429769728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361603.414622:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361603.414658:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769728 00000100:00100000:0.0:1788361603.414679:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769728 00000100:00100000:0.0:1788361603.414726:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:0.0:1788361603.414735:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429769728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788361603.414768:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:0.0:1788361603.414844:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429769728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361603.414853:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:0.0:1788361603.414900:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429769728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361603.415040:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361603.415050:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429769856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361603.415077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361603.415104:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769600 00000100:00100000:2.0:1788361603.415107:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769600 00000100:00100000:2.0:1788361603.415139:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769856 00000100:00100000:2.0:1788361603.415142:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769856 00000100:00100000:2.0:1788361603.415160:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1788361603.415166:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429769600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361603.415181:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361603.415213:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429769600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361603.415219:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1788361603.415231:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1788361603.415248:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429769856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361603.415259:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361603.415289:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429769856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361603.415295:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1788361603.415324:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429769600:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788361603.415341:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361603.415350:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361603.415368:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429769856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361603.416134:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429769984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361603.416170:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361603.416265:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429769984 00000100:00100000:2.0:1788361603.416270:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429769984 00000100:00100000:2.0:1788361603.416309:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1788361603.416317:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429769984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361603.416334:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:2.0:1788361603.416368:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429769984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361603.416374:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00100000:0.0:1788361603.416445:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429769984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361603.416988:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429770112:0@lo:400:kworker.0 00000100:00100000:2.0:1788361603.417014:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361603.417065:0:86948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770112 00000100:00100000:0.0:1788361603.417068:0:86948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770112 00000100:00100000:0.0:1788361603.417097:0:86948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788361603.417103:0:86948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429770112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.417308:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429770368:0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.417341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.417385:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429770240:0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.417414:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429770880:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.417504:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429770752:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.417538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788361603.417542:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429770624:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417559:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.417571:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875230429771136:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417586:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.417607:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770752 00000100:00100000:1.0:1788361603.417610:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770752 00000100:00100000:1.0:1788361603.417636:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1788361603.417641:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417672:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429770752:12345-0@lo:400:kworker.0 Request processed in 31us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.417678:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1788361603.417694:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770368 00000100:00100000:1.0:1788361603.417697:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770368 00000100:00100000:1.0:1788361603.417720:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770240 00000100:00100000:1.0:1788361603.417722:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770240 00000100:00100000:1.0:1788361603.417736:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770624 00000100:00100000:1.0:1788361603.417738:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770624 00000100:00100000:1.0:1788361603.417772:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771136 00000100:00100000:1.0:1788361603.417775:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771136 00000100:00100000:1.0:1788361603.417784:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1788361603.417802:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429770368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417861:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429770368:12345-0@lo:400:kworker.0 Request processed in 60us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.417867:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1788361603.417879:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1788361603.417885:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429770240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417912:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429770240:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.417918:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1788361603.417930:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1788361603.417936:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.417961:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429770624:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.417967:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1788361603.417978:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1788361603.417983:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875230429771136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418007:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875230429771136:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.418013:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1788361603.418041:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429770624:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418053:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875230429771136:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418061:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429770240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429770752:0@lo:400:kworker.0 00000100:00080000:1.0:1788361603.418106:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361603.418110:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361603.418143:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429770496:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418168:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.418185:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429771008:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418205:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.418227:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770496 00000100:00100000:1.0:1788361603.418230:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770496 00000100:00100000:1.0:1788361603.418266:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771008 00000100:00100000:1.0:1788361603.418269:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771008 00000100:00100000:1.0:1788361603.418283:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1788361603.418288:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429770496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418319:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429770496:12345-0@lo:400:kworker.0 Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.418324:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1788361603.418335:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1788361603.418340:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429771008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418363:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429771008:12345-0@lo:400:kworker.0 Request processed in 24us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.418368:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00080000:1.0:1788361603.418378:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361603.418392:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429770496:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418400:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429771008:0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.418757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361603.418812:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429770368:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418889:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429770880 00000100:00100000:1.0:1788361603.418899:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429770880 00000100:00100000:1.0:1788361603.418930:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:1.0:1788361603.418937:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429770880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.418972:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429770880:12345-0@lo:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.418977:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:3.0:1788361603.419047:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429770880:0@lo:400:kworker.0 00000100:00100000:0.0:1788361603.419162:0:86948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429770112:12345-0@lo:400:kworker.0 Request processed in 2058us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361603.419171:0:86948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788361603.419323:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429770112:0@lo:400:kworker.0 00000001:00080000:3.0:1788361603.929538:0:86939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00000001:00080000:1.0:1788361603.931101:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968748 is committed 00000001:00080000:0.0:1788361603.932506:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968747 is committed 00010000:00010000:3.0:1788361604.182944:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361605.206181:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361606.025714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361606.025790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361606.025863:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406981376 00000100:00100000:1.0:1788361606.025877:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406981376 00000100:00100000:0.0:1788361606.025877:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361606.025905:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361606.025947:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361606.025972:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406981248 00000100:00100000:1.0:1788361606.025975:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406981248 00000100:00100000:2.0:1788361606.025977:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406981632 00000100:00100000:2.0:1788361606.025984:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406981632 00000100:00100000:0.0:1788361606.025989:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 820 00000100:00100000:0.0:1788361606.026005:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406981376:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361606.026016:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 821 00000100:00100000:1.0:1788361606.026029:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:2412:x1875230406981248:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361606.026032:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406981504 00000100:00100000:2.0:1788361606.026037:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406981504 00000100:00100000:2.0:1788361606.026065:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1820 00000100:00100000:2.0:1788361606.026076:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406981632:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361606.026112:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:2412:x1875230406981248:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361606.026119:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 821 00000100:00100000:3.0:1788361606.026128:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406981120 00000100:00100000:3.0:1788361606.026134:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406981120 00000100:00080000:1.0:1788361606.026144:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361606.026148:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361606.026151:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361606.026152:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361606.026175:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406981376:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 174us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361606.026183:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406981632:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 108us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361606.026192:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1821 00000100:00100000:0.0:1788361606.026193:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 820 00000100:00100000:1.0:1788361606.026202:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406981504:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361606.026224:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406981504:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361606.026229:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1821 00000100:00100000:2.0:1788361606.026262:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1820 00000100:00100000:3.0:1788361606.026318:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:3.0:1788361606.026328:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406981120:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361606.026360:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406981120:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 35us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361606.026367:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 75 00010000:00010000:2.0:1788361606.231809:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361606.744711:0:87762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 11:06:45 (1788361605) 00000100:00100000:1.0:1788361606.783914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361606.784024:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406981760 00000100:00100000:3.0:1788361606.784039:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406981760 00000100:00100000:3.0:1788361606.784141:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1112 00000100:00100000:3.0:1788361606.784156:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:67738:x1875230406981760:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361606.784201:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361606.784236:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710d9e expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784328:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784357:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784374:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784394:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784403:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784425:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784489:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784498:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784505:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784513:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784520:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361606.784526:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784536:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784550:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d008133e00) 00010000:00010000:3.0:1788361606.784554:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361606.784560:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784567:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe2abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784580:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784593:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784600:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784605:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bec00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361606.784608:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784615:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784624:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99d004359600) 00010000:00010000:3.0:1788361606.784626:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361606.784629:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784635:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2ac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784681:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2ab4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d9e expref: 9 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784693:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d008133e00) 00010000:00010000:3.0:1788361606.784695:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361606.784699:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d9e expref: 9 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361606.784734:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfa00, rc 0) 00000100:00100000:3.0:1788361606.784885:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:67738:x1875230406981760:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 731us (984us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361606.784894:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1112 00000100:00100000:0.0:1788361606.790547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361606.790787:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406982016 00000100:00100000:1.0:1788361606.790807:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406982016 00000100:00100000:1.0:1788361606.790914:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1113 00000100:00100000:1.0:1788361606.790926:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:67738:x1875230406982016:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361606.790956:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361606.790960:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361606.790997:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe2a59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d82 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791022:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d008133e00) 00010000:00010000:1.0:1788361606.791036:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361606.791057:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ac9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710da5 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791221:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791238:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791250:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791265:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791271:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791277:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791895:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791909:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791917:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361606.791929:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788361606.791964:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791973:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791980:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791987:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.791994:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361606.792000:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792009:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792020:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d119daac00) 00010000:00010000:1.0:1788361606.792024:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361606.792036:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792043:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2ad0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361606.792058:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca6b39d9 reply state 000000002e003eb6 transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792072:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792079:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99d119daaa00) 00010000:00010000:1.0:1788361606.792081:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361606.792084:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361606.792120:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ac9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792141:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.792150:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d119daae00) 00010000:00010000:1.0:1788361606.792153:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361606.792156:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4e00, rc 0) 00000100:00100000:1.0:1788361606.792256:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:67738:x1875230406982016:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1331us (1725us total) trans 107374182403 rc 0/0 00000100:00100000:1.0:1788361606.792266:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1113 00000100:00100000:0.0:1788361606.796248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361606.796342:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406982272 00000100:00100000:1.0:1788361606.796365:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406982272 00000100:00100000:1.0:1788361606.796441:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1114 00000100:00100000:1.0:1788361606.796455:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:67738:x1875230406982272:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361606.796503:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361606.796565:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2aec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dac expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.796754:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.796773:0:80345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.796782:0:80345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.796860:0:80345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.796890:0:80345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 11 pid: 66127 timeout: 2746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361606.796909:0:80345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80345:1875230429771264:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788361606.797012:0:80345:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11eebbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361606.799433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361606.799513:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406982400 00000100:00100000:0.0:1788361606.799529:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406982400 00010000:00010000:0.0:1788361606.799583:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 12 pid: 66127 timeout: 2746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361606.799648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2583 00000100:00100000:0.0:1788361606.799661:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:2409:x1875230406982400:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361606.799677:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361606.799685:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 12 pid: 66127 timeout: 2746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361606.799708:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 12 pid: 66127 timeout: 2746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361606.799751:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d119daae00) 00010000:00010000:0.0:1788361606.799758:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361606.799768:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361606.799792:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361606.799812:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361606.799916:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:2409:x1875230406982400:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 255us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361606.799926:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2583 00010000:00010000:1.0:1788361606.800527:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2ade lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710da5 expref: 11 pid: 66127 timeout: 2746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361606.800553:0:80345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80345:1875230429771264:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788361606.800585:0:80345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.800610:0:80345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.800617:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361606.800645:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788361606.801171:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801182:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801197:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801203:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361606.801208:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801217:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801234:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d119daae00) 00010000:00010000:1.0:1788361606.801237:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361606.801241:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801247:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2af3 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801342:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2aec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dac expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801353:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d119daac00) 00010000:00010000:1.0:1788361606.801356:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361606.801360:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2aec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dac expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361606.801370:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5a00, rc 0) 00000100:00100000:1.0:1788361606.801435:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:67738:x1875230406982272:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 4984us (5217us total) trans 107374182404 rc 301/301 00000100:00100000:1.0:1788361606.801444:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1114 00000100:00100000:1.0:1788361606.803975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361606.804083:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406982656 00000100:00100000:3.0:1788361606.804098:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406982656 00000100:00100000:3.0:1788361606.804162:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 221 00000100:00100000:3.0:1788361606.804174:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:67738:x1875230406982656:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788361606.804735:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+11:67738:x1875230406982656:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 552us (764us total) trans 107374182405 rc 0/0 00000100:00100000:3.0:1788361606.804744:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 221 00000100:00100000:0.0:1788361606.808459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361606.808577:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406982912 00000100:00100000:3.0:1788361606.808592:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406982912 00000100:00100000:3.0:1788361606.808712:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 222 00000100:00100000:3.0:1788361606.808736:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+11:67738:x1875230406982912:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788361606.809091:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:67738:x1875230406982912:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 368us (648us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1788361606.809099:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 222 00000001:00080000:3.0:1788361607.250179:0:86939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:2.0:1788361607.250955:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.250989:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.250997:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.251005:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361607.251010:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.251026:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.251049:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99d119daaa00) 00010000:00010000:2.0:1788361607.251053:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361607.251059:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.251065:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2ad7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361607.254224:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361607.290372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361607.290453:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983040 00000100:00100000:0.0:1788361607.290464:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983040 00000100:00100000:0.0:1788361607.290522:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1115 00000100:00100000:0.0:1788361607.290533:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:67748:x1875230406983040:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788361607.290555:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361607.290579:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e600/0x1b69fa8920fe2b01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710db3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.290651:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785fe00/0x1b69fa8920fe2b08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.290664:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785fe00/0x1b69fa8920fe2b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.290676:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785fe00/0x1b69fa8920fe2b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361607.290733:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788361607.290738:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361607.290759:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785fe00/0x1b69fa8920fe2b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.290797:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e600/0x1b69fa8920fe2b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710db3 expref: 9 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.290811:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785fe00/0x1b69fa8920fe2b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710db3 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.290842:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d105570600) 00010000:00010000:0.0:1788361607.290846:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361607.290850:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785fe00, rc 0) 00000100:00100000:0.0:1788361607.290902:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:67748:x1875230406983040:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 372us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361607.290909:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1115 00000100:00100000:3.0:1788361607.294944:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361607.294986:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983168 00000100:00100000:3.0:1788361607.294996:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983168 00000100:00100000:3.0:1788361607.295053:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1116 00000100:00100000:3.0:1788361607.295064:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:67748:x1875230406983168:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361607.295113:0:66127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00000100:00100000:3.0:1788361607.295188:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:67748:x1875230406983168:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361607.295197:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1116 00000100:00100000:0.0:1788361607.297294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361607.297356:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983296 00000100:00100000:3.0:1788361607.297365:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983296 00000100:00100000:3.0:1788361607.297414:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1117 00000100:00100000:3.0:1788361607.297423:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:67748:x1875230406983296:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361607.297451:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:3.0:1788361607.297502:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:67748:x1875230406983296:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361607.297510:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1117 00000100:00100000:3.0:1788361607.299807:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361607.299885:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983424 00000100:00100000:0.0:1788361607.299894:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983424 00000100:00100000:0.0:1788361607.299940:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1472 00000100:00100000:0.0:1788361607.299962:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67748:x1875230406983424:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361607.299989:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361607.300054:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67748:x1875230406983424:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361607.300063:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1472 00000100:00100000:0.0:1788361607.301338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361607.301405:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983552 00000100:00100000:2.0:1788361607.301411:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983552 00000100:00100000:2.0:1788361607.301444:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1473 00000100:00100000:2.0:1788361607.301453:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67748:x1875230406983552:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361607.301477:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361607.301528:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:67748:x1875230406983552:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361607.301536:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1473 00000100:00100000:0.0:1788361607.333624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361607.335663:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983808 00000100:00100000:2.0:1788361607.335677:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983808 00000100:00100000:2.0:1788361607.335761:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1118 00000100:00100000:2.0:1788361607.335774:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:67755:x1875230406983808:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00010000:2.0:1788361607.335853:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361607.335881:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785fe00/0x1b69fa8920fe2b08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710db3 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.335903:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d105570600) 00010000:00010000:2.0:1788361607.335918:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361607.335978:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.335992:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336004:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336018:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336025:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336033:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336451:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336478:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336484:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336492:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336499:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361607.336504:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336513:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336524:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d119de6c00) 00010000:00010000:2.0:1788361607.336527:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361607.336531:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336538:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361607.336559:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1397afa reply state 00000000160dc354 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336572:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.336578:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119de6700) 00010000:00010000:2.0:1788361607.336587:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361607.336591:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361607.336681:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+9:67755:x1875230406983808:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 908us (3063us total) trans 107374182407 rc 0/0 00000100:00100000:2.0:1788361607.336690:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1118 00000100:00100000:0.0:1788361607.353876:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361607.353912:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983936 00000100:00100000:0.0:1788361607.353922:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983936 00000100:00100000:0.0:1788361607.353983:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1119 00000100:00100000:0.0:1788361607.353994:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139d3c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+9:67758:x1875230406983936:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:0.0:1788361607.354023:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361607.354051:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e200/0x1b69fa8920fe2b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dba expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.354128:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785f600/0x1b69fa8920fe2b24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.354146:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785f600/0x1b69fa8920fe2b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.354159:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785f600/0x1b69fa8920fe2b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361607.354209:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788361607.354218:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361607.354242:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785f600/0x1b69fa8920fe2b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.354269:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e200/0x1b69fa8920fe2b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dba expref: 11 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.354286:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785f600/0x1b69fa8920fe2b24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dba expref: 10 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361607.354295:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d105570000) 00010000:00010000:0.0:1788361607.354298:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361607.354301:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f600, rc 0) 00000100:00100000:0.0:1788361607.354361:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139d3c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:67758:x1875230406983936:12345-192.168.204.35@tcp:101:rm.0 Request processed in 370us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361607.354374:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1119 00000100:00100000:0.0:1788361607.361527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361607.361753:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406984064 00000100:00100000:1.0:1788361607.361765:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406984064 00000100:00100000:1.0:1788361607.361852:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1120 00000100:00100000:1.0:1788361607.361863:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:67758:x1875230406984064:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:1.0:1788361607.361893:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361607.361918:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dc1 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.361991:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362009:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362038:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362051:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362060:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362067:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362157:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362165:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362172:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361607.362229:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788361607.362233:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361607.362259:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362271:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362279:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362300:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362308:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362317:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361607.362324:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362336:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362347:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d105570000) 00010000:00010000:1.0:1788361607.362351:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361607.362355:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362366:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362380:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362391:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362397:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362403:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361607.362412:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362419:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362427:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119de6700) 00010000:00010000:1.0:1788361607.362430:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361607.362433:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362439:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362463:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dc1 expref: 12 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362475:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dc1 expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361607.362482:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99d007048700) 00010000:00010000:1.0:1788361607.362484:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361607.362491:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5a00, rc 0) 00000100:00100000:1.0:1788361607.362556:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+11:67758:x1875230406984064:12345-192.168.204.35@tcp:101:rm.0 Request processed in 695us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361607.362568:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1120 00000100:00100000:0.0:1788361607.367000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361607.367606:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406984320 00000100:00100000:2.0:1788361607.367619:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406984320 00000100:00100000:2.0:1788361607.367687:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1121 00000100:00100000:2.0:1788361607.367698:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+11:67758:x1875230406984320:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:2.0:1788361607.367768:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788361607.367796:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b40 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dc1 expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367813:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99d007048700) 00010000:00010000:2.0:1788361607.367852:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785f600/0x1b69fa8920fe2b24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dba expref: 10 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367863:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d105570000) 00010000:00010000:2.0:1788361607.367868:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361607.367893:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367905:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367915:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367926:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367951:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.367958:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368048:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368056:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368063:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368260:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368269:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368276:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368283:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368288:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368294:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368328:0:67579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361607.368349:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368355:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368361:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368368:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361607.368370:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361607.368373:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361607.368378:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368384:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361607.368390:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361607.368403:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368407:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99d119de6600) 00010000:00010000:2.0:1788361607.368413:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361607.368418:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368419:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368436:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b55 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361607.368441:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99d119de6600) 00010000:00010000:3.0:1788361607.368446:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788361607.368449:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368455:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368470:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361607.368473:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe2b5c lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368488:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361607.368496:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361607.368499:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361607.368502:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361607.368508:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368515:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361607.368518:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368525:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368534:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d119de6c00) 00010000:00010000:2.0:1788361607.368536:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361607.368539:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368546:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb200/0x1b69fa8920fe2b47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361607.368559:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000425d472e reply state 000000001adc407e transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368569:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361607.368575:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119de6700) 00010000:00010000:2.0:1788361607.368578:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361607.368580:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361607.368655:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+11:67758:x1875230406984320:12345-192.168.204.35@tcp:36:rm.0 Request processed in 958us (1663us total) trans 107374182408 rc 0/0 00000100:00100000:2.0:1788361607.368664:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1121 00000100:00100000:1.0:1788361608.022207:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429771520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361608.022222:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361608.022334:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.022334:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429771392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361608.022409:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771520 00000100:00100000:2.0:1788361608.022425:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771520 00000100:00100000:0.0:1788361608.022438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361608.022596:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361608.022649:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771392 00000100:00100000:2.0:1788361608.022653:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771392 00000100:00100000:0.0:1788361608.022694:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1788361608.022723:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429771520:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788361608.022730:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788361608.022754:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361608.022790:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1788361608.022806:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429771392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361608.022814:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429771520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (480us total) trans 0 rc 0/0 00002000:00000024:2.0:1788361608.022877:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361608.022943:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429771392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361608.022953:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1788361608.022963:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1788361608.023055:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429771392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361608.023056:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429771520:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788361608.278015:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361608.534024:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788361608.534065:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429771776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361608.534138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361608.534181:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429771648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361608.534199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361608.534282:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771776 00000100:00100000:2.0:1788361608.534283:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771648 00000100:00100000:1.0:1788361608.534298:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771776 00000100:00100000:2.0:1788361608.534357:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771648 00000100:00100000:1.0:1788361608.534403:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1788361608.534417:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1788361608.534424:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429771776:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788361608.534426:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361608.534436:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361608.534444:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429771648:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361608.534469:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429771904:0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1788361608.534472:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788361608.534473:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361608.534510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361608.534526:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429771648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361608.534537:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1788361608.534537:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361608.534545:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429772032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361608.534597:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429771776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361608.534613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361608.534615:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1788361608.534633:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429772160:0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.534658:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429772288:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.534659:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429772416:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.534675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.534726:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361608.534737:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429772672:0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.534759:0:86945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772160 00000100:00100000:2.0:1788361608.534761:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429771904 00000100:00100000:1.0:1788361608.534769:0:86945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772160 00000100:00100000:2.0:1788361608.534770:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429771904 00000100:00100000:0.0:1788361608.534775:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429772928:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.534783:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.534814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361608.534864:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772032 00000100:00100000:2.0:1788361608.534868:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772032 00000100:00100000:0.0:1788361608.534882:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788361608.534890:0:86945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788361608.534900:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429772544:0@lo:400:kworker.0 00000100:00100000:2.0:1788361608.534904:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:1.0:1788361608.534910:0:86945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429772160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.534913:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 2 00000100:00100000:2.0:1788361608.534924:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429771904:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361608.534941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361608.534951:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429771776:0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1788361608.534954:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361608.534972:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429773056:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.534973:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968747 gen 2 00000100:00100000:1.0:1788361608.535000:0:86945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429772160:12345-0@lo:400:kworker.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361608.535011:0:86945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788361608.535017:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429771904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361608.535021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361608.535032:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:2.0:1788361608.535048:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1788361608.535062:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429771904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361608.535069:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429772032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788361608.535086:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444982784 avail 1298743296 00010000:00000080:2.0:1788361608.535097:0:23938:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e88380 x1875230429772032/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:669/0 lens 224/368 e 0 to 0 dl 1788361619 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361608.535097:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772416 00000100:00100000:0.0:1788361608.535101:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772416 00000100:00100000:1.0:1788361608.535114:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772672 00000100:00100000:1.0:1788361608.535121:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772672 00000100:00100000:3.0:1788361608.535134:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429771648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361608.535144:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429772032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361608.535154:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1788361608.535163:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772928 00000100:00100000:1.0:1788361608.535167:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772544 00000100:00100000:0.0:1788361608.535168:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772928 00000100:00100000:1.0:1788361608.535173:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772544 00000100:00100000:0.0:1788361608.535191:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773056 00000100:00100000:2.0:1788361608.535195:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1788361608.535196:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773056 00000100:00100000:2.0:1788361608.535204:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429772416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.535217:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1788361608.535226:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1788361608.535233:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429772672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361608.535241:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429772416:12345-0@lo:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361608.535241:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429772928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361608.535249:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1788361608.535272:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1788361608.535283:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429772160:0@lo:400:kworker.0 00000100:00100000:2.0:1788361608.535287:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429772544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.535302:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429772672:12345-0@lo:400:kworker.0 Request processed in 68us (513us total) trans 0 rc 0/0 00010000:00000080:2.0:1788361608.535304:0:67579:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e89180 x1875230429772544/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:669/0 lens 224/224 e 0 to 0 dl 1788361619 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361608.535328:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429772672:0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.535330:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1788361608.535369:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1788361608.535373:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429772544:12345-0@lo:400:kworker.0 Request processed in 90us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361608.535399:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429773056:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788361608.535420:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e89f80 x1875230429773056/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:669/0 lens 224/224 e 0 to 0 dl 1788361619 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361608.535467:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429773056:12345-0@lo:400:kworker.0 Request processed in 74us (449us total) trans 0 rc 0/0 00010000:00000080:0.0:1788361608.535474:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e8a300 x1875230429772928/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:669/0 lens 224/224 e 0 to 0 dl 1788361619 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361608.535507:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361608.535512:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361608.535520:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429772928:12345-0@lo:400:kworker.0 Request processed in 284us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.535539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361608.535547:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1788361608.535567:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429772800:0@lo:400:kworker.0 00000100:00100000:2.0:1788361608.535567:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772288 00000100:00100000:2.0:1788361608.535573:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772288 00000100:00100000:3.0:1788361608.535591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361608.535611:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1788361608.535618:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875230429772288:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361608.535623:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361608.535630:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429772800 00000100:00100000:3.0:1788361608.535634:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429772800 00010000:00000080:2.0:1788361608.535643:0:67579:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d108c6d500 x1875230429772288/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:669/0 lens 224/224 e 0 to 0 dl 1788361619 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361608.535654:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:3.0:1788361608.535660:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429772800:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788361608.535672:0:23938:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d108c6df80 x1875230429772800/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:669/0 lens 224/224 e 0 to 0 dl 1788361619 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361608.535685:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875230429772288:12345-0@lo:400:kworker.0 Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361608.535704:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1788361608.535722:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429772800:12345-0@lo:400:kworker.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.535730:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:2.0:1788361608.535741:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429772288:0@lo:400:kworker.0 00000100:00100000:2.0:1788361608.535754:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429772800:0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.535788:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1788361608.535796:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1788361608.535870:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429772544:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.535885:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429773056:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.535893:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429772416:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.535901:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429772928:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.535911:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429772032:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788361609.302494:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361610.329365:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361610.749787:0:88157:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788361610.800709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361610.800956:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406984448 00000100:00100000:3.0:1788361610.800969:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406984448 00000100:00100000:3.0:1788361610.801075:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1122 00000100:00100000:3.0:1788361610.801089:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:67826:x1875230406984448:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361610.801121:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361610.801154:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dc8 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361610.801245:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2b6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361610.801274:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2b6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361610.801289:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2b6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361610.801357:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361610.801363:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361610.801417:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2b6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361610.801449:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe2b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dc8 expref: 13 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361610.801470:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2b6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dc8 expref: 12 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361610.801481:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d004359b00) 00010000:00010000:3.0:1788361610.801485:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361610.801489:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfa00, rc 0) 00010000:00000080:3.0:1788361610.801499:0:66127:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e88a80 x1875230406984448/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:671/0 lens 576/688 e 0 to 0 dl 1788361621 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361610.801689:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+12:67826:x1875230406984448:12345-192.168.204.35@tcp:101:dd.0 Request processed in 602us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361610.801698:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1122 00000100:00080000:0.0:1788361610.801761:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361610.806375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361610.806665:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406984704 00000100:00100000:1.0:1788361610.806686:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406984704 00000100:00100000:1.0:1788361610.806770:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1123 00000100:00100000:1.0:1788361610.806782:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+12:67826:x1875230406984704:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361610.806810:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361610.806814:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361610.806874:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe2b6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dc8 expref: 12 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.806899:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d004359b00) 00010000:00010000:1.0:1788361610.806918:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361610.806937:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dcf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807709:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807728:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807740:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807770:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807778:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807785:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807892:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807901:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.807909:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361610.808025:0:67579:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788361610.808028:0:67579:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788361606 00000004:00010000:1.0:1788361610.808030:0:67579:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788361606 00000004:00010000:1.0:1788361610.808032:0:67579:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788361606 00000004:00010000:1.0:1788361610.808033:0:67579:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1788361610.808036:0:67579:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1788361610.808042:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808047:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808051:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808061:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808065:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361610.808068:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808074:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808081:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d007048e00) 00010000:00010000:1.0:1788361610.808084:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361610.808087:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808091:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4e00/0x1b69fa8920fe2b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808101:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808106:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808111:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808116:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361610.808119:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808135:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808144:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99d007048000) 00010000:00010000:1.0:1788361610.808147:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361610.808150:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808156:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4600/0x1b69fa8920fe2b7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808200:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2b71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 14 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808215:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 13 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.808222:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d007048d00) 00010000:00010000:1.0:1788361610.808225:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1788361610.808227:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5400, rc 0) 00010000:00000080:1.0:1788361610.808237:0:67579:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e8ad80 x1875230406984704/t107374182409(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:671/0 lens 752/824 e 0 to 0 dl 1788361621 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361610.808321:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+13:67826:x1875230406984704:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1542us (1963us total) trans 107374182409 rc 0/0 00000100:00100000:1.0:1788361610.808328:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1123 00000100:00100000:1.0:1788361610.812666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361610.812961:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406984832 00000100:00100000:2.0:1788361610.812976:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406984832 00000100:00100000:2.0:1788361610.813064:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1124 00000100:00100000:2.0:1788361610.813076:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+13:67826:x1875230406984832:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361610.813114:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361610.813143:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2b94 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dd6 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.813199:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b9b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.813223:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b9b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.813239:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b9b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.813382:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe2b94 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dd6 expref: 15 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.813410:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b9b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dd6 expref: 14 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.813421:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d007048d00) 00010000:00010000:2.0:1788361610.813424:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361610.813429:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea200, rc 0) 00010000:00000080:2.0:1788361610.813439:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d108c7ce00 x1875230406984832/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:671/0 lens 568/1272 e 0 to 0 dl 1788361621 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361610.813535:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+14:67826:x1875230406984832:12345-192.168.204.35@tcp:101:dd.0 Request processed in 462us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361610.813544:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1124 00000100:00100000:3.0:1788361610.821220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361610.821590:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985088 00000100:00100000:1.0:1788361610.821612:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985088 00000100:00100000:1.0:1788361610.822619:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1125 00000100:00100000:1.0:1788361610.822635:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+14:67826:x1875230406985088:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:1.0:1788361610.822815:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.822859:0:66128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 14 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.822871:0:66128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.822914:0:66128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 14 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.822931:0:66128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 14 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361610.822949:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429773184:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788361610.823050:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361610.826561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361610.826705:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985216 00000100:00100000:2.0:1788361610.826716:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985216 00000100:00100000:1.0:1788361610.826736:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429773184:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361610.826767:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 15 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.826771:0:66128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361610.826894:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2584 00000100:00100000:2.0:1788361610.826906:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:ec302d84-8f96-49d3-8682-aefc474f8448+15:2410:x1875230406985216:12345-192.168.204.35@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1788361610.826927:0:19651:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 15 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.826940:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 15 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.826954:0:19651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 15 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.826974:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d007048d00) 00010000:00010000:2.0:1788361610.826977:0:19651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788361610.827275:0:19651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.827290:0:19651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.827298:0:19651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361610.827337:0:19651:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 15 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.827403:0:66128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361610.827412:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:ec302d84-8f96-49d3-8682-aefc474f8448+15:2410:x1875230406985216:12345-192.168.204.35@tcp:102:ldlm_bl.0 Request processed in 507us (864us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361610.827416:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361610.827425:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2584 00000004:00010000:1.0:1788361610.827633:0:66128:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788361610.827637:0:66128:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788361606 -> 1788361610 00000004:00010000:1.0:1788361610.827654:0:66128:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788361606 -> 1788361606 00000004:00010000:1.0:1788361610.827658:0:66128:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788361606 -> 1788361610 00000004:00010000:1.0:1788361610.827660:0:66128:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1788361610.827669:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000151a943c reply state 00000000bb627411 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.827684:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361610.827692:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d007048d00) 00010000:00010000:1.0:1788361610.827695:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361610.827698:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1788361610.827766:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d108c6d180 x1875230406985088/t107374182410(0) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:671/0 lens 488/456 e 0 to 0 dl 1788361621 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361610.827844:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+16:67826:x1875230406985088:12345-192.168.204.35@tcp:36:dd.0 Request processed in 5194us (6627us total) trans 107374182410 rc 0/0 00000100:00100000:1.0:1788361610.827853:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1125 00000100:00100000:0.0:1788361610.832973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361610.833061:0:66139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985344 00000100:00100000:1.0:1788361610.833077:0:66139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985344 00002000:00010000:1.0:1788361610.833129:0:66139:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:1.0:1788361610.833135:0:66139:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99d120e88700 with x1875230406985344 00000100:00100000:1.0:1788361610.833176:0:66139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:1.0:1788361610.833187:0:66139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:ec302d84-8f96-49d3-8682-aefc474f8448+16:2412:x1875230406985344:12345-192.168.204.35@tcp:10:dd.0 00000004:00010000:1.0:1788361610.833435:0:66139:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788361610.833446:0:66139:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788361610 -> 1788361610 00000004:00010000:1.0:1788361610.833449:0:66139:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788361606 -> 1788361606 00000004:00010000:1.0:1788361610.833452:0:66139:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788361610 -> 1788361610 00000004:00010000:1.0:1788361610.833454:0:66139:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361610.833478:0:66139:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e88700 x1875230406985344/t107374182411(0) o10->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:671/0 lens 440/432 e 0 to 0 dl 1788361621 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361610.833562:0:66139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:ec302d84-8f96-49d3-8682-aefc474f8448+17:2412:x1875230406985344:12345-192.168.204.35@tcp:10:dd.0 Request processed in 377us (601us total) trans 107374182411 rc 0/0 00000100:00100000:1.0:1788361610.833571:0:66139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00002000:00010000:1.0:1788361610.833575:0:66139:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:1.0:1788361610.833578:0:66139:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99d120e88700 with x1875230406985344 00000100:00100000:0.0:1788361610.837999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361610.838483:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985600 00000100:00100000:3.0:1788361610.838496:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985600 00000100:00100000:3.0:1788361610.838689:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 223 00000100:00100000:3.0:1788361610.838702:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+17:67826:x1875230406985600:12345-192.168.204.35@tcp:35:dd.0 00010000:00000080:3.0:1788361610.838979:0:66129:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d120e8b480 x1875230406985600/t107374182412(0) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:671/0 lens 392/456 e 0 to 0 dl 1788361621 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361610.839068:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+18:67826:x1875230406985600:12345-192.168.204.35@tcp:35:dd.0 Request processed in 368us (1083us total) trans 107374182412 rc 0/0 00000100:00100000:3.0:1788361610.839082:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 223 00000100:00100000:0.0:1788361611.143580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361611.143677:0:86946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985728 00000100:00100000:3.0:1788361611.143692:0:86946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985728 00000100:00100000:0.0:1788361611.143713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361611.143757:0:86946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:0.0:1788361611.143780:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361611.143781:0:86946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406985728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361611.143875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361611.143917:0:86946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2412:x1875230406985728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 147us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361611.143927:0:86946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:2.0:1788361611.143956:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985984 00000100:00100000:2.0:1788361611.143967:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985984 00000100:00100000:3.0:1788361611.144000:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986112 00000100:00100000:3.0:1788361611.144007:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986112 00000100:00100000:2.0:1788361611.144046:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1822 00000100:00100000:3.0:1788361611.144058:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1823 00000100:00100000:2.0:1788361611.144064:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406985984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361611.144074:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406986112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:0.0:1788361611.145056:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361611.145063:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361611.145095:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985856 00000100:00100000:0.0:1788361611.145101:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985856 00000100:00100000:0.0:1788361611.145158:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 828 00000100:00100000:0.0:1788361611.145170:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406985856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361611.145201:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406986112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1126us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361611.145212:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1823 00000100:00100000:0.0:1788361611.145432:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406985856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 263us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361611.145441:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 828 00000100:00080000:0.0:1788361611.145469:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361611.145493:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406985984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1433us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361611.145503:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1822 00010000:00010000:3.0:1788361611.350134:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788361611.999232:0:88254:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788361611.999291:0:88254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361611.999307:0:88254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361611.999315:0:88254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361611.999322:0:88254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361611.999347:0:88254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788361611.999353:0:88254:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788361611.999381:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361611.999389:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788361611.999389:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788361611.999402:0:88254:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788361611.999408:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361611.999422:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d134a82400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361611.999428:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361611.999430:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788361611.999462:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361611.999471:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361611.999478:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361611.999481:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788361611.999484:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788361611.999530:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361611.999543:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361611.999587:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361611.999595:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a82400/0x1b69fa8920fe2718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe271f expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361611.999610:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361611.999613:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361611.999615:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361611.999720:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429773440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361611.999785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361611.999870:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773440 00000100:00100000:2.0:1788361611.999880:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773440 00000100:00100000:2.0:1788361611.999946:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1788361611.999953:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429773312:0@lo:39:umount.0 00000100:00100000:2.0:1788361611.999959:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429773440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361611.999990:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788361612.000005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361612.000015:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ea00/0x1b69fa8920fe271f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2718 expref: 24 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.000048:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361612.000051:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773312 00000100:00100000:0.0:1788361612.000060:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773312 00000100:00100000:0.0:1788361612.000118:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1788361612.000133:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429773440:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361612.000134:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429773312:12345-0@lo:39:umount.0 00000100:00100000:2.0:1788361612.000153:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000020:00000080:0.0:1788361612.000167:0:66901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2837 00000100:00080000:0.0:1788361612.000186:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d141652000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788361612.000222:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10695df80 x1875230429773312/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:672/0 lens 224/224 e 0 to 0 dl 1788361622 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361612.000226:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429773440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361612.000283:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875230429773312:12345-0@lo:39:umount.0 Request processed in 155us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361612.000302:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000020:00000080:0.0:1788361612.000311:0:66901:0:(genops.c:906:class_export_put()) final put ffff99d141650800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788361612.000368:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361612.000394:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1788361612.000401:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141650800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788361612.000404:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429773312:0@lo:39:umount.0 00000020:00000080:2.0:1788361612.000465:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141652000 for lustre-MDT0000 00000100:00080000:2.0:1788361612.000504:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361612.000510:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361612.000516:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788361612.001698:0:88254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001715:0:88254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001723:0:88254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001731:0:88254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001766:0:88254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361612.001774:0:88254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001782:0:88254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.001784:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361612.001796:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.001850:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361612.001858:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001862:0:88254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.001868:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001872:0:88254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361612.001890:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361612.001895:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361612.001897:0:88254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788361612.001898:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788361612.001916:0:88254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001925:0:88254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001933:0:88254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.001939:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.001940:0:88254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.001972:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361612.001988:0:88254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361612.001997:0:88254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002003:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.002007:0:88254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361612.002028:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361612.002029:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe263f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2646 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.002032:0:88254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361612.002037:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002063:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361612.002064:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d140d0ee00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:3.0:1788361612.002066:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361612.002068:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.002104:0:88254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002105:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:1.0:1788361612.002106:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361612.002111:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361612.002142:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002144:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361612.002149:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:3.0:1788361612.002151:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361612.002151:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788361612.002153:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:3.0:1788361612.002155:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788361612.002162:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788361612.002164:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788361612.002176:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361612.002176:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002182:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361612.002182:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361612.002188:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002195:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db4400/0x1b69fa8920fe270a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2711 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361612.002198:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002204:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361612.002204:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0ee00/0x1b69fa8920fe273b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2742 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002206:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361612.002207:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361612.002214:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361612.002215:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788361612.002215:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361612.002217:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361612.002222:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788361612.002229:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429773568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361612.002229:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429773824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361612.002306:0:88254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788361612.002312:0:88254:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788361612.002317:0:88254:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1788361612.002352:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788361612.002363:0:88254:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788361612.002370:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788361612.002375:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788361612.002383:0:88254:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:1.0:1788361612.002399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361612.002408:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773568 00000100:00100000:3.0:1788361612.002415:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773568 00000100:00100000:1.0:1788361612.002421:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429773696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361612.002440:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361612.002462:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773824 00000100:00100000:1.0:1788361612.002466:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773824 00000100:00100000:1.0:1788361612.002488:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773696 00000100:00100000:1.0:1788361612.002491:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773696 00000100:00100000:1.0:1788361612.002511:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1788361612.002531:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429773568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361612.002543:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788361612.002550:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1788361612.002557:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3651:x1875230429773824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361612.002557:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0e000/0x1b69fa8920fe2646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe263f expref: 25 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002563:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361612.002568:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361612.002571:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a82a00/0x1b69fa8920fe2742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe273b expref: 24 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.002580:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361612.002599:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429773568:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361612.002600:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3651:x1875230429773824:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361612.002607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00010000:00010000:0.0:1788361612.002729:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361612.002735:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.002742:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361612.002745:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.002752:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361612.002758:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361612.002774:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361612.002776:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788361612.002778:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788361612.002796:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.002801:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361612.002808:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.002842:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db5800/0x1b69fa8920fe262a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2631 expref: -99 pid: 86938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.002851:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361612.002853:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361612.002854:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361612.002861:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361612.002871:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429773952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361612.002896:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361612.002923:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429773952 00000100:00100000:0.0:1788361612.002927:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429773952 00000100:00100000:1.0:1788361612.003004:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1788361612.003020:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1788361612.003026:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3651:x1875230429773696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361612.003034:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361612.003043:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a83a00/0x1b69fa8920fe2711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe270a expref: 22 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361612.003051:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429773568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361612.003051:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361612.003071:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3651:x1875230429773696:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361612.003074:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429773824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361612.003077:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1788361612.003080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429773696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361612.003115:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361612.003136:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1788361612.003143:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3650:x1875230429773952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361612.003152:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361612.003162:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0f000/0x1b69fa8920fe2631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe262a expref: 20 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.003170:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361612.003314:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429773952:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361612.003320:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1788361612.003369:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429773952:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1788361612.004451:0:88254:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1788361612.005299:0:86939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:0.0:1788361612.005399:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361612.005403:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788361612.005411:0:88254:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d006c8a000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361612.005423:0:88254:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d141653000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788361612.005424:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361612.005432:0:88254:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d005030800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361612.005450:0:88254:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d13fd98800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361612.005463:0:88254:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d13fd9e800 ec302d84-8f96-49d3-8682-aefc474f8448 192.168.204.35@tcp 11 (0 0 3) 0 0 0 2: ffff99d007283000 107374182412 stale:0 00010000:00010000:0.0:1788361612.005470:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361612.005471:0:88254:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99d006a03380) has exports, disconnecting them 00000020:00080000:2.0:1788361612.005480:0:88254:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d006c8a000), last request at 1788361598 00000020:00000080:2.0:1788361612.005489:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2830 00000100:00080000:2.0:1788361612.005499:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d006c89000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788361612.005510:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eae00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361612.005516:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361612.005534:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d006c8a000): rc 0 00000020:00000080:2.0:1788361612.005539:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d006c8a000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1788361612.005553:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788361612.005571:0:88254:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d141653000), last request at 1788361608 00000020:00000080:2.0:1788361612.005576:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2829 00000100:00080000:2.0:1788361612.005584:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788361612.005591:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.005611:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119de6700) 00010000:00010000:0.0:1788361612.005617:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00000080:2.0:1788361612.005649:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1788361612.005673:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788361612.005705:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d141653000): rc 0 00000020:00000080:3.0:1788361612.005709:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d141653000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788361612.005709:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006c89000 for lustre-MDT0000 00000020:00000080:2.0:1788361612.005729:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141653000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:3.0:1788361612.005730:0:88254:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d005030800), last request at 1788361608 00000020:00000080:3.0:1788361612.005745:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2822 00000100:00080000:3.0:1788361612.005756:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d005037800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788361612.005773:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141657800 for lustre-MDT0000 00000020:00080000:3.0:1788361612.005780:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d005030800): rc 0 00000020:00000080:3.0:1788361612.005783:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d005030800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788361612.005793:0:88254:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d13fd98800), last request at 1788361592 00000020:00000080:2.0:1788361612.005800:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005030800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361612.005809:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe268c 00000100:00080000:3.0:1788361612.005857:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788361612.005881:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d005037800 for lustre-MDT0000 00000020:00080000:3.0:1788361612.005914:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d13fd98800): rc 0 00000020:00000080:3.0:1788361612.005917:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d13fd98800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788361612.005929:0:88254:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.35@tcp (ffff99d13fd9e800), last request at 1788361610 00000020:00000080:3.0:1788361612.005933:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2685 00000020:00010000:3.0:1788361612.005940:0:88254:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d13fd9e800: total 1 00000020:00000080:2.0:1788361612.005942:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd98800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:3.0:1788361612.005944:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d141654000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788361612.005966:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d13fd9e800: total 1 00000020:00000080:2.0:1788361612.005982:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d005034000 for lustre-MDT0000 00010000:00010000:3.0:1788361612.006016:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d13fd9e800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1788361612.006044:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe2b86 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 10 pid: 67579 timeout: 2750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.006078:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe2a75 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d89 expref: 9 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.006097:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe2b9b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dd6 expref: 8 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.006107:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d13fd9e800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1788361612.006339:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006412:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe2b16 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006434:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006441:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006448:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006455:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361612.006458:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006465:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006487:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d119de6700) 00010000:00010000:0.0:1788361612.006490:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361612.006495:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006502:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2b4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006518:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006524:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006529:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006534:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361612.006537:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361612.006539:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361612.006545:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006555:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d007048d00) 00010000:00010000:0.0:1788361612.006558:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361612.006561:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361612.006566:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe2ba2 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361612.006571:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788361612.006895:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d13fd9e800): rc 0 00000004:00000080:2.0:1788361612.006906:0:88254:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa088191fae0 00000100:00080000:2.0:1788361612.006938:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788361612.006942:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788361612.010668:0:88254:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788361612.010717:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d1055ae800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361612.010974:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429774080:0@lo:39:umount.0 00000100:00100000:0.0:1788361612.011063:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361612.011142:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774080 00000100:00100000:0.0:1788361612.011151:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774080 00000100:00100000:1.0:1788361612.011341:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:1.0:1788361612.011355:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429774080:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788361612.011392:0:8449:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26cb 00000100:00080000:1.0:1788361612.011403:0:8449:0:(import.c:65:import_set_state_nolock()) ffff99d00541f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361612.011438:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411437 00000100:00100000:1.0:1788361612.011671:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3649:x1875230429774080:12345-0@lo:39:umount.0 Request processed in 318us (607us total) trans 77309411438 rc 0/0 00000100:00100000:1.0:1788361612.011682:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00080000:0.0:1788361612.011714:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1055ae800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788361612.011727:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429774080:0@lo:39:umount.0 00000100:00080000:2.0:1788361612.011818:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788361612.011897:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968747 gen 3 00000004:00080000:2.0:1788361612.011913:0:88254:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788361612.012410:0:88254:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788361612.012430:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d11e634800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361612.012485:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429774208:0@lo:9:umount.0 00000100:00100000:1.0:1788361612.012551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361612.012604:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788361612.012607:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 3 00000004:00080000:2.0:1788361612.012629:0:88254:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788361612.012715:0:88254:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788361612.012726:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d116c07800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361612.012759:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429774336:0@lo:9:umount.0 00000100:00100000:1.0:1788361612.012794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361612.012858:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774208 00000100:00100000:0.0:1788361612.012869:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774208 00000100:00100000:1.0:1788361612.012877:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774336 00000100:00100000:1.0:1788361612.012885:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774336 00000100:00100000:1.0:1788361612.012943:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884 00000100:00100000:1.0:1788361612.012953:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429774336:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788361612.012962:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4885 00000020:00000080:1.0:1788361612.012978:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26f5 00000100:00100000:0.0:1788361612.012978:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429774208:12345-0@lo:9:umount.0 00000100:00080000:1.0:1788361612.012989:0:15123:0:(import.c:65:import_set_state_nolock()) ffff99d10f55a000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788361612.013015:0:26159:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26e0 00000100:00080000:0.0:1788361612.013025:0:26159:0:(import.c:65:import_set_state_nolock()) ffff99d136d1a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361612.013040:0:15123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968748 00000001:00000004:0.0:1788361612.013088:0:26159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968747 00000100:00100000:0.0:1788361612.013275:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429774208:12345-0@lo:9:umount.0 Request processed in 302us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361612.013283:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4885 00000100:00080000:0.0:1788361612.013314:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361612.013321:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788361612.013340:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788361612.013360:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d006a03380) has no exports 00010000:00010000:0.0:1788361612.013372:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361612.013423:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c07800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788361612.013431:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788361612.013433:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361612.013439:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429774336:0@lo:9:umount.0 00000100:00100000:1.0:1788361612.013447:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429774336:12345-0@lo:9:umount.0 Request processed in 493us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361612.013458:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884 00000100:00080000:0.0:1788361612.013458:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d11e634800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788361612.013484:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788361612.013498:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361612.013502:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429774208:0@lo:9:umount.0 00010000:00010000:1.0:1788361612.013590:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788361612.014137:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d006a03380) has no exports 00000020:00000080:3.0:1788361612.087305:0:8455:0:(genops.c:906:class_export_put()) final put ffff99d13fd9e800/ec302d84-8f96-49d3-8682-aefc474f8448 00010000:00010000:3.0:1788361612.087378:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361612.087381:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361612.087385:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361612.087443:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9e800/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-MDT0000 00000020:00000080:1.0:1788361612.087519:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141654000 for lustre-MDT0000 00000020:00000080:2.0:1788361612.104668:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26a1 00000020:00000080:2.0:1788361612.104690:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d001c6d000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788361612.104736:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788361612.104800:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d001c6d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788361612.105018:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361612.105039:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361612.105045:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d136cb0000) has no exports 00000020:00000080:0.0:1788361612.105512:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe269a 00000020:00000080:0.0:1788361612.105520:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d12c4e5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361612.105591:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361612.105601:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361612.105604:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d12c4e7000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788361612.105608:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788361612.105630:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788361612.105674:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788361612.105802:0:88254:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d120e099c0 - data ffff99d0019a8ca8/ffff99d1377f8400 00000020:01000000:0.0:1788361612.106172:0:88254:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d136cfa7e0 - data ffff99d12cbaf5e8/ffff99d117146400 00000100:00080000:1.0:1788361612.145265:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788361612.145275:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361612.145289:0:88254:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d12cfe2300 x1875230429774080/t77309411438(77309411438) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361622 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361612.145312:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788361612.148520:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361612.148528:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968747 gen 4 00000004:00080000:1.0:1788361612.148538:0:88254:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361612.148540:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361612.149195:0:86956:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361612.149204:0:86956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:2.0:1788361612.149221:0:86956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:1.0:1788361612.150100:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361612.150106:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 4 00000004:00080000:1.0:1788361612.150126:0:88254:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361612.150141:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361612.150388:0:86958:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361612.150395:0:86958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:2.0:1788361612.150406:0:86958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:1.0:1788361612.151298:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2654 00000020:00000080:1.0:1788361612.151308:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d0021f8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361612.152230:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2669 00000020:00000080:1.0:1788361612.152237:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d13fd9a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361612.152243:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788361612.152248:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.152258:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361612.152262:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99d006a019c0) has no exports 00000004:01000000:1.0:1788361612.152412:0:88254:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788361612.152419:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26ee 00000020:00000080:1.0:1788361612.152423:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d116c01800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361612.152427:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361612.152430:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.152438:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361612.152440:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d001c619c0) has no exports 00000020:00000080:1.0:1788361612.152445:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26e7 00000020:00000080:1.0:1788361612.152449:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d13fd7a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361612.152535:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0021f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361612.152553:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788361612.152562:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c01800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361612.152568:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd7a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361612.152936:0:88254:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361612.152940:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361612.152944:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 5 00000004:00080000:1.0:1788361612.152948:0:88254:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361612.152951:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361612.153039:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.153048:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361612.153054:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26d2 00000020:00000080:1.0:1788361612.153058:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d11e637000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361612.153077:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d116c07800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361612.153082:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d11e636800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361612.153084:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e636800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788361612.153089:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361612.153192:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361612.153197:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.153203:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361612.153206:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99d1053199c0) has no exports 00000020:00000080:1.0:1788361612.153210:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26c4 00000020:00000080:1.0:1788361612.153214:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d11e637800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788361612.153579:0:88254:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361612.153583:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361612.153585:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968747 gen 5 00000004:00080000:1.0:1788361612.153589:0:88254:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361612.153590:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361612.153631:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e637000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788361612.153638:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e637800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361612.153644:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e634800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361612.153704:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.153711:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361612.153715:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d11e635000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361612.153718:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e635000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788361612.153723:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788361612.153880:0:88254:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788361612.153887:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26b6 00000020:00000080:1.0:1788361612.153892:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d11e634000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361612.153897:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788361612.153900:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.153905:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361612.153908:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99d10531cd40) has no exports 00000020:00000080:1.0:1788361612.153913:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe26af 00000020:00000080:1.0:1788361612.153915:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d1055ab000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361612.154252:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e634000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788361612.154270:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1055ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361612.164417:0:88254:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788361612.164427:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788361612.164431:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788361612.164440:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361612.164539:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.164555:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361612.164588:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.164592:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361612.164597:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d140d58800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361612.164602:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d58800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788361612.164612:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361612.164729:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2670 00000020:00000080:1.0:1788361612.164751:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d13fd9f000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788361612.164898:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1055ae800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788361612.164905:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d0021fb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361612.164907:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0021fb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788361612.164913:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361612.166556:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788361612.166571:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.166582:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361612.166586:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99d006a00000) has no exports 00000020:00000080:1.0:1788361612.166612:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.166629:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788361612.166635:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2677 00000020:00000080:1.0:1788361612.166642:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d13fd99000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788361612.166652:0:88254:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d136443800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788361612.166656:0:88254:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d136443800 3 00000020:00000080:3.0:1788361612.166657:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:1.0:1788361612.166660:0:88254:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d136443800 from lustre-MDT0000 00000020:00000080:3.0:1788361612.166665:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d140d5a800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788361612.166669:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d5a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788361612.166676:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788361612.166698:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.166703:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788361612.166706:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d0021fb800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788361612.166708:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0021fb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788361612.166719:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1788361612.166741:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd99000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788361612.166789:0:88254:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788361612.166793:0:88254:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788361612.166796:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788361612.166799:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.166802:0:88254:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788361612.166810:0:88254:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d11e630800 1f5c0251-1795-40ef-8392-cb147010b7b5 192.168.204.35@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361612.166816:0:88254:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d13fd15000 c8a6f36d-efb9-41cf-af98-5917323f2b0d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361612.166833:0:88254:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff99d006a04d40) has exports, disconnecting them 00000020:00080000:1.0:1788361612.166839:0:88254:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.35@tcp (ffff99d11e630800), last request at 1788361595 00000020:00000080:1.0:1788361612.166863:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe27ff 00000020:00010000:1.0:1788361612.167205:0:88254:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d11e630800: total 0 00000100:00080000:1.0:1788361612.167211:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d11e630000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788361612.167285:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d11e630800): rc 0 00000020:00080000:1.0:1788361612.167289:0:88254:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d13fd15000), last request at 1788361592 00000020:00000080:1.0:1788361612.167350:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe261c 00000020:00010000:1.0:1788361612.167354:0:88254:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d13fd15000: total 0 00000100:00080000:1.0:1788361612.167356:0:88254:0:(import.c:65:import_set_state_nolock()) ffff99d13fd12800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788361612.167380:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d11e630800: total 0 00010000:00010000:2.0:1788361612.167385:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361612.167435:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d11e630800, canceled 0 locks, left on hash table 4. 00000020:00080000:1.0:1788361612.167463:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d13fd15000): rc 0 00000020:00080000:1.0:1788361612.167467:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99d006a04d40) has no exports 00010000:00010000:2.0:1788361612.167475:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715d400/0x1b69fa8920fe2814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d74 expref: 5 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788361612.167480:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d13fd15000: total 0 00010000:00010000:2.0:1788361612.167497:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137158a00/0x1b69fa8920fe281b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d7b expref: 4 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.167512:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0e600/0x1b69fa8920fe280d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d6d expref: 3 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.167526:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137158800/0x1b69fa8920fe2806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710d66 expref: 2 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167527:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d13fd15000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788361612.167538:0:86945:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d107c21800:86945] 1 exiting: rc = 0 00010000:00010000:2.0:1788361612.167539:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d11e630800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1788361612.167555:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a82600/0x1b69fa8920fe27c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe27b9 expref: 14 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361612.167574:0:8454:0:(genops.c:906:class_export_put()) final put ffff99d11e630800/1f5c0251-1795-40ef-8392-cb147010b7b5 00010000:00010000:3.0:1788361612.167577:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139db5c00/0x1b69fa8920fe2750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2749 expref: 13 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.167587:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361612.167591:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361612.167593:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139db4200/0x1b69fa8920fe27ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe27c7 expref: 12 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361612.167595:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361612.167606:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139db4000/0x1b69fa8920fe275e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2757 expref: 11 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361612.167705:0:86943:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d107c20800:86943] 0 exiting: rc = 1 00010000:00010000:3.0:1788361612.167717:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0ec00/0x1b69fa8920fe276c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2765 expref: 10 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167733:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a82c00/0x1b69fa8920fe27ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe27e3 expref: 9 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167762:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a83e00/0x1b69fa8920fe277a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2773 expref: 8 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167784:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0e800/0x1b69fa8920fe27dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe27d5 expref: 7 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167800:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a83200/0x1b69fa8920fe2796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe278f expref: 6 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361612.167813:0:86948:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99d107c20c00:86948] 3 exiting: rc = 0 00010000:00010000:3.0:1788361612.167817:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d140d0fc00/0x1b69fa8920fe27f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe27f1 expref: 5 pid: 86945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167851:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d134a83400/0x1b69fa8920fe2788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2781 expref: 4 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361612.167855:0:86946:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d13c3c7600:86946] 2 exiting: rc = 0 00010000:00010000:3.0:1788361612.167872:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139db5e00/0x1b69fa8920fe27a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe279d expref: 3 pid: 86943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167896:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139db5200/0x1b69fa8920fe27b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe27ab expref: 2 pid: 86946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361612.167908:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d13fd15000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1788361612.167920:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788361612.167932:0:6511:0:(genops.c:906:class_export_put()) final put ffff99d13fd15000/c8a6f36d-efb9-41cf-af98-5917323f2b0d 00000100:00100000:1.0:1788361612.167932:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788361612.167939:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e630800/1f5c0251-1795-40ef-8392-cb147010b7b5 for MGS 00000100:00100000:1.0:1788361612.167943:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361612.167948:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361612.167953:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361612.167954:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361612.167957:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361612.167962:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd15000/c8a6f36d-efb9-41cf-af98-5917323f2b0d for MGS 00000020:00000080:2.0:1788361612.167992:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e630000 for MGS 00000020:00000080:2.0:1788361612.167996:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd12800 for MGS 00000100:00100000:1.0:1788361612.168033:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168042:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168058:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168071:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168078:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168083:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168089:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168095:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168099:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168104:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168109:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168115:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168121:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168129:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168135:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168141:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168148:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168154:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168160:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168165:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168172:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168177:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168183:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168200:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168207:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168215:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168223:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168229:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168235:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168240:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168244:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168250:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168253:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168259:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168264:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168269:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168275:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168281:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168286:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168291:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168297:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168301:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168306:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168311:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168315:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168320:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168324:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168329:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168334:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168339:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168345:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168350:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168357:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168366:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168374:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168382:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168392:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168397:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168413:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361612.168419:0:88254:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788361612.169248:0:88254:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d002f59d20 - data ffff99d12cbccbd0/ffff99d0055e7400 00000020:01000000:1.0:1788361612.169386:0:88254:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d120e09720 - data ffff99d12c8e9af8/ffff99d136fdc400 00000020:00000080:1.0:1788361612.170067:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2615 00000020:00000080:1.0:1788361612.170076:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d004107800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788361612.170092:0:88254:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d136443800 from MGS, refs=2 00000020:01000004:1.0:1788361612.170096:0:88254:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d136443800 2 00000020:01000004:1.0:1788361612.170100:0:88254:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d136443800 from MGS 00000020:00000080:2.0:1788361612.170109:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d004107800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361612.170126:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.170135:0:88254:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788361612.170139:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d004103000/MGS 00000020:00000080:1.0:1788361612.170142:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d004103000/MGS for MGS 00000020:01000000:1.0:1788361612.170150:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788361612.170242:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788361612.170253:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.170263:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788361612.170269:0:88254:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d140d58000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361612.170274:0:88254:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99d001c60000) has exports, disconnecting them 00000020:00080000:1.0:1788361612.170278:0:88254:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d140d58000), last request at 1788361592 00000020:00000080:1.0:1788361612.170282:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe272d 00000020:00080000:1.0:1788361612.170292:0:88254:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d140d58000): rc 0 00000020:00000080:1.0:1788361612.170296:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d140d58000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788361612.170316:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d58000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788361612.175664:0:88254:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788361612.175673:0:88254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361612.175677:0:88254:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788361612.175685:0:88254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361612.175746:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137ea5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788361612.175871:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361612.175885:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788361612.175890:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d116c02800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788361612.175894:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c02800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788361612.175912:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788361612.175981:0:88254:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d136443800 1 00000020:00000080:1.0:1788361612.175987:0:88254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2607 00000020:00000080:1.0:1788361612.175993:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d004100800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788361612.176011:0:88254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788361612.176015:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361612.176020:0:88254:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361612.176025:0:88254:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d10531b380) has no exports 00000020:00000080:2.0:1788361612.176044:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d004100800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361612.193064:0:88254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361612.193089:0:88254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788361612.193096:0:88254:0:(genops.c:906:class_export_put()) final put ffff99d136442000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361612.193101:0:88254:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136442000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788361612.193108:0:88254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788361612.193436:0:88254:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d136441000 00000020:02000400:2.0:1788361612.193512:0:88254:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788361612.374108:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361613.142095:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429774464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361613.142220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.142292:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361613.142296:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774464 00000100:00100000:2.0:1788361613.142309:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774464 00000100:00100000:3.0:1788361613.142318:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429774592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361613.142352:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361613.142405:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774592 00000100:00100000:2.0:1788361613.142410:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774592 00000100:00080000:1.0:1788361613.142450:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361613.142459:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361613.142584:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1788361613.142607:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429774464:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361613.142660:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1788361613.142672:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429774592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361613.142712:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788361613.142712:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361613.142782:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429774464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 187us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361613.142785:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429774592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361613.142797:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1788361613.142808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1788361613.142902:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429774592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361613.142927:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429774464:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788361613.398353:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361613.654570:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361613.654608:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429774976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361613.654674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.655119:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361613.655145:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429774720:0@lo:400:kworker.0 00000400:00000100:3.0:1788361613.655211:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429774720 offset 0 length 224: 4 00000100:00100000:1.0:1788361613.655351:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361613.655373:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429775488:0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.655403:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774976 00000100:00100000:2.0:1788361613.655414:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774976 00000100:00100000:1.0:1788361613.655432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361613.655479:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1788361613.655491:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3653:x1875230429774976:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788361613.655500:0:23938:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361613.655559:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3653:x1875230429774976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (877us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361613.655583:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1788361613.655770:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775488 00000100:00100000:2.0:1788361613.655774:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775488 00000100:00100000:3.0:1788361613.657946:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429774848:0@lo:400:kworker.0 00000100:00100000:3.0:1788361613.658036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.658086:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429775360:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.658220:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429775104:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.658294:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.658346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.658394:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:02020000:1.0:1788361613.658406:0:3653:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1788361613.658407:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429775232:0@lo:400:kworker.0 00000100:00080000:1.0:1788361613.658421:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361613.658429:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361613.658435:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788361613.658438:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774848 00000100:00080000:1.0:1788361613.658442:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788361613.658448:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774848 00000100:00100000:3.0:1788361613.658455:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361613.658457:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2638 00000100:00080000:1.0:1788361613.658469:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361613.658502:0:3653:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c7e680 x1875230429775616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361613.658563:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775104 00000100:00100000:3.0:1788361613.658571:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775104 00000100:00100000:1.0:1788361613.658577:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775360 00000100:00100000:1.0:1788361613.658585:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775360 00000100:00100000:2.0:1788361613.659633:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775232 00000100:00100000:2.0:1788361613.659644:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775232 00000100:00100000:0.0:1788361613.659910:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1788361613.659922:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1875230429775488:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361613.660017:0:80345:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361613.661161:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1875230429775488:12345-0@lo:400:kworker.0 Request processed in 1237us (5725us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361613.661173:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1788361613.661191:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788361613.661200:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429774848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361613.661201:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000020:00080000:2.0:1788361613.661210:0:66127:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361613.661252:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429774848:12345-0@lo:400:kworker.0 Request processed in 52us (3216us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361613.661268:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3651:x1875230429775232:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361613.661274:0:80345:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361613.661299:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3651:x1875230429775232:12345-0@lo:400:kworker.0 Request processed in 32us (2853us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361613.661728:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1788361613.661738:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1788361613.661776:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1788361613.661797:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429775104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361613.661848:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361613.661914:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429775616:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788361613.661992:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361613.662011:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361613.662016:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361613.662023:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361613.662027:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2638 00000100:00080000:3.0:1788361613.662037:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361613.662075:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c6dc00 x1875230429775744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361613.662120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429775232:0@lo:400:kworker.0 00000100:00100000:0.0:1788361613.662208:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361613.662257:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429775744:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788361613.662278:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429775104:12345-0@lo:400:kworker.0 Request processed in 488us (3979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361613.662289:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1788361613.662304:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361613.662366:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361613.662371:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361613.662375:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361613.662379:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361613.662382:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2638 00000100:00080000:3.0:1788361613.662394:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361613.662412:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c6c380 x1875230429775872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361613.662434:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429774848:0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.662452:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775744 00000100:00100000:2.0:1788361613.662461:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775744 00000100:00100000:0.0:1788361613.662478:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775616 00000100:00100000:0.0:1788361613.662490:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775616 00000100:00100000:2.0:1788361613.662512:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1788361613.662519:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429775744:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788361613.662543:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361613.662577:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:0.0:1788361613.662602:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429775616:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788361613.662621:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361613.662626:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361613.662629:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361613.662633:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00020000:0.0:1788361613.662635:0:23939:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788361613.662641:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2638 00000100:00080000:3.0:1788361613.662657:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361613.662680:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd47800 x1875230429776000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361613.662694:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429775488:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.662710:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1788361613.662725:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429775360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.662930:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429775744:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 407us (627us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361613.662944:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1788361613.662946:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429775104:0@lo:400:kworker.0 00000100:00100000:0.0:1788361613.662977:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429775616:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 383us (819us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361613.662988:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:0.0:1788361613.663030:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429775872:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361613.663060:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429775360:12345-0@lo:400:kworker.0 Request processed in 340us (4720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361613.663069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361613.663077:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1788361613.663114:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429775872 00000100:00100000:3.0:1788361613.663117:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429775360:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.663121:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429775872 00000100:00100000:0.0:1788361613.663121:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429776000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788361613.663152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361613.663158:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1788361613.663163:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429775872:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788361613.663175:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361613.663203:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429775872:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 38us (138us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361613.663208:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1788361613.663315:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776000 00000100:00100000:2.0:1788361613.663322:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776000 00000100:00080000:0.0:1788361613.663326:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361613.663334:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361613.663341:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429775744:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361613.663356:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788361613.663364:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429776000:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788361613.663374:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361613.663402:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429776000:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 37us (249us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788361613.663412:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361613.663417:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361613.663421:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429775616:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788361613.663448:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361613.663452:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361613.663455:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429775872:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788361613.663478:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361613.663482:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361613.663486:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429776000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361613.663679:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00010000:00010000:2.0:1788361614.422210:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361615.446259:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361616.264990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361616.265047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361616.265082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361616.265123:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986752 00000100:00100000:0.0:1788361616.265135:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986752 00000100:00100000:3.0:1788361616.265152:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986496 00000100:00100000:3.0:1788361616.265159:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986496 00000100:00100000:1.0:1788361616.265212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361616.265221:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1133 00000100:00100000:3.0:1788361616.265233:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1134 00000100:00100000:2.0:1788361616.265241:0:66141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986368 00000100:00100000:3.0:1788361616.265243:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1875230406986496:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361616.265255:0:66141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986368 00000020:00080000:3.0:1788361616.265261:0:67579:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000400:00000100:1.0:1788361616.265267:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406986240 offset 0 length 224: 4 00000100:00100000:1.0:1788361616.265300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361616.265301:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2410:x1875230406986752:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:2.0:1788361616.265317:0:66141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:2.0:1788361616.265330:0:66141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2410:x1875230406986368:12345-192.168.204.35@tcp:4:dd.0 00000020:00080000:2.0:1788361616.265340:0:66141:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:3.0:1788361616.265346:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1875230406986496:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 98us (293us total) trans 0 rc -107/-107 00000020:00080000:0.0:1788361616.265350:0:80345:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:3.0:1788361616.265361:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1134 00000100:00100000:1.0:1788361616.265364:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361616.265383:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986624 00000100:00100000:0.0:1788361616.265387:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2410:x1875230406986752:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 156us (408us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361616.265389:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986624 00000100:00100000:0.0:1788361616.265399:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1133 00000100:00100000:3.0:1788361616.265437:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 831 00000100:00100000:3.0:1788361616.265447:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406986624:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361616.265495:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406986624:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361616.265504:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 831 00000100:00100000:3.0:1788361616.265545:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986880 00000100:00100000:3.0:1788361616.265550:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986880 00000100:00100000:2.0:1788361616.265563:0:66141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2410:x1875230406986368:12345-192.168.204.35@tcp:4:dd.0 Request processed in 231us (475us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361616.265568:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406987008 00000100:00100000:0.0:1788361616.265576:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406987008 00000100:00100000:2.0:1788361616.265578:0:66141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00080000:2.0:1788361616.265644:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361616.265651:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361616.265655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361616.265699:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1824 00000100:00100000:0.0:1788361616.265717:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1825 00000100:00100000:3.0:1788361616.265726:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406986880:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361616.265734:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406987008:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361616.265774:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406986880:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 56us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361616.265775:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406987008:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361616.265790:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1824 00000100:00100000:0.0:1788361616.265797:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1825 00000100:00100000:1.0:1788361616.267009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361616.267049:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406987136 00000100:00100000:0.0:1788361616.267055:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406987136 00000100:00100000:0.0:1788361616.267082:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1135 00000100:00100000:0.0:1788361616.267087:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230406987136:12345-192.168.204.35@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1788361616.267104:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361616.267148:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230406987136:12345-192.168.204.35@tcp:38:ptlrpcd_01_00.0 Request processed in 59us (143us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361616.267167:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1135 00010000:00010000:1.0:1788361616.471938:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361617.494151:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361617.751656:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361617.751665:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d105492800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788361617.751733:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361617.751737:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d005419800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361617.751891:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d105492800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788361617.752025:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005419800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788361617.752110:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136d1a800 for lustre-OST0000 00000020:00000080:3.0:1788361617.752116:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d10f55a000 for lustre-OST0001 00000001:00100000:1.0:1788361617.752530:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788361617.752540:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411438 is committed 00000020:00000080:1.0:1788361617.752544:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d13fd10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361617.752582:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd10000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788361617.752765:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d00541f800 for lustre-MDT0001 00000100:00100000:1.0:1788361618.262346:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361618.262367:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429776256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361618.262444:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.262663:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776256 00000100:00100000:3.0:1788361618.262670:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776256 00000100:00100000:3.0:1788361618.262729:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1788361618.262737:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429776256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788361618.262761:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361618.262796:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429776256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361618.262801:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1788361618.262851:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429776256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361618.262871:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361618.262881:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429776128:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788361618.262889:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361618.262910:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361618.262980:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776128 00000100:00100000:1.0:1788361618.262983:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776128 00000100:00100000:1.0:1788361618.263016:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:1.0:1788361618.263021:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429776128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361618.263034:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361618.263222:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429776128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361618.263230:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429776128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361618.263232:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00080000:3.0:1788361618.263394:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788361618.518247:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361618.774147:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361618.774156:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361618.774178:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361618.774188:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2653 00000100:00080000:3.0:1788361618.774196:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361618.774205:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361618.774235:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44000 x1875230429776512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361618.774288:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361618.774293:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361618.774295:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361618.774299:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2653 00000100:00080000:3.0:1788361618.774304:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788361618.774305:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429776512:0@lo:38:kworker.0 00000100:00080000:3.0:1788361618.774309:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361618.774326:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd46300 x1875230429776768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361618.774347:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361618.774351:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361618.774353:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361618.774357:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2653 00000100:00080000:3.0:1788361618.774360:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361618.774364:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361618.774378:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44a80 x1875230429777024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361618.774389:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361618.774393:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361618.774400:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361618.774405:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2653 00000100:00080000:3.0:1788361618.774408:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361618.774413:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361618.774422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.774427:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44e00 x1875230429777152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361618.774477:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429776768:0@lo:38:kworker.0 00000100:00100000:3.0:1788361618.774499:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429776896:0@lo:400:kworker.0 00000100:00100000:3.0:1788361618.774536:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.774564:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361618.774570:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429776640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361618.774591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.774623:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776512 00000100:00100000:3.0:1788361618.774631:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776512 00000100:00100000:3.0:1788361618.774665:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776896 00000100:00100000:3.0:1788361618.774667:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776896 00000100:00100000:3.0:1788361618.774702:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776640 00000100:00100000:3.0:1788361618.774704:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776640 00000100:00100000:3.0:1788361618.774726:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1788361618.774736:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429776896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.774756:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361618.774767:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429777024:0@lo:38:kworker.0 00000100:00100000:2.0:1788361618.774796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.774806:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429776896:12345-0@lo:400:kworker.0 Request processed in 70us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361618.774815:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1788361618.774850:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429777152:0@lo:38:kworker.0 00000100:00100000:3.0:1788361618.774875:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429776768 00000100:00100000:2.0:1788361618.774880:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.774881:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429776768 00000100:00100000:3.0:1788361618.774895:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777152 00000100:00100000:3.0:1788361618.774898:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777152 00000100:00100000:3.0:1788361618.774911:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1788361618.774914:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777024 00000100:00100000:2.0:1788361618.774919:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777024 00000100:00100000:3.0:1788361618.774920:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.774945:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:2.0:1788361618.774950:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429777024:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361618.774964:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429776640:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00010000:00020000:2.0:1788361618.774971:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361618.774972:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1788361618.774990:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788361618.774996:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429776512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361618.775007:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361618.775016:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429777024:12345-0@lo:38:kworker.0 Request processed in 63us (217us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361618.775036:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429776512:12345-0@lo:38:kworker.0 Request processed in 39us (616us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361618.775042:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788361618.775051:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1788361618.775055:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429776768:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361618.775063:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361618.775088:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429776768:12345-0@lo:38:kworker.0 Request processed in 31us (332us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361618.775098:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1788361618.775098:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00100000:3.0:1788361618.775115:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1788361618.775120:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429777152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361618.775129:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788361618.775163:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361618.775170:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361618.775173:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429776768:0@lo:38:kworker.0 00000100:00100000:0.0:1788361618.775249:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788361618.775348:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361618.775406:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429776384:0@lo:400:kworker.0 00000100:00100000:3.0:1788361618.775447:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429777152:12345-0@lo:38:kworker.0 Request processed in 326us (569us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361618.775454:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00080000:2.0:1788361618.775556:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361618.775562:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361618.775566:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429777024:0@lo:38:kworker.0 00000400:00000100:0.0:1788361618.775575:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429776384 offset 0 length 224: 4 00000100:00080000:2.0:1788361618.775579:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361618.775584:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361618.775589:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429777152:0@lo:38:kworker.0 00000100:00100000:1.0:1788361618.775657:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429776640:0@lo:400:kworker.0 00000100:00100000:1.0:1788361618.775670:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429776896:0@lo:400:kworker.0 00000100:00080000:2.0:1788361618.775761:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361618.775766:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361618.775769:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429776512:0@lo:38:kworker.0 00010000:00010000:3.0:1788361619.543210:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361620.565986:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788361621.383817:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406987264 offset 0 length 224: 4 00000100:00100000:1.0:1788361621.383881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361621.383909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361621.383966:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361621.384051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361621.384079:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406987520 00000100:00100000:1.0:1788361621.384088:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406987520 00000100:00100000:3.0:1788361621.384108:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406987648 00000100:00100000:3.0:1788361621.384113:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406987648 00000100:00100000:3.0:1788361621.384142:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406987776 00000100:00100000:1.0:1788361621.384142:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406987392 00000100:00100000:3.0:1788361621.384150:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406987776 00000100:00100000:1.0:1788361621.384151:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406987392 00000100:00100000:1.0:1788361621.384169:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 834 00000100:00100000:3.0:1788361621.384170:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1826 00000100:00100000:3.0:1788361621.384178:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406987648:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361621.384178:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406987520:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361621.384247:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:ec302d84-8f96-49d3-8682-aefc474f8448+5:2411:x1875230406987648:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361621.384266:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1826 00000100:00100000:2.0:1788361621.384278:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1139 00000100:00100000:3.0:1788361621.384280:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1827 00000100:00100000:3.0:1788361621.384285:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406987776:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361621.384285:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230406987392:12345-192.168.204.35@tcp:38:kworker.0 00000100:00080000:0.0:1788361621.384347:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361621.384352:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361621.384354:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:2.0:1788361621.384463:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361621.384855:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406987520:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 676us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361621.384863:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 834 00000100:00100000:3.0:1788361621.384883:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:ec302d84-8f96-49d3-8682-aefc474f8448+5:2412:x1875230406987776:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 597us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361621.384891:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1827 00000100:00100000:2.0:1788361621.385094:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230406987392:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 807us (1041us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361621.385101:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1139 00010000:00010000:3.0:1788361621.590028:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361622.614287:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361623.382199:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429777280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361623.382208:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429777408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361623.382311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361623.382762:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777280 00000100:00100000:2.0:1788361623.382793:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777280 00000100:00100000:2.0:1788361623.382897:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1788361623.382907:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429777280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361623.382958:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788361623.383441:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361623.383463:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361623.383488:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777408 00000100:00100000:0.0:1788361623.383496:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777408 00000100:00100000:2.0:1788361623.383534:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429777280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 626us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361623.383545:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1788361623.383552:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:0.0:1788361623.383562:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429777408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788361623.383587:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361623.383640:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429777408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361623.383647:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00080000:0.0:1788361623.383725:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361623.383774:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429777408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361623.383872:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429777280:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788361623.638960:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361623.894397:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361623.894404:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361623.894407:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788361623.894427:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429777536:0@lo:400:kworker.0 00000100:00080000:0.0:1788361623.894437:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2658 00000100:00080000:0.0:1788361623.894442:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361623.894449:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361623.894475:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10695c700 x1875230429777664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788361623.894485:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429777536 offset 0 length 224: 4 00000100:00080000:0.0:1788361623.894521:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361623.894525:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361623.894527:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361623.894531:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2658 00000100:00080000:0.0:1788361623.894535:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1788361623.894537:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788361623.894540:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361623.894547:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429777792:0@lo:400:kworker.0 00000100:00100000:0.0:1788361623.894558:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10695d880 x1875230429777920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361623.894587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361623.894589:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361623.894594:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361623.894596:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361623.894600:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2658 00000100:00080000:0.0:1788361623.894604:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361623.894608:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361623.894624:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10695f480 x1875230429778176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361623.894631:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777792 00000100:00080000:0.0:1788361623.894635:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788361623.894640:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777792 00000100:00080000:0.0:1788361623.894640:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361623.894644:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361623.894656:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2658 00000100:00080000:0.0:1788361623.894658:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361623.894662:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361623.894678:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10695fb80 x1875230429778304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361623.894706:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429778048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.894711:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1788361623.894718:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429777664:0@lo:38:kworker.0 00000100:00100000:1.0:1788361623.894725:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429777792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361623.894742:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361623.894775:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778048 00000100:00100000:3.0:1788361623.894779:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778048 00000100:00100000:1.0:1788361623.894814:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429777792:12345-0@lo:400:kworker.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361623.894817:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1788361623.894845:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429777792:0@lo:400:kworker.0 00000100:00100000:3.0:1788361623.894851:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429778048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.894866:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1788361623.894904:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429778048:12345-0@lo:400:kworker.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361623.894913:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1788361623.894925:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429778048:0@lo:400:kworker.0 00000100:00080000:2.0:1788361623.894928:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361623.894952:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361623.894983:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429777920:0@lo:38:kworker.0 00000100:00100000:3.0:1788361623.895007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361623.895025:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777664 00000100:00100000:2.0:1788361623.895031:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777664 00000100:00100000:3.0:1788361623.895040:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429778176:0@lo:38:kworker.0 00000100:00100000:2.0:1788361623.895061:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429777920 00000100:00100000:2.0:1788361623.895065:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429777920 00000100:00100000:3.0:1788361623.895070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361623.895089:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1788361623.895095:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429777664:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788361623.895114:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361623.895149:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429777664:12345-0@lo:38:kworker.0 Request processed in 53us (199us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361623.895156:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1788361623.895184:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788361623.895190:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429778304:0@lo:38:kworker.0 00000100:00100000:2.0:1788361623.895192:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429777920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788361623.895207:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361623.895221:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361623.895247:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429777920:12345-0@lo:38:kworker.0 Request processed in 55us (237us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361623.895254:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00080000:3.0:1788361623.895259:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361623.895266:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361623.895268:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778304 00000100:00100000:3.0:1788361623.895271:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429777664:0@lo:38:kworker.0 00000100:00100000:2.0:1788361623.895273:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778304 00000100:00080000:3.0:1788361623.895286:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361623.895290:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361623.895294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429777920:0@lo:38:kworker.0 00000100:00100000:2.0:1788361623.895298:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1788361623.895311:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429778304:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788361623.895322:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361623.895355:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429778304:12345-0@lo:38:kworker.0 Request processed in 43us (134us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361623.895360:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1788361623.896227:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778176 00000100:00100000:0.0:1788361623.896234:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778176 00000100:00100000:0.0:1788361623.896270:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1788361623.896277:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429778176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788361623.896290:0:23939:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361623.896332:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429778176:12345-0@lo:38:kworker.0 Request processed in 55us (1263us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361623.896339:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00080000:3.0:1788361623.896372:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361623.896379:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361623.896382:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429778176:0@lo:38:kworker.0 00000100:00080000:3.0:1788361623.896403:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361623.896407:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361623.896411:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429778304:0@lo:38:kworker.0 00010000:00010000:1.0:1788361624.661940:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361625.686215:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788361626.505755:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230406987904 offset 0 length 224: 4 00000100:00100000:1.0:1788361626.506904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361626.506951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361626.506986:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361626.507026:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988160 00000100:00100000:0.0:1788361626.507044:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988160 00000100:00100000:0.0:1788361626.507131:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988032 00000100:00100000:0.0:1788361626.507134:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988032 00000100:00100000:0.0:1788361626.507168:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 837 00000100:00100000:0.0:1788361626.507183:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406988160:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361626.507274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361626.507304:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230406988160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 123us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361626.507446:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1143 00000100:00100000:3.0:1788361626.507457:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230406988032:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:3.0:1788361626.507484:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361626.507545:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 837 00000100:00100000:3.0:1788361626.507556:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230406988032:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 95us (600us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361626.507570:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1143 00000100:00100000:0.0:1788361626.507613:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988288 00000100:00100000:0.0:1788361626.507620:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988288 00000100:00100000:1.0:1788361626.507960:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988416 00000100:00100000:1.0:1788361626.507970:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988416 00000100:00100000:0.0:1788361626.508067:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4886 00000100:00100000:0.0:1788361626.508091:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+5:2408:x1875230406988288:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:0.0:1788361626.508145:0:26162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2884 00000100:00080000:0.0:1788361626.508169:0:26162:0:(import.c:65:import_set_state_nolock()) ffff99d141656000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361626.508268:0:26162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968747 00000100:00100000:0.0:1788361626.508985:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230406988288:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 894us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361626.509028:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4886 00010000:00010000:0.0:1788361626.509914:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361626.510870:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361626.510882:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361626.510887:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361626.511309:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4887 00000100:00100000:1.0:1788361626.511325:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+5:2408:x1875230406988416:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788361626.511367:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe288b 00000100:00080000:1.0:1788361626.511378:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99d106089000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361626.511435:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968748 00010000:00010000:0.0:1788361626.511474:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361626.511777:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230406988416:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 457us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361626.511787:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4887 00010000:00010000:1.0:1788361626.710040:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361627.734077:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361628.502098:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429778432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361628.502196:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361628.502872:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778432 00000100:00100000:2.0:1788361628.502883:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778432 00000100:00100000:2.0:1788361628.502954:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1788361628.502957:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429778560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361628.502966:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429778432:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361628.502988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788361628.503000:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361628.503026:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778560 00000100:00100000:0.0:1788361628.503030:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778560 00000100:00100000:2.0:1788361628.503051:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429778432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361628.503056:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1788361628.503060:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1788361628.503063:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429778560:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788361628.503083:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361628.503087:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788361628.503087:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361628.503120:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429778560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361628.503126:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1788361628.503151:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429778432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361628.503158:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429778560:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788361628.758449:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788361628.912721:0:88873:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788361628.912729:0:88873:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788361628.912730:0:88873:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788361628.913245:0:88873:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d13fd79000 00000020:01000004:3.0:1788361628.913323:0:88873:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788361628.913340:0:88873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788361628.913355:0:88873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d001c619c0) 00000020:00000080:3.0:1788361628.913378:0:88873:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788361628.989944:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788361628.992414:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788361628.994010:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788361628.994524:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788361628.996509:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788361628.996858:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788361628.997121:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788361628.997401:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788361628.997631:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788361628.997872:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788361628.998206:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.001497:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.002134:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.002407:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.002651:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.002906:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.003140:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.003413:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.003666:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.003902:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.004097:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.004365:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.004605:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.004873:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.005097:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.005399:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.005645:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.005870:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.006111:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.006323:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.006520:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.006849:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.007041:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788361629.007403:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788361629.008547:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000100:00100000:0.0:1788361629.014008:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429778688:0@lo:400:kworker.0 00000400:00000100:0.0:1788361629.014063:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429778688 offset 0 length 224: 4 00000100:00080000:1.0:1788361629.014139:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361629.014144:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361629.014148:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361629.014154:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2663 00000100:00080000:1.0:1788361629.014159:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788361629.014166:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361629.014190:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa6d80 x1875230429778816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361629.014232:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361629.014235:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361629.014245:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361629.014249:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2663 00000100:00080000:1.0:1788361629.014252:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788361629.014255:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361629.014268:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa6300 x1875230429779072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361629.014284:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361629.014304:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361629.014306:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361629.014309:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2663 00000100:00080000:1.0:1788361629.014312:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788361629.014316:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361629.014328:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa4380 x1875230429779328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361629.014367:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429779456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361629.014388:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429778816:0@lo:38:kworker.0 00000100:00100000:2.0:1788361629.014491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.014507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361629.014510:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361629.014513:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361629.014516:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361629.014521:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2663 00000100:00080000:1.0:1788361629.014524:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1788361629.014528:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788361629.014529:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361629.014539:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429779072:0@lo:38:kworker.0 00000100:00100000:2.0:1788361629.014541:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429779584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.014547:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa5c00 x1875230429779712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361629.014582:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429779200:0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.014588:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429778944:0@lo:400:kworker.0 00000100:00100000:3.0:1788361629.014647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361629.014660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.014669:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429779328:0@lo:38:kworker.0 00000100:00100000:3.0:1788361629.014697:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361629.014701:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779456 00000100:00100000:2.0:1788361629.014709:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779456 00000100:00100000:3.0:1788361629.014728:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429779712:0@lo:38:kworker.0 00000100:00100000:0.0:1788361629.014759:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361629.014768:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779584 00000100:00100000:3.0:1788361629.014771:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778816 00000100:00100000:2.0:1788361629.014773:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779584 00000100:00100000:3.0:1788361629.014777:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778816 00000100:00100000:1.0:1788361629.014778:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779072 00000100:00100000:1.0:1788361629.014787:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779072 00000100:00100000:3.0:1788361629.014809:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779200 00000100:00100000:3.0:1788361629.014812:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779200 00000100:00100000:1.0:1788361629.014817:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1788361629.014848:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429778816:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361629.014855:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1788361629.014863:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429779072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361629.014868:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361629.014874:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00010000:00020000:0.0:1788361629.014878:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361629.014884:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429779200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.014912:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429778816:12345-0@lo:38:kworker.0 Request processed in 65us (416us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361629.014919:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1788361629.014938:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429779072:12345-0@lo:38:kworker.0 Request processed in 73us (289us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361629.014948:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1788361629.014949:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429779200:12345-0@lo:400:kworker.0 Request processed in 65us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.014952:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.014959:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1788361629.014972:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429778944 00000100:00100000:0.0:1788361629.014977:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429778944 00000100:00100000:2.0:1788361629.014987:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:1.0:1788361629.014992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361629.015001:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361629.015014:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779712 00000100:00100000:3.0:1788361629.015019:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779712 00000100:00100000:0.0:1788361629.015019:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00080000:1.0:1788361629.015023:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361629.015029:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361629.015034:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429778816:0@lo:38:kworker.0 00000100:00080000:1.0:1788361629.015046:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788361629.015048:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429778944:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361629.015053:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361629.015059:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429779456:12345-0@lo:400:kworker.0 Request processed in 60us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.015060:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429779072:0@lo:38:kworker.0 00000100:00100000:2.0:1788361629.015073:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1788361629.015093:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1788361629.015101:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429779584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.015120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429779200:0@lo:400:kworker.0 00000100:00100000:2.0:1788361629.015140:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429779584:12345-0@lo:400:kworker.0 Request processed in 39us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.015146:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1788361629.015170:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779328 00000100:00100000:2.0:1788361629.015173:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779328 00000100:00100000:3.0:1788361629.015208:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1788361629.015215:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429779712:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361629.015226:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788361629.015234:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361629.015261:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429779712:12345-0@lo:38:kworker.0 Request processed in 45us (272us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361629.015267:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00080000:1.0:1788361629.015271:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361629.015275:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361629.015277:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429779712:0@lo:38:kworker.0 00000100:00100000:2.0:1788361629.015328:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1788361629.015336:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429779328:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361629.015343:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429778944:12345-0@lo:400:kworker.0 Request processed in 311us (389us total) trans 0 rc 0/0 00010000:00020000:2.0:1788361629.015352:0:8448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361629.015353:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1788361629.015395:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429779328:12345-0@lo:38:kworker.0 Request processed in 59us (697us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788361629.015436:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361629.015441:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361629.015444:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429779328:0@lo:38:kworker.0 00000100:00100000:3.0:1788361629.015464:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429778944:0@lo:400:kworker.0 00000100:00100000:2.0:1788361629.015471:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00100000:1.0:1788361629.015480:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429779584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.015507:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429779456:0@lo:400:kworker.0 00100000:10000000:0.0:1788361629.018813:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788361629.019856:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788361629.020399:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788361629.020635:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788361629.020815:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.021432:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788361629.021758:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.022007:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.022361:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.022603:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.022850:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788361629.023096:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.025927:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.026524:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.027367:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.030591:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.031003:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788361629.031356:0:88873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1788361629.031904:0:88873:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788361629.032191:0:88873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788361629.032200:0:88873:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788361629.032210:0:88873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2bb0 00000020:01000004:0.0:1788361629.032217:0:88873:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788361629.032230:0:88873:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788361629.032235:0:88873:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d13fd79000 from MGS 00000020:01000004:0.0:1788361629.032239:0:88873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788361629.032250:0:88873:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d10531b380) 00000020:00000080:0.0:1788361629.032337:0:88873:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:0.0:1788361629.032404:0:88873:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d13fd79000 from MGS, refs=2 00080000:01000000:0.0:1788361629.032409:0:88873:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788361629.032413:0:88873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2bbe 00010000:00010000:0.0:1788361629.032527:0:88873:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788361629.038256:0:88873:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788361629.040229:0:88877:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788361629.040322:0:88873:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788361629.040375:0:88873:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361629.041012:0:88873:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788361629.043441:0:88873:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361629.043613:0:88873:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788361629.043620:0:88873:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788361629.044374:0:88873:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788361629.044384:0:88873:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788361629.045237:0:88873:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788361629.045247:0:88873:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788361629.046929:0:88873:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788361629.046956:0:88873:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788361629.046958:0:88873:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788361629.046962:0:88873:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1788361629.046976:0:88873:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788361629.046982:0:88873:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788361629.046986:0:88873:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788361629.046988:0:88873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788361629.046997:0:88873:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d12cfe1c00 x1875230429774720/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361629 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361629.047026:0:88873:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d12cd45880 x1875230429776384/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361634 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361629.047049:0:88873:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d10695e300 x1875230429777536/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361639 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361629.047061:0:88873:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d10eaa5500 x1875230429778688/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361645 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788361629.047071:0:88873:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788361629.047074:0:88873:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788361629.047075:0:88873:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788361629.047078:0:88873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1788361629.047166:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429776384:0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.047178:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429774720:0@lo:400:kworker.0 00000100:00100000:0.0:1788361629.047220:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429778688:0@lo:400:kworker.0 00000100:00100000:1.0:1788361629.047225:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429777536:0@lo:400:kworker.0 10000000:01000000:2.0:1788361629.047282:0:88873:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788361629.047309:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047320:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047326:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788361629.047344:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047354:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db5600/0x1b69fa8920fe27e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047370:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047389:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047394:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047398:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047402:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0f200/0x1b69fa8920fe2749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047411:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047418:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047423:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047426:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047429:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a83600/0x1b69fa8920fe2765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe276c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047438:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047444:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047450:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047453:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047456:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db4a00/0x1b69fa8920fe278f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2796 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047476:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047483:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047489:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047493:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047499:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a83c00/0x1b69fa8920fe279d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047508:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047515:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047520:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047524:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047529:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0fa00/0x1b69fa8920fe27b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047539:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047546:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047551:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047618:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047624:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137159e00/0x1b69fa8920fe27c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047635:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047642:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047647:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047652:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047658:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db4c00/0x1b69fa8920fe27f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047671:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047677:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047682:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047696:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047700:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d140d0fe00/0x1b69fa8920fe2757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047715:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047721:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047737:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361629.047741:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047745:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a82000/0x1b69fa8920fe2773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe277a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047757:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047763:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047768:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788361629.047772:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047776:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a82200/0x1b69fa8920fe2781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047787:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047793:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047799:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788361629.047803:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.047808:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a83000/0x1b69fa8920fe27ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.047817:0:88873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361629.047918:0:88873:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361629.047924:0:88873:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788361629.048054:0:88873:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788361629.048060:0:88873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d134a83800/0x1b69fa8920fe27d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe27dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361629.048076:0:88873:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99d1054f2000 already not connected (conn 49, was 0): DISCONN 00000100:00080000:2.0:1788361629.048081:0:88873:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361629.048086:0:88873:0:(import.c:510:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 2632 00000100:00080000:2.0:1788361629.048093:0:88873:0:(import.c:624:import_select_connection()) MGC192.168.204.135@tcp: import ffff99d1054f2000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361629.048123:0:88873:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cfe2680 x1875230429779840/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361629.048180:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429779840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788361629.048250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.048325:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779840 00000100:00080000:2.0:1788361629.048326:0:88873:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788361629.048335:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779840 00000100:00100000:0.0:1788361629.048376:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361629.048383:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875230429779840:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788361629.048409:0:88879:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo t0 exp 0000000000000000 cur 2669 last 0 00000020:00000080:0.0:1788361629.048434:0:88879:0:(genops.c:1406:class_connect()) connect: client c8a6f36d-efb9-41cf-af98-5917323f2b0d, cookie 0x1b69fa8920fe2bc5 00000100:00080000:0.0:1788361629.048611:0:88879:0:(import.c:65:import_set_state_nolock()) ffff99d006c8c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361629.048677:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:3649:x1875230429779840:12345-0@lo:250:mount.lustre.0 Request processed in 293us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.048685:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361629.049084:0:3649:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 26 00000100:00080000:2.0:1788361629.049094:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361629.049101:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361629.049104:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361629.049108:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361629.049110:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361629.049140:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361629.049150:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429779840:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788361629.049173:0:88873:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788361629.049183:0:88873:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788361629.049216:0:88873:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788361629.049221:0:88873:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788361629.049339:0:88873:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000000:3.0:1788361629.049358:0:48377:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.135@tcp 00000020:01000004:2.0:1788361629.049371:0:88873:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 10000000:01000000:3.0:1788361629.049375:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788361629.049376:0:88873:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361629.049381:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788361629.049381:0:88873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361629.049383:0:88873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361629.049385:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361629.049386:0:88873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361629.049389:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361629.049390:0:88873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361629.049394:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361629.049394:0:88873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361629.049397:0:88873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361629.049398:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361629.049400:0:88873:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361629.049402:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361629.049404:0:88873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361629.049405:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361629.049408:0:88873:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361629.049409:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 10000000:01000000:2.0:1788361629.049412:0:88873:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788361629.049415:0:88873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361629.049419:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:2.0:1788361629.049419:0:88873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361629.049423:0:88873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361629.049424:0:88873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361629.049425:0:88873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361629.049427:0:88873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361629.049428:0:88873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361629.049429:0:88873:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361629.049431:0:88873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361629.049432:0:88873:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788361629.049447:0:88873:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788361629.049459:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780096:0@lo:253:mount.lustre.0 00000020:01000000:3.0:1788361629.049461:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788361629.049471:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788361629.049473:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361629.049474:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361629.049476:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361629.049477:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361629.049479:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361629.049480:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361629.049482:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361629.049483:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361629.049484:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788361629.049501:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788361629.049502:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1788361629.049508:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788361629.049510:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788361629.049511:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788361629.049512:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361629.049513:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361629.049514:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361629.049515:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361629.049516:0:48377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361629.049517:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361629.049518:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788361629.049535:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788361629.049570:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429780224:0@lo:253:kworker.0 00000100:00100000:3.0:1788361629.049604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.049642:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361629.049651:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429779968:0@lo:253:kworker.0 00000100:00100000:0.0:1788361629.049669:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361629.049682:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429780352:0@lo:253:kworker.0 00000100:00100000:3.0:1788361629.049683:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.049725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.049810:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780224 00000100:00100000:3.0:1788361629.049815:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780224 00000100:00100000:3.0:1788361629.050016:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429779968 00000100:00100000:3.0:1788361629.050021:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429779968 00000100:00100000:3.0:1788361629.050031:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780352 00000100:00100000:3.0:1788361629.050033:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780352 00000100:00100000:3.0:1788361629.050043:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361629.050057:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3651:x1875230429780224:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788361629.050082:0:88881:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788361629.050258:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361629.050267:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3651:x1875230429779968:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788361629.050283:0:88880:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1788361629.050349:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0180 going to sleep for 11 seconds 10000000:01000000:2.0:1788361629.050601:0:88882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788361629.050700:0:88881:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 111 00000100:00100000:0.0:1788361629.054684:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780096 20000000:01000000:3.0:1788361629.054687:0:88883:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788361629.054696:0:88883:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000100:00100000:0.0:1788361629.054701:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780096 20000000:01000000:3.0:1788361629.054702:0:88883:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788361629.054707:0:88883:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788361629.055910:0:88883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788361629.056143:0:88881:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361629.056166:0:88881:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361629.058892:0:88881:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361629.058913:0:88880:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361629.058940:0:88881:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788361629.059241:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429780224:12345-0@lo:253:kworker.0 Request processed in 9180us (9633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.059259:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361629.059327:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361629.059338:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3653:x1875230429780352:12345-0@lo:253:kworker.0 00000020:01000004:0.0:1788361629.059348:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788361629.059352:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361629.059353:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361629.059355:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361629.059356:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361629.059357:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361629.059359:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361629.059361:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361629.059362:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:1.0:1788361629.059366:0:88881:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788361629.059366:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429780224:0@lo:253:kworker.0 20000000:01000000:3.0:1788361629.059552:0:88882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788361629.059557:0:88882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788361629.059690:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059707:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361629.059717:0:88882:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000161335s 00010000:00010000:3.0:1788361629.059723:0:88882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059731:0:88882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059738:0:88882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059745:0:88882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059751:0:88882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361629.059756:0:88882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059785:0:88882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059798:0:88882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059806:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.059813:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2bcc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361629.062624:0:88881:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788361629.062957:0:88880:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361629.063036:0:88880:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788361629.063106:0:88882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788361629.063113:0:88882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788361629.063205:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063229:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361629.063240:0:88882:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000161335s 00010000:00010000:3.0:1788361629.063246:0:88882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063253:0:88882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063260:0:88882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063267:0:88882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063302:0:88882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361629.063307:0:88882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063317:0:88882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063332:0:88882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063340:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.063346:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bf800/0x1b69fa8920fe2bd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361629.071685:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3651:x1875230429779968:12345-0@lo:253:kworker.0 Request processed in 21404us (21988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.071711:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1788361629.071748:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788361629.071777:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361629.071779:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361629.071782:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:2.0:1788361629.071786:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1788361629.071786:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361629.071790:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361629.071792:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361629.071795:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361629.071796:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788361629.071806:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429779968:0@lo:253:kworker.0 00000100:00100000:2.0:1788361629.071819:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:88873:x1875230429780096:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361629.071893:0:88881:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361629.071912:0:88881:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788361629.071977:0:88880:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788361629.071981:0:88880:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788361629.071984:0:88880:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788361629.071993:0:88880:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788361629.072109:0:88882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361629.072115:0:88882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361629.072145:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072162:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361629.072173:0:88882:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000161335s 00010000:00010000:1.0:1788361629.072178:0:88882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072186:0:88882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072193:0:88882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072200:0:88882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072208:0:88882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361629.072212:0:88882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072234:0:88882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072248:0:88882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072255:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.072261:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2bda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361629.072602:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:3653:x1875230429780352:12345-0@lo:253:kworker.0 Request processed in 13263us (22874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.072613:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1788361629.072910:0:3653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788361629.072914:0:3653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788361629.072916:0:3653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361629.072917:0:3653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361629.072919:0:3653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361629.072920:0:3653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361629.072933:0:3653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361629.072935:0:3653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361629.072936:0:3653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788361629.072941:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429780352:0@lo:253:kworker.0 00000100:00100000:2.0:1788361629.073159:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:88873:x1875230429780096:12345-0@lo:253:mount.lustre.0 Request processed in 1347us (23656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.073167:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361629.073249:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361629.073265:0:88873:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788361629.073267:0:88873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361629.073268:0:88873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361629.073270:0:88873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361629.073271:0:88873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361629.073272:0:88873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361629.073273:0:88873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361629.073274:0:88873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361629.073276:0:88873:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361629.073277:0:88873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361629.073278:0:88873:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361629.073310:0:88873:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d13fd79000 from lustre-MDT0000 10000000:01000000:0.0:1788361629.073347:0:88873:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788361629.073350:0:88873:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788361629.073361:0:88873:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d13fd79000 10000000:01000000:0.0:1788361629.073366:0:88873:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361629.073372:0:88873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99d13fd79000 10000000:01000000:0.0:1788361629.073374:0:88873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788361629.073378:0:88873:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d13fd79000 from 1 10000000:01000000:0.0:1788361629.073381:0:88873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361629.073423:0:88873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.073434:0:88873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.073444:0:88873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.073477:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361629.073520:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.073606:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1039293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.074416:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780480 00000100:00100000:2.0:1788361629.074428:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780480 00000100:00100000:2.0:1788361629.074489:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361629.074499:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:88873:x1875230429780480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361629.074517:0:88879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361629.074539:0:88879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe2be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2be1 expref: -99 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.074570:0:88879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2be1 expref: 6 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.074584:0:88879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2be1 expref: 6 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.074595:0:88879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea800, rc 0) 00000100:00100000:2.0:1788361629.074721:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:88873:x1875230429780480:12345-0@lo:101:mount.lustre.0 Request processed in 223us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.074728:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361629.075384:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361629.075408:0:88873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.075419:0:88873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361629.075439:0:88873:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788361629.075454:0:88873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.075460:0:88873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361629.075468:0:88873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788361629.075475:0:88873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361629.075483:0:88873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d13fd79000 10000000:01000000:0.0:1788361629.075487:0:88873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788361629.075492:0:88873:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788361629.075494:0:88873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361629.075532:0:88873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.075541:0:88873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.075563:0:88873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.075584:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361629.075627:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.075667:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1039293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.076049:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780608 00000100:00100000:2.0:1788361629.076056:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780608 00000100:00100000:2.0:1788361629.076098:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361629.076115:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:88873:x1875230429780608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361629.076130:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361629.076142:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe2bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2bef expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.076172:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe2bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2bef expref: 7 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.076182:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe2bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2bef expref: 7 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.076190:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eba00, rc 0) 00000100:00100000:1.0:1788361629.076275:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361629.076299:0:88873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.076307:0:88873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361629.076381:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361629.076424:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:88873:x1875230429780608:12345-0@lo:101:mount.lustre.0 Request processed in 310us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.076431:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361629.076606:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361629.076644:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361629.076683:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780736 00000100:00100000:3.0:1788361629.076689:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780736 00000100:00100000:3.0:1788361629.076724:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361629.076732:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:88873:x1875230429780736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361629.076997:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88873:x1875230429780736:12345-0@lo:501:mount.lustre.0 Request processed in 265us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.077006:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361629.077011:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361629.077053:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361629.077099:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.077554:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780864 00000100:00100000:0.0:1788361629.077562:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780864 00000100:00100000:1.0:1788361629.077568:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361629.077606:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361629.077615:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88873:x1875230429780864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361629.078805:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88873:x1875230429780864:12345-0@lo:503:mount.lustre.0 Request processed in 1185us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.078818:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361629.079034:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429780864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361629.079783:0:88884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88884:1875230429780992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361629.079951:0:88884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361629.080039:0:88884:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361629.084032:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429780992 00000100:00100000:3.0:1788361629.084054:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429780992 00000100:00100000:3.0:1788361629.084147:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361629.084159:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88884:x1875230429780992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361629.086218:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88884:x1875230429780992:12345-0@lo:502:llog_process_th.0 Request processed in 2051us (6257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.086235:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361629.086382:0:88884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88884:1875230429780992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361629.086427:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361629.086442:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.086445:0:88884:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361629.086451:0:88884:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788361629.086454:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361629.086474:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d136cb19c0) 00000020:00000080:2.0:1788361629.086505:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788361629.086512:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788361629.086620:0:88884:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788361629.086639:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2c04 00000020:00000080:2.0:1788361629.087071:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788361629.087077:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361629.087081:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.087083:0:88884:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361629.087086:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361629.087090:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.087091:0:88884:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788361629.087095:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361629.087104:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d136cb4d40) 00000020:00000080:2.0:1788361629.087118:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788361629.087123:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788361629.087125:0:88884:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788361629.087129:0:88884:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788361629.087136:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361629.087197:0:88884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d13fd79000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788361629.087212:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d136cb0000) 00000020:00000080:2.0:1788361629.087224:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788361629.087305:0:88884:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788361629.087312:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c19 00000020:00000080:2.0:1788361629.087439:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788361629.087448:0:88884:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788361629.087455:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b69fa8920fe2c20 00080000:01000000:2.0:1788361629.087460:0:88884:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788361629.087465:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2c27 00010000:00010000:2.0:1788361629.151430:0:88884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788361629.152070:0:88884:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: ec302d84-8f96-49d3-8682-aefc474f8448 idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:2.0:1788361629.152131:0:88884:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:2.0:1788361629.152155:0:88884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:2.0:1788361629.152311:0:88884:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788361629.152455:0:88884:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d10f70b300: xid 1875230406982656, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:2.0:1788361629.152475:0:88884:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d10f70be40: xid 1875230406982912, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:2.0:1788361629.153513:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d137c019c0) 00000020:00000080:2.0:1788361629.153711:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788361629.153852:0:88884:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788361629.153963:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2c43 00000020:00000080:3.0:1788361629.156274:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361629.161986:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b69fa8920fe2c4a 00000020:00000080:2.0:1788361629.162756:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788361629.162773:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361629.162782:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.162784:0:88884:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788361629.162789:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361629.162793:0:88884:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788361629.162794:0:88884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361629.162795:0:88884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361629.162797:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361629.162799:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.162801:0:88884:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361629.162803:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361629.162809:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.162810:0:88884:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788361629.162816:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788361629.162904:0:88884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788361629.162923:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361629.162927:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.162928:0:88884:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788361629.162932:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361629.162936:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.162937:0:88884:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788361629.162940:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361629.162947:0:88884:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:2.0:1788361629.162979:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361629.162999:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d137c04d40) 00000020:00000080:2.0:1788361629.163023:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788361629.163039:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788361629.163109:0:88884:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788361629.163116:0:88884:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788361629.163125:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2c58 00010000:00080000:2.0:1788361629.163168:0:88884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d141652000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788361629.165054:0:88884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788361629.166255:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361629.166271:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788361629.166333:0:88884:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788361629.166366:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c5f 00000100:00080000:2.0:1788361629.166379:0:88884:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361629.166386:0:88884:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99d141652000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361629.166435:0:88884:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cfe2680 x1875230429781120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361629.166525:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429781120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361629.166622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.166759:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781120 00000100:00100000:0.0:1788361629.166769:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781120 00000100:00080000:2.0:1788361629.167047:0:88884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788361629.167114:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:3.0:1788361629.167128:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429781120:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788361629.167161:0:23938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2669 last 0 00000020:01000000:2.0:1788361629.167166:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361629.167173:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.167223:0:88884:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788361629.167228:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361629.167232:0:88884:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788361629.167234:0:88884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361629.167235:0:88884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361629.167237:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361629.167240:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.167242:0:88884:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361629.167245:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361629.167251:0:88884:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788361629.167255:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.167256:0:88884:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788361629.167259:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361629.167264:0:88884:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788361629.167311:0:88884:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788361629.167314:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361629.167340:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d003a099c0) 00000020:00000080:3.0:1788361629.167362:0:23938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c66 00000004:00100000:3.0:1788361629.167382:0:23938:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:2.0:1788361629.167487:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00080000:3.0:1788361629.167512:0:23938:0:(import.c:65:import_set_state_nolock()) ffff99d116c07000 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1788361629.167539:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788361629.167595:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429781120:12345-0@lo:38:llog_process_th.0 Request processed in 468us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.167603:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000004:00080000:2.0:1788361629.167665:0:88884:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788361629.167673:0:88884:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00100000:1.0:1788361629.167677:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000020:00000080:2.0:1788361629.167681:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2c74 00000100:00080000:1.0:1788361629.167689:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788361629.167700:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788361629.167706:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788361629.167711:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d141652000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1788361629.167720:0:88884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d136cc4000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00000100:00100000:1.0:1788361629.167766:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429781120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361629.168034:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429781248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361629.168069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.168145:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781248 00010000:00010000:2.0:1788361629.168155:0:88884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788361629.168163:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781248 00000100:00100000:3.0:1788361629.168243:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:3.0:1788361629.168261:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429781248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788361629.168313:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:3.0:1788361629.168407:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429781248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.168415:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:1.0:1788361629.168719:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429781248:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1788361629.170225:0:88884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361629.170265:0:88884:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361629.170380:0:88884:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1788361629.173298:0:88884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361629.173340:0:88884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:2.0:1788361629.177744:0:88884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:1.0:1788361629.178506:0:88890:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:1.0:1788361629.178515:0:88890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788361629.178869:0:88890:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1788361629.178895:0:88890:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788361629.179248:0:88890:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:1.0:1788361629.179252:0:88890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788361629.180346:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361629.180366:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788361629.180431:0:88884:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788361629.180468:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c7b 00000100:00080000:2.0:1788361629.180483:0:88884:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361629.180506:0:88884:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d136cc4000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361629.180868:0:88884:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cfe1c00 x1875230429781376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361629.180899:0:88884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788361629.180983:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361629.180989:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.180991:0:88884:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788361629.180996:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361629.181001:0:88884:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788361629.181010:0:88884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361629.181012:0:88884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361629.181014:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361629.181018:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.181020:0:88884:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361629.181023:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361629.181028:0:88884:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788361629.181034:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361629.181035:0:88884:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788361629.181039:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361629.181043:0:88884:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788361629.181075:0:88884:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788361629.181078:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361629.181092:0:88884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99d003a08000) 00000020:00000080:2.0:1788361629.181110:0:88884:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788361629.181117:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788361629.181192:0:88884:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788361629.181201:0:88884:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788361629.181209:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe2c89 00010000:00080000:2.0:1788361629.181249:0:88884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d1171e5000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788361629.181503:0:88884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788361629.181602:0:88884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361629.181621:0:88884:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361629.182245:0:88884:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1788361629.183062:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429781376:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1788361629.183115:0:88884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361629.183152:0:88884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:2.0:1788361629.183315:0:88884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000100:00100000:1.0:1788361629.183666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.184228:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781376 00000040:00080000:2.0:1788361629.184237:0:88892:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000100:00100000:0.0:1788361629.184243:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781376 00000100:00100000:0.0:1788361629.184320:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4888 00000100:00100000:0.0:1788361629.184333:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875230429781376:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788361629.184383:0:26167:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2669 last 0 00000020:00000080:0.0:1788361629.184433:0:26167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c90 00002000:00100000:0.0:1788361629.184453:0:26167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d004106800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788361629.184458:0:26167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788361629.184462:0:26167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788361629.184534:0:26167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788361629.184568:0:26167:0:(import.c:65:import_set_state_nolock()) ffff99d003820000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788361629.184654:0:88892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788361629.184691:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429781376:12345-0@lo:8:llog_process_th.0 Request processed in 358us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.184721:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361629.184733:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788361629.184741:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361629.184747:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788361629.184759:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d136cc4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361629.184775:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361629.184782:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429781376:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788361629.184810:0:88890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000040:00080000:2.0:1788361629.184859:0:88892:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1788361629.184877:0:88892:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788361629.184882:0:88890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2669194059302ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788361629.184888:0:88890:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788361629.184964:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361629.184974:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429781504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361629.185019:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361629.185086:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781504 00000100:00100000:1.0:1788361629.185093:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781504 00000100:00100000:0.0:1788361629.185117:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4888 00000100:00100000:1.0:1788361629.185168:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1788361629.185256:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429781504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361629.185282:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788361629.185302:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361629.185351:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429781504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.185361:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000040:00080000:0.0:1788361629.185364:0:88892:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:0.0:1788361629.185371:0:88892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788361629.185413:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429781504:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788361629.185925:0:88884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361629.185947:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361629.185995:0:88884:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788361629.186020:0:88884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c97 00000100:00080000:3.0:1788361629.186027:0:88884:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361629.186033:0:88884:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d1171e5000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361629.186060:0:88884:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd45c00 x1875230429781632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361629.186085:0:88884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788361629.186166:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361629.186170:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361629.186172:0:88884:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788361629.186174:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1788361629.186350:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429781632:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788361629.186393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.186478:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781632 00000100:00100000:0.0:1788361629.186484:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781632 00000100:00100000:0.0:1788361629.186516:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889 00000100:00100000:0.0:1788361629.186522:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3649:x1875230429781632:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788361629.186544:0:15123:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2669 last 0 00000020:00000080:0.0:1788361629.186568:0:15123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe2c9e 00002000:00100000:0.0:1788361629.186580:0:15123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d003827800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788361629.186585:0:15123:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788361629.186587:0:15123:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788361629.186643:0:15123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361629.186663:0:15123:0:(import.c:65:import_set_state_nolock()) ffff99d003825000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361629.186713:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429781632:12345-0@lo:8:llog_process_th.0 Request processed in 190us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.186721:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889 00000020:00000080:3.0:1788361629.186764:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361629.186766:0:88884:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361629.186772:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788361629.186774:0:88884:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361629.186777:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361629.186779:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361629.186781:0:88884:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361629.186784:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361629.186786:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361629.186787:0:88884:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361629.186791:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788361629.186817:0:88884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88884:1875230429781760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361629.186900:0:88884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.186918:0:88884:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361629.187022:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361629.187035:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788361629.187042:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361629.187047:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788361629.187049:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1171e5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361629.187063:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361629.187065:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781760 00000100:00100000:0.0:1788361629.187069:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781760 00000100:00100000:1.0:1788361629.187075:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429781632:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361629.187092:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361629.187099:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88884:x1875230429781760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361629.187198:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88884:x1875230429781760:12345-0@lo:502:llog_process_th.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.187206:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361629.187280:0:88884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88884:1875230429781760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361629.187309:0:88884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361629.187314:0:88884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361629.187315:0:88884:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361629.187319:0:88884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788361629.187379:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429781888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361629.187408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788361629.187480:0:88873:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788361629.187503:0:88873:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361629.187518:0:88873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.187529:0:88873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361629.187537:0:88873:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d13fd79000 from 1 10000000:01000000:0.0:1788361629.187540:0:88873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361629.187564:0:88873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.187573:0:88873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.187582:0:88873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.187593:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361629.187618:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.187634:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10a2f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361629.187660:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782016 00000100:00100000:3.0:1788361629.187719:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782016 00000100:00100000:3.0:1788361629.187759:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361629.187765:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:88873:x1875230429782016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361629.187774:0:88881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361629.187786:0:88881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2ca5 expref: -99 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.187804:0:88881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 9 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.187814:0:88881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 9 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361629.187848:0:88881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bec00, rc 0) 00000100:00100000:3.0:1788361629.187873:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:88873:x1875230429782016:12345-0@lo:101:mount.lustre.0 Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.187879:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361629.188036:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429781888 00000100:00100000:2.0:1788361629.188048:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429781888 00000100:00080000:0.0:1788361629.188094:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361629.188228:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1788361629.188237:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429781888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361629.188252:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361629.188342:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361629.188356:0:88873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.188366:0:88873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361629.189003:0:88892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788361629.189013:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782144:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788361629.189052:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788361629.189078:0:88892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2669198254686ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788361629.189085:0:88892:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788361629.189133:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11111c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.189152:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429781888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 915us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.189163:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000004:00080000:3.0:1788361629.189194:0:88874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788361629.189419:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782144 00000100:00100000:0.0:1788361629.189425:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782144 00000100:00100000:0.0:1788361629.189458:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361629.189465:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:88873:x1875230429782144:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788361629.189481:0:88879:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788361629.189498:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361629.189502:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361629.189508:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361629.189511:0:88879:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 114 00000100:00100000:0.0:1788361629.189591:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:88873:x1875230429782144:12345-0@lo:256:mount.lustre.0 Request processed in 126us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.189597:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361629.189630:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782144:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788361629.190273:0:88873:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:1.0:1788361629.190300:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429781888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788361629.190403:0:88873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.190415:0:88873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361629.190423:0:88873:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d13fd79000 from 1 10000000:01000000:0.0:1788361629.190426:0:88873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361629.190454:0:88873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.190462:0:88873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.190471:0:88873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.190486:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361629.190518:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.190544:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.191052:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782272 00000100:00100000:2.0:1788361629.191058:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782272 00000100:00100000:2.0:1788361629.191098:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361629.191107:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:88873:x1875230429782272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361629.191118:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361629.191130:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe2cba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2cb3 expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.191151:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe2cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2cb3 expref: 10 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.191160:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe2cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2cb3 expref: 10 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361629.191168:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb400, rc 0) 00000100:00100000:2.0:1788361629.191534:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88873:x1875230429782272:12345-0@lo:101:mount.lustre.0 Request processed in 428us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.191541:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:2.0:1788361629.192011:0:88874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788361629.192099:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361629.192117:0:88873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.192142:0:88873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.192432:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361629.192464:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.192498:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361629.192558:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782400 00000100:00100000:3.0:1788361629.192564:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782400 00000100:00100000:3.0:1788361629.192632:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361629.192641:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88873:x1875230429782400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361629.192776:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88873:x1875230429782400:12345-0@lo:501:mount.lustre.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.192784:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361629.192812:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361629.192867:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361629.192910:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361629.192947:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11111ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.192959:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782528 00000100:00100000:2.0:1788361629.192965:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782528 00000100:00100000:2.0:1788361629.192997:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361629.193012:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88873:x1875230429782528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361629.193096:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88873:x1875230429782528:12345-0@lo:503:mount.lustre.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.193103:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361629.193126:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361629.193673:0:88894:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88894:1875230429782656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361629.193711:0:88894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.193771:0:88894:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361629.193809:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782656 00000100:00100000:3.0:1788361629.193813:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782656 00000100:00100000:3.0:1788361629.193927:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361629.193934:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88894:x1875230429782656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361629.194387:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88894:x1875230429782656:12345-0@lo:502:llog_process_th.0 Request processed in 452us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.194395:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361629.194475:0:88894:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88894:1875230429782656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361629.194498:0:88894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361629.194507:0:88894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361629.194510:0:88894:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361629.194517:0:88894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d13fd79000 00000020:00000080:0.0:1788361629.194519:0:88894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361629.194527:0:88894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361629.194528:0:88894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361629.194530:0:88894:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361629.194532:0:88894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361629.194534:0:88894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361629.194535:0:88894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361629.194538:0:88894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d13fd79000 00000020:00000080:0.0:1788361629.194540:0:88894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788361629.194612:0:88894:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88894:1875230429782784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361629.194644:0:88894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.194673:0:88894:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.196465:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782784 00000100:00100000:2.0:1788361629.196477:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782784 00000100:00100000:2.0:1788361629.196520:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361629.196529:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88894:x1875230429782784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361629.196668:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88894:x1875230429782784:12345-0@lo:502:llog_process_th.0 Request processed in 139us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.196677:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361629.196854:0:88894:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88894:1875230429782784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361629.196883:0:88894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361629.196894:0:88894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361629.196896:0:88894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788361629.196903:0:88894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788361629.197063:0:88873:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788361629.197089:0:88873:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361629.197111:0:88873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.197122:0:88873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361629.197171:0:88873:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788361629.197174:0:88873:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d13fd79000 10000000:01000000:0.0:1788361629.197190:0:88873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d13fd79000 10000000:01000000:0.0:1788361629.197195:0:88873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361629.197201:0:88873:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d13fd79000 from 1 10000000:01000000:0.0:1788361629.197204:0:88873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361629.197233:0:88873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.197241:0:88873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.197259:0:88873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.197278:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361629.197321:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.197355:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361629.197518:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429782912 00000100:00100000:1.0:1788361629.197523:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429782912 00000100:00100000:1.0:1788361629.197548:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361629.197555:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:88873:x1875230429782912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361629.197565:0:88881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361629.197578:0:88881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2cc1 expref: -99 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.197599:0:88881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2cc1 expref: 11 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.197609:0:88881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2cc1 expref: 11 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.197618:0:88881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166a200, rc 0) 00000100:00100000:1.0:1788361629.197653:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429782912:12345-0@lo:101:mount.lustre.0 Request processed in 98us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.197659:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361629.198362:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429782912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361629.198380:0:88873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.198389:0:88873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361629.198454:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429783040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361629.198488:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.198512:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361629.198527:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783040 00000100:00100000:0.0:1788361629.198531:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783040 00000100:00100000:0.0:1788361629.198566:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361629.198573:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429783040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361629.198686:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429783040:12345-0@lo:501:mount.lustre.0 Request processed in 113us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.198694:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361629.198726:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429783040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361629.198751:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429783168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361629.198793:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.198816:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10320dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361629.198967:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783168 00000100:00100000:3.0:1788361629.198971:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783168 00000100:00100000:3.0:1788361629.199003:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361629.199011:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429783168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361629.199095:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429783168:12345-0@lo:503:mount.lustre.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.199102:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361629.199301:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429783168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361629.200625:0:88896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88896:1875230429783296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361629.200683:0:88896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.200720:0:88896:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d140d060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.200776:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783296 00000100:00100000:2.0:1788361629.200782:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783296 00000100:00100000:2.0:1788361629.201394:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361629.201405:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88896:x1875230429783296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361629.201529:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88896:x1875230429783296:12345-0@lo:502:llog_process_th.0 Request processed in 126us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.201537:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361629.201662:0:88896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88896:1875230429783296:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788361629.201727:0:88896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788361629.201742:0:88896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99d10531cd40) 00000020:00000080:0.0:1788361629.201768:0:88896:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788361629.201959:0:88896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d13fd79000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788361629.201964:0:88896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d13fd79000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788361629.201966:0:88896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d13fd79000 4 00010000:00080000:0.0:1788361629.201994:0:88896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d137f16000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788361629.203617:0:88896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788361629.203707:0:88896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788361629.203763:0:88896:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788361629.203775:0:88896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b69fa8920fe2cd6 00000100:00080000:0.0:1788361629.203784:0:88896:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361629.203790:0:88896:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d137f16000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361629.203855:0:88896:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10695fb80 x1875230429783424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361629.203893:0:88896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361629.203919:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429783424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361629.203976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.204555:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783424 00000100:00100000:0.0:1788361629.204561:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783424 00000100:00100000:0.0:1788361629.204600:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1788361629.204607:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429783424:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361629.204762:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429783424:12345-0@lo:38:llog_process_th.0 Request processed in 57us (688us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361629.204772:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788361629.204916:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361629.204924:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137f16000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361629.204928:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361629.204932:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429783424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361629.211354:0:88896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88896:1875230429783552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361629.211428:0:88896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.211468:0:88896:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d140d06e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361629.211590:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783552 00000100:00100000:0.0:1788361629.211597:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783552 00000100:00100000:0.0:1788361629.211710:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361629.211718:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88896:x1875230429783552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361629.211818:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88896:x1875230429783552:12345-0@lo:502:llog_process_th.0 Request processed in 101us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.211841:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361629.211859:0:88896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88896:1875230429783552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361629.211900:0:88896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88896:1875230429783680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361629.211935:0:88896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.212101:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783680 00000100:00100000:3.0:1788361629.212106:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783680 00000100:00100000:0.0:1788361629.212135:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361629.212141:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88896:x1875230429783680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361629.212145:0:88896:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0065b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361629.212203:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88896:x1875230429783680:12345-0@lo:502:llog_process_th.0 Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.212209:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788361629.212226:0:88896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88896:1875230429783680:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788361629.212244:0:88896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788361629.212388:0:88873:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788361629.212414:0:88873:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361629.212427:0:88873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361629.212437:0:88873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361629.212481:0:88873:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788361629.212483:0:88873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361629.212484:0:88873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361629.212486:0:88873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361629.212487:0:88873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361629.212488:0:88873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361629.212489:0:88873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361629.212491:0:88873:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361629.212493:0:88873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361629.212494:0:88873:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361629.212497:0:88873:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788361629.212499:0:88873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361629.212500:0:88873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361629.212501:0:88873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361629.212501:0:88873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361629.212502:0:88873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361629.212502:0:88873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361629.212503:0:88873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361629.212504:0:88873:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361629.212504:0:88873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361629.212505:0:88873:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361629.212516:0:88873:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788361629.212523:0:88873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429783808:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361629.212543:0:88873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.212567:0:88873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361629.212574:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783808 00000100:00100000:2.0:1788361629.212578:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783808 00000100:00100000:2.0:1788361629.212651:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361629.212659:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429783808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361629.212678:0:88880:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361629.212691:0:88880:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788361629.219223:0:88880:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361629.219245:0:88880:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788361629.219265:0:88882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361629.219271:0:88882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361629.219306:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.219328:0:88882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.219337:0:88882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.219386:0:88882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.219399:0:88882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 2769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361629.219414:0:88882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88882:1875230429783936:0@lo:104: 00000100:00100000:1.0:1788361629.219477:0:88882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.219574:0:88873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:88873:1875230429783808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361629.219597:0:88873:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361629.219601:0:88873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361629.219605:0:88873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361629.219606:0:88873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361629.219607:0:88873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361629.219608:0:88873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361629.219627:0:88873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361629.219629:0:88873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361629.219631:0:88873:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361629.219634:0:88873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361629.219635:0:88873:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788361629.219660:0:88873:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788361629.220109:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:88873:x1875230429783808:12345-0@lo:253:mount.lustre.0 Request processed in 7447us (7560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361629.220126:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361629.220129:0:88882:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102f44480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361629.220167:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429783936 00000100:00100000:1.0:1788361629.220271:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429783936 00000100:00100000:1.0:1788361629.220390:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788361629.220404:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:88882:x1875230429783936:12345-0@lo:104: 00010000:00010000:1.0:1788361629.220420:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220493:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361629.220499:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:88882:x1875230429783936:12345-0@lo:104: Request processed in 101us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.220508:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788361629.220556:0:88882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88882:1875230429783936:0@lo:104: 00010000:00010000:1.0:1788361629.220575:0:88882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220604:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361629.220609:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220625:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785f400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361629.220628:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220634:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361629.220639:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361629.220642:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361629.220669:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220673:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361629.220685:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220690:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe2cac expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220711:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361629.220713:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361629.220715:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361629.220732:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361629.220744:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429784064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361629.220775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361629.220810:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784064 00000100:00100000:1.0:1788361629.220813:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784064 00010000:00010000:1.0:1788361629.220863:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 2769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361629.220884:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1788361629.220889:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3653:x1875230429784064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361629.220896:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361629.220900:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 2769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220910:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 2769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220920:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bec00/0x1b69fa8920fe2cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe2ca5 expref: 11 pid: 88881 timeout: 2769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220931:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220936:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361629.220948:0:9528:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001677625s 00010000:00010000:1.0:1788361629.220952:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220960:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220965:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220969:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220980:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361629.220984:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220990:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.220999:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.221006:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361629.221042:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:3653:x1875230429784064:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361629.221051:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1788361629.221187:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429784064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361629.221216:0:88882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.221225:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361629.221232:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe2cdd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788361629.228164:0:88873:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411366 00000040:01000000:3.0:1788361629.228567:0:88873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788361629.228598:0:88902:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411366 00000020:00080000:1.0:1788361629.228604:0:88902:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411366 00000040:01000000:3.0:1788361629.231899:0:88903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361629.231916:0:88873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788361629.232423:0:88904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88904:1875230429784192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361629.232495:0:88904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.232531:0:88904:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48840 going to sleep for 11 seconds 00000040:01000000:1.0:1788361629.233099:0:88873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788361629.233149:0:88873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788361629.233641:0:88873:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788361629.233650:0:88873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788361629.233694:0:88873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361629.234536:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784192 00000100:00100000:0.0:1788361629.234550:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784192 00000100:00100000:0.0:1788361629.234612:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:0.0:1788361629.234634:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88904:x1875230429784192:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788361629.234660:0:88873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788361629.234766:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88904:x1875230429784192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.234774:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:0.0:1788361629.234871:0:88904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88904:1875230429784192:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788361629.234920:0:88904:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788361629.234960:0:88904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88904:1875230429784320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361629.235000:0:88904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.235031:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784320 00000100:00100000:0.0:1788361629.235035:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784320 00000100:00100000:0.0:1788361629.235066:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:0.0:1788361629.235074:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88904:x1875230429784320:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361629.235160:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88904:x1875230429784320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.235167:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:0.0:1788361629.235183:0:88904:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361629.235194:0:88904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88904:1875230429784320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361629.235251:0:88904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88904:1875230429784448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361629.235274:0:88904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361629.235304:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784448 00000100:00100000:0.0:1788361629.235308:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784448 00000040:00080000:1.0:1788361629.235338:0:88873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:0.0:1788361629.235348:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:0.0:1788361629.235359:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88904:x1875230429784448:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788361629.235366:0:88903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788361629.235409:0:88873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:0.0:1788361629.235420:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88904:x1875230429784448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361629.235439:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:0.0:1788361629.235457:0:88904:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361629.235469:0:88904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88904:1875230429784448:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788361629.235502:0:88904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361629.237016:0:88873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788361629.237705:0:88873:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:1.0:1788361629.239473:0:88873:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00000040:00080000:2.0:1788361629.241637:0:88903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788361629.241706:0:88903:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1788361629.241714:0:88905:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88905 00010000:02000000:3.0:1788361629.241733:0:88905:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788361629.241736:0:88905:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788361629.241739:0:88905:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788361629.241973:0:88873:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788361629.241998:0:88873:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788361629.242024:0:88873:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788361629.242081:0:88873:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788361629.244875:0:88873:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788361629.245383:0:88873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788361629.246676:0:88904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788361629.246753:0:88904:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788361629.246758:0:88904:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1788361629.247022:0:88905:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1788361629.782646:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361630.678756:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788361630.678762:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d13fd79000 from 115 10000000:01000000:0.0:1788361630.678767:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361630.678809:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.678842:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.678855:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.678879:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.679051:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.679090:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.680555:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784576 00000100:00100000:3.0:1788361630.680566:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784576 00000100:00100000:3.0:1788361630.680783:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361630.680795:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:6520:x1875230429784576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361630.680813:0:88879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361630.680847:0:88879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bfe00/0x1b69fa8920fe2ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2ce4 expref: -99 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.680874:0:88879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bfe00/0x1b69fa8920fe2ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2ce4 expref: 11 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.680885:0:88879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bfe00/0x1b69fa8920fe2ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2ce4 expref: 11 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.680894:0:88879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfe00, rc 0) 00000100:00100000:3.0:1788361630.680966:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429784576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.680980:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361630.681093:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.681111:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.681121:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.681195:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.681235:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.681290:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.681347:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784704 00000100:00100000:2.0:1788361630.681352:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784704 00000100:00100000:2.0:1788361630.681392:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361630.681401:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429784704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361630.681416:0:88880:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788361630.681433:0:88880:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361630.681439:0:88880:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 115 00000100:00100000:2.0:1788361630.681537:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429784704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.681544:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361630.681603:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361630.681651:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361630.681658:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.681667:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361630.681677:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361630.681680:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 52 10000000:01000000:3.0:1788361630.681683:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361630.681702:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.681710:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.681717:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361630.681731:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.681757:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.681779:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d119ff0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.681812:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784832 00000100:00100000:2.0:1788361630.681818:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784832 00000100:00100000:2.0:1788361630.681896:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788361630.681903:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429784832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.681911:0:88879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361630.681920:0:88879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ebe00/0x1b69fa8920fe2cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2cf2 expref: -99 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.681935:0:88879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ebe00/0x1b69fa8920fe2cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2cf2 expref: 12 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.681943:0:88879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ebe00/0x1b69fa8920fe2cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2cf2 expref: 12 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.681949:0:88879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ebe00, rc 0) 00000100:00100000:2.0:1788361630.681977:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429784832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.681983:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361630.682014:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361630.682027:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.682045:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361630.682096:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.682117:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.682140:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d119ff0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.682180:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429784960 00000100:00100000:0.0:1788361630.682183:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429784960 00000100:00100000:0.0:1788361630.682220:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361630.682225:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429784960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.682363:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429784960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.682370:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788361630.682416:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429784960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.682447:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.682504:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361630.682520:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.682532:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785088 00000100:00100000:2.0:1788361630.682536:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785088 00000100:00100000:2.0:1788361630.682573:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361630.682579:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429785088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.682657:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429785088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.682665:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361630.682678:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361630.684238:0:89031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788361630.684534:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788361630.684567:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361630.684578:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.684590:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361630.684600:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788361630.684603:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 112 10000000:01000000:2.0:1788361630.684606:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788361630.684640:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.684648:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.684658:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361630.684683:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.684741:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361630.684790:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.684867:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785216 00000100:00100000:3.0:1788361630.684875:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785216 00000100:00100000:3.0:1788361630.684925:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788361630.684936:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429785216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361630.684948:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361630.684961:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231be600/0x1b69fa8920fe2d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d00 expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.684983:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231be600/0x1b69fa8920fe2d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d00 expref: 13 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.684993:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231be600/0x1b69fa8920fe2d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d00 expref: 13 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.685001:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be600, rc 0) 00000100:00100000:3.0:1788361630.685042:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429785216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.685049:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788361630.685811:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.685851:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.685862:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361630.685920:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.685963:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361630.685998:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.686059:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785344 00000100:00100000:3.0:1788361630.686065:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785344 00000100:00100000:3.0:1788361630.686104:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361630.686113:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12d382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429785344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361630.686130:0:88879:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361630.686147:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361630.686151:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788361630.686155:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788361630.686158:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788361630.686161:0:88879:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:2.0:1788361630.686295:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.686296:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12d382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429785344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.686309:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 10000000:01000000:2.0:1788361630.686380:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788361630.686387:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.686395:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361630.686404:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788361630.686406:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1788361630.686410:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361630.686437:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.686445:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.686454:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361630.686479:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.686509:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361630.686569:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.686599:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785472 00000100:00100000:3.0:1788361630.686602:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785472 00000100:00100000:3.0:1788361630.686628:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361630.686633:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429785472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361630.686640:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361630.686649:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231be400/0x1b69fa8920fe2d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d0e expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.686662:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231be400/0x1b69fa8920fe2d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d0e expref: 14 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.686669:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231be400/0x1b69fa8920fe2d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d0e expref: 14 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.686674:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be400, rc 0) 00000100:00100000:3.0:1788361630.686732:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429785472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.686741:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361630.686781:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.686791:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.686799:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361630.686966:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.686992:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.687009:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785600 00000100:00100000:2.0:1788361630.687013:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.687014:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785600 00000100:00100000:3.0:1788361630.687084:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361630.687093:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429785600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.687252:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429785600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.687273:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361630.687291:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.687318:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.687356:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361630.687377:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.687390:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785728 00000100:00100000:0.0:1788361630.687394:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785728 00000100:00100000:0.0:1788361630.687423:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361630.687428:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429785728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.688168:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429785728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 736us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.688178:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361630.688306:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361630.688947:0:89032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788361630.689092:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788361630.689114:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788361630.689122:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.689139:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361630.689149:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788361630.689152:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d002df9000 from 1 10000000:01000000:3.0:1788361630.689154:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788361630.689185:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.689193:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.689202:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361630.689220:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.689302:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.689368:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f424240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.689400:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785856 00000100:00100000:0.0:1788361630.689405:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785856 00000100:00100000:0.0:1788361630.689457:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361630.689464:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429785856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.689473:0:88879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361630.689484:0:88879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe2d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d1c expref: -99 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.689508:0:88879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe2d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d1c expref: 15 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.689515:0:88879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe2d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d1c expref: 15 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.689521:0:88879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785ec00, rc 0) 00000100:00100000:0.0:1788361630.689555:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429785856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.689559:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361630.689650:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361630.689664:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.689674:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361630.689686:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788361630.689691:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.689698:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361630.689711:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788361630.689713:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d002df9000 from 7 10000000:01000000:1.0:1788361630.689715:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361630.689730:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.689737:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.689744:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.689757:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.689783:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.689808:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.690045:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429785984 00000100:00100000:0.0:1788361630.690049:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429785984 00000100:00100000:0.0:1788361630.690074:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788361630.690080:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429785984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.690088:0:88881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361630.690096:0:88881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785f800/0x1b69fa8920fe2d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d2a expref: -99 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.690110:0:88881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785f800/0x1b69fa8920fe2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d2a expref: 16 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.690117:0:88881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785f800/0x1b69fa8920fe2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d2a expref: 16 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.690123:0:88881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f800, rc 0) 00000100:00100000:0.0:1788361630.690174:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429785984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.690187:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361630.690337:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429785984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361630.690350:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.690361:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.690412:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.690439:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.690470:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.690522:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786112 00000100:00100000:3.0:1788361630.690527:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786112 00000100:00100000:3.0:1788361630.690560:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788361630.690575:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429786112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.690686:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429786112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.690693:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361630.690753:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.690782:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.690842:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.690860:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.690900:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786240 00000100:00100000:2.0:1788361630.690904:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786240 00000100:00100000:2.0:1788361630.690934:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788361630.690940:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0032c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429786240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.691017:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0032c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429786240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.691033:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361630.691405:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361630.693782:0:89033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361630.693991:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361630.694023:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361630.694033:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.694044:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361630.694054:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361630.694056:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 52 10000000:01000000:1.0:1788361630.694058:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361630.694090:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.694098:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.694108:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.694131:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.694184:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.694224:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786368 00000100:00100000:1.0:1788361630.694229:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.694232:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786368 00000100:00100000:3.0:1788361630.694302:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361630.694314:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0032cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429786368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361630.694326:0:88879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361630.694340:0:88879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bf200/0x1b69fa8920fe2d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d38 expref: -99 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.694364:0:88879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bf200/0x1b69fa8920fe2d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d38 expref: 17 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.694372:0:88879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bf200/0x1b69fa8920fe2d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d38 expref: 17 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.694379:0:88879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf200, rc 0) 00000100:00100000:3.0:1788361630.694425:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0032cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429786368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.694442:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361630.695307:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361630.695326:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.695349:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.695413:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.695450:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.695484:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.695495:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786496 00000100:00100000:0.0:1788361630.695502:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786496 00000100:00100000:0.0:1788361630.695543:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361630.695552:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0032c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429786496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.695680:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0032c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429786496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.695689:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361630.695707:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.695736:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.695777:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.695798:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.695814:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786624 00000100:00100000:0.0:1788361630.695819:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786624 00000100:00100000:0.0:1788361630.696000:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361630.696008:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429786624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.696097:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429786624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.696104:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361630.696138:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361630.696955:0:89036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788361630.697124:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788361630.697153:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361630.697161:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.697172:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361630.697182:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788361630.697184:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788361630.697187:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788361630.697213:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.697221:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.697238:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.697271:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.697308:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.697378:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.697981:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786752 00000100:00100000:0.0:1788361630.697987:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786752 00000100:00100000:0.0:1788361630.698030:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361630.698039:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429786752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.698051:0:88881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361630.698064:0:88881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe2d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d46 expref: -99 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.698085:0:88881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe2d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d46 expref: 18 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.698096:0:88881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe2d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d46 expref: 18 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.698114:0:88881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f600, rc 0) 00000100:00100000:0.0:1788361630.698155:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429786752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.698162:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361630.698202:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.698215:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.698223:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.698295:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.698330:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.698351:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d140d06240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.698476:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429786880 00000100:00100000:3.0:1788361630.698481:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429786880 00000100:00100000:3.0:1788361630.698509:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361630.698516:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429786880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.698636:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429786880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.698644:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361630.698675:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429786880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.698707:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.698749:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.698781:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f4249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361630.698799:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787008 00000100:00100000:3.0:1788361630.698803:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787008 00000100:00100000:3.0:1788361630.698852:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361630.698860:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429787008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.699547:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429787008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 684us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.699555:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788361630.699679:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361630.701075:0:89039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788361630.701135:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788361630.701425:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788361630.701437:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.701460:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361630.701469:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361630.701471:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0021f9800 from 7 10000000:01000000:3.0:1788361630.701474:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361630.701510:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.701518:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361630.701528:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361630.701552:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361630.701609:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361630.701649:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f4249c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.701655:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787136 00000100:00100000:2.0:1788361630.701663:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787136 00000100:00100000:2.0:1788361630.701708:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788361630.701718:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429787136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.701730:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361630.701743:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe2d5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d54 expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.701867:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe2d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d54 expref: 19 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.701879:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe2d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d54 expref: 19 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.701888:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb000, rc 0) 00000100:00100000:2.0:1788361630.701942:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429787136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.701950:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788361630.702159:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.702174:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.702182:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.702331:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.702361:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.702396:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d140d06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.702399:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787264 00000100:00100000:2.0:1788361630.702404:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787264 00000100:00100000:2.0:1788361630.702428:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361630.702434:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429787264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.702534:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429787264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.702546:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788361630.702567:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.702602:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.702638:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.702654:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d140d06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.702666:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787392 00000100:00100000:2.0:1788361630.702670:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787392 00000100:00100000:2.0:1788361630.702690:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361630.702696:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429787392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.702756:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429787392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.702762:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788361630.702769:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361630.703512:0:89041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788361630.704350:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788361630.704375:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361630.704385:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.704395:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361630.704405:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361630.704408:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 52 10000000:01000000:0.0:1788361630.704410:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361630.704442:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.704451:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.704461:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.704479:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.704536:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361630.704575:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787520 00000100:00100000:0.0:1788361630.704577:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.704580:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787520 00000100:00100000:2.0:1788361630.704621:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788361630.704630:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429787520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.704642:0:88881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361630.704655:0:88881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe2d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d62 expref: -99 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.704678:0:88881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe2d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d62 expref: 20 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.704690:0:88881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe2d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d62 expref: 20 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.704699:0:88881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb200, rc 0) 00000100:00100000:2.0:1788361630.704749:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429787520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.704756:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361630.704853:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.704874:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.704883:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.704935:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.704958:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.704981:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.704991:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787648 00000100:00100000:2.0:1788361630.704996:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787648 00000100:00100000:2.0:1788361630.705024:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788361630.705032:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429787648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.705131:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429787648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.705139:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788361630.705140:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.705164:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.705199:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.705216:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00333c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.705413:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787776 00000100:00100000:2.0:1788361630.705419:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787776 00000100:00100000:2.0:1788361630.705449:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788361630.705455:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429787776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.705515:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429787776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.705520:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361630.705586:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361630.706359:0:89042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788361630.706461:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788361630.706548:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361630.706556:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.706567:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361630.706576:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788361630.706578:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788361630.706580:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361630.706604:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.706621:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.706630:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.706648:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.706686:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.706721:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d140d06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.706771:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429787904 00000100:00100000:2.0:1788361630.706777:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429787904 00000100:00100000:2.0:1788361630.706897:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788361630.706908:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429787904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.706920:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361630.706933:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe2d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d70 expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.706952:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe2d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d70 expref: 21 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.706962:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe2d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d70 expref: 21 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.706982:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea200, rc 0) 00000100:00100000:2.0:1788361630.707040:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429787904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.707047:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361630.707077:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429787904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361630.707092:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.707102:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.707154:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.707182:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.707220:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.707275:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788032 00000100:00100000:0.0:1788361630.707279:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788032 00000100:00100000:0.0:1788361630.707315:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361630.707323:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429788032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.707533:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429788032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.707541:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788361630.707789:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.708034:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.708456:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.708627:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.708650:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788160 00000100:00100000:2.0:1788361630.708657:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788160 00000100:00100000:2.0:1788361630.708700:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361630.708709:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429788160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.710369:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429788160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1654us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.710382:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361630.710602:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361630.712241:0:89043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788361630.712314:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788361630.712346:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361630.712356:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712369:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361630.712386:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361630.712388:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d137d28000 from 7 10000000:01000000:0.0:1788361630.712391:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361630.712428:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712436:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712446:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.712470:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.712529:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.712565:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.712584:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788288 00000100:00100000:0.0:1788361630.712589:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788288 00000100:00100000:0.0:1788361630.712632:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361630.712640:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429788288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.712653:0:88879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361630.712666:0:88879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe2d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d7e expref: -99 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712689:0:88879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe2d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d7e expref: 22 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712701:0:88879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe2d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d7e expref: 22 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712722:0:88879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e400, rc 0) 00000100:00100000:0.0:1788361630.712759:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429788288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.712767:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361630.712814:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.712848:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.712857:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.712915:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.712946:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.712962:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.713862:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788416 00000100:00100000:2.0:1788361630.713872:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788416 00000100:00100000:2.0:1788361630.713932:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788361630.713944:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11e83ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429788416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361630.714095:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11e83ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429788416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.714102:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788361630.714174:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.714214:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.714265:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.714293:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788544 00000100:00100000:0.0:1788361630.714299:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788544 00000100:00100000:1.0:1788361630.714310:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.714331:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361630.714337:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429788544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.714430:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429788544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.714436:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361630.714644:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361630.715502:0:89044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788361630.718524:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788361630.718586:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361630.718599:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.718624:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361630.718634:0:6520:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788361630.718637:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99d1349b4d40 from 1 10000000:01000000:0.0:1788361630.718640:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788361630.718681:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.718688:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.718699:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361630.718724:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.718789:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361630.718866:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361630.719041:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788672 00000100:00100000:2.0:1788361630.719049:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788672 00000100:00100000:2.0:1788361630.719102:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788361630.719111:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429788672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361630.719126:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361630.719141:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ebc00/0x1b69fa8920fe2d93 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d8c expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.719176:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ebc00/0x1b69fa8920fe2d93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d8c expref: 23 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.719187:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ebc00/0x1b69fa8920fe2d93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d8c expref: 23 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361630.719201:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ebc00, rc 0) 00000100:00100000:2.0:1788361630.719266:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429788672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361630.719274:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361630.719319:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361630.719336:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.719347:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361630.719365:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361630.719370:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.719377:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361630.719384:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788361630.719386:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:1.0:1788361630.719388:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788361630.719404:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.719411:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.719419:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.719430:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.719456:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.719491:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361630.719497:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788800 00000100:00100000:0.0:1788361630.719503:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788800 00000100:00100000:0.0:1788361630.719577:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361630.719584:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429788800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361630.719591:0:88881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361630.719599:0:88881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785e800/0x1b69fa8920fe2da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe2d9a expref: -99 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.719612:0:88881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e800/0x1b69fa8920fe2da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d9a expref: 24 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.719634:0:88881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785e800/0x1b69fa8920fe2da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe2d9a expref: 24 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.719641:0:88881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e800, rc 0) 00000100:00100000:0.0:1788361630.719685:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429788800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361630.719693:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788361630.719753:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361630.719763:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.719772:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361630.719819:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361630.719859:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361630.719881:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361630.719898:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429788928 00000100:00100000:1.0:1788361630.719901:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429788928 00000100:00100000:0.0:1788361630.720131:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361630.720140:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429788928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361630.720216:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429788928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361630.720223:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361630.720903:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429788928:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788361630.720964:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361630.720973:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361630.720981:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361630.806044:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361631.639486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361631.639558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361631.639588:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361631.639619:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988672 00000100:00100000:0.0:1788361631.639627:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988672 00000100:00100000:0.0:1788361631.639658:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988800 00000100:00100000:0.0:1788361631.639666:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988800 00000100:00100000:0.0:1788361631.639708:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 840 00000100:00100000:0.0:1788361631.639718:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406988800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361631.639786:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230406988800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361631.639794:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 840 00000100:00100000:0.0:1788361631.639811:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1148 00000100:00100000:0.0:1788361631.639816:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230406988672:12345-192.168.204.35@tcp:38:kworker.0 00010000:00080000:0.0:1788361631.639856:0:66128:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'ec302d84-8f96-49d3-8682-aefc474f8448' at ffff99d10f55e000, cookie 0x1b69fa8920fe2c2e 00010000:00080000:0.0:1788361631.639862:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp recovering/t107374182407 exp ffff99d10f55e000 cur 2671 last 1788361629 00010000:02000400:0.0:1788361631.639869:0:66128:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788361631.639874:0:66128:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788361631.639897:0:66128:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788361631.640026:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d137d1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361631.640069:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406988672:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 251us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361631.640076:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1148 00000100:00080000:0.0:1788361631.640099:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361631.643358:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988544 00000100:00100000:3.0:1788361631.643371:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988544 00000100:00100000:3.0:1788361631.643416:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:3.0:1788361631.643424:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2411:x1875230406988544:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:3.0:1788361631.643433:0:88881:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:3.0:1788361631.643493:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2411:x1875230406988544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 68us (4016us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361631.643500:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:2.0:1788361631.645550:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361631.645678:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406983808 00000100:00100000:1.0:1788361631.645685:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406983808 00000100:00100000:1.0:1788361631.645763:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1149 00000100:00100000:1.0:1788361631.645773:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406983808:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00080000:1.0:1788361631.645791:0:80345:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:1.0:1788361631.645811:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406983808:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 40us (265us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361631.645817:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1149 00010000:00080000:3.0:1788361631.645858:0:88905:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788361631.649756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361631.649919:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406988928 00000100:00100000:3.0:1788361631.649935:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406988928 00000100:00100000:3.0:1788361631.650015:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788361631.650023:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2408:x1875230406988928:12345-192.168.204.35@tcp:250:kworker.0 00010000:00080000:3.0:1788361631.650063:0:88879:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1f5c0251-1795-40ef-8392-cb147010b7b5@192.168.204.35@tcp t0 exp 0000000000000000 cur 2671 last 0 00000020:00000080:3.0:1788361631.650093:0:88879:0:(genops.c:1406:class_connect()) connect: client 1f5c0251-1795-40ef-8392-cb147010b7b5, cookie 0x1b69fa8920fe2da8 00000100:00080000:3.0:1788361631.650249:0:88879:0:(import.c:65:import_set_state_nolock()) ffff99d11e637000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361631.650323:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+5:2408:x1875230406988928:12345-192.168.204.35@tcp:250:kworker.0 Request processed in 298us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361631.650331:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000001:02000400:1.0:1788361631.683949:0:89156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361631.829911:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361632.087992:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788361632.088005:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:0.0:1788361632.088009:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d10608f800/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361632.088081:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10608f800/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0001 00000020:00000080:1.0:1788361632.088149:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d106089000 for lustre-OST0001 00000001:00100000:1.0:1788361632.089770:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788361632.089793:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361632.089796:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d141657000/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:3.0:1788361632.089898:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141657000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0000 00000020:00000080:3.0:1788361632.089957:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141656000 for lustre-OST0000 00000020:00000004:1.0:1788361632.232323:0:89208:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788361632.232550:0:89208:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788361632.790534:0:89258:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788361632.790782:0:89258:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788361632.854978:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361633.160923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361633.161044:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989056 00000100:00100000:3.0:1788361633.161061:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989056 00000100:00100000:3.0:1788361633.161135:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788361633.161148:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0070f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+5:42333:x1875230406989056:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361633.161168:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361633.161202:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bf000/0x1b69fa8920fe2daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ddd expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.161245:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bf000/0x1b69fa8920fe2daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ddd expref: 6 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.161258:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bf000/0x1b69fa8920fe2daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ddd expref: 6 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.161267:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf000, rc 0) 00000100:00100000:3.0:1788361633.161429:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0070f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406989056:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 284us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361633.161453:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788361633.165370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361633.165492:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989184 00000100:00100000:3.0:1788361633.165502:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989184 00000100:00100000:3.0:1788361633.166767:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788361633.166785:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0070f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406989184:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361633.166813:0:88879:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788361633.166856:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361633.166860:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788361633.166864:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788361633.166867:0:88879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788361633.166869:0:88879:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:2.0:1788361633.170482:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0070f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406989184:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 3693us (5109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361633.170497:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:2.0:1788361633.173359:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361633.173436:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989312 00000100:00100000:3.0:1788361633.173446:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989312 00000100:00100000:3.0:1788361633.173508:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788361633.173519:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230406989312:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361633.173536:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361633.173554:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bea00/0x1b69fa8920fe2db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710de4 expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.173585:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bea00/0x1b69fa8920fe2db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710de4 expref: 7 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.173597:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bea00/0x1b69fa8920fe2db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710de4 expref: 7 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.173606:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bea00, rc 0) 00000100:00100000:3.0:1788361633.173683:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230406989312:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 167us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361633.173708:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:1.0:1788361633.181507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361633.183960:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989440 00000100:00100000:2.0:1788361633.183975:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989440 00000100:00100000:2.0:1788361633.184052:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:2.0:1788361633.184063:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230406989440:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361633.184260:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406989440:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 198us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361633.184269:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:0.0:1788361633.187565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361633.187670:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989568 00000100:00100000:1.0:1788361633.187680:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989568 00000100:00100000:1.0:1788361633.187737:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788361633.187747:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406989568:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361633.187943:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406989568:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 195us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361633.187951:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788361633.193494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361633.193641:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989696 00000100:00100000:3.0:1788361633.193654:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989696 00000100:00100000:3.0:1788361633.193719:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:3.0:1788361633.193729:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230406989696:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361633.193748:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361633.193768:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bfc00/0x1b69fa8920fe2dbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710deb expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.193801:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bfc00/0x1b69fa8920fe2dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710deb expref: 9 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.193813:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bfc00/0x1b69fa8920fe2dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710deb expref: 9 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.193856:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfc00, rc 0) 00000100:00100000:3.0:1788361633.193922:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406989696:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 195us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361633.193931:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361633.195896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361633.196028:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989824 00000100:00100000:2.0:1788361633.196039:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989824 00000100:00100000:2.0:1788361633.196108:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788361633.196119:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406989824:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361633.196286:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406989824:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 168us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361633.196295:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788361633.198523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361633.198608:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406989952 00000100:00100000:1.0:1788361633.198617:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406989952 00000100:00100000:1.0:1788361633.198672:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:1.0:1788361633.198681:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406989952:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361633.198857:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406989952:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 140us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361633.198867:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:0.0:1788361633.203244:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361633.203378:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406990080 00000100:00100000:3.0:1788361633.203389:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406990080 00000100:00100000:3.0:1788361633.203493:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788361633.203504:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230406990080:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361633.203519:0:88880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361633.203536:0:88880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1231bf600/0x1b69fa8920fe2dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710df2 expref: -99 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.203583:0:88880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1231bf600/0x1b69fa8920fe2dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710df2 expref: 10 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.203595:0:88880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1231bf600/0x1b69fa8920fe2dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710df2 expref: 10 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361633.203604:0:88880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf600, rc 0) 00000100:00100000:3.0:1788361633.203656:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406990080:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 155us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361633.203663:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:0.0:1788361633.205383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361633.205446:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406990208 00000100:00100000:2.0:1788361633.205455:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406990208 00000100:00100000:2.0:1788361633.205504:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:2.0:1788361633.205514:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406990208:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361633.205626:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230406990208:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 113us (250us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361633.205635:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788361633.622210:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361633.622235:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429789056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361633.622307:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361633.622403:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361633.622414:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429789184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361633.622446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361633.622503:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789056 00000100:00100000:1.0:1788361633.622510:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789056 00000100:00100000:1.0:1788361633.622566:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789184 00000100:00100000:1.0:1788361633.622569:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789184 00000100:00100000:1.0:1788361633.622600:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1788361633.622610:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429789056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361633.622640:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361633.622691:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429789056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361633.622699:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1788361633.622722:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1788361633.622731:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429789184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361633.622749:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361633.622787:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429789184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361633.622794:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00080000:3.0:1788361633.622959:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361633.622965:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361633.623125:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429789184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361633.624392:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429789056:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788361633.877991:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361634.646008:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361634.646031:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429789312:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788361634.646068:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788361634.646076:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429789440:0@lo:400:kworker.0 00000100:00080000:1.0:1788361634.646076:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361634.646082:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361634.646089:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2669 00000100:00080000:1.0:1788361634.646093:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788361634.646101:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361634.646103:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361634.646129:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa5f80 x1875230429789568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361634.646202:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788361634.646206:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789312 00000100:00080000:1.0:1788361634.646206:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361634.646209:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788361634.646214:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789312 00000100:00080000:1.0:1788361634.646215:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2669 00000100:00100000:3.0:1788361634.646222:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361634.646222:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788361634.646230:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361634.646243:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d108c7d500 x1875230429789824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361634.646258:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361634.646261:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361634.646263:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361634.646267:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2669 00000100:00100000:2.0:1788361634.646269:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00080000:1.0:1788361634.646270:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788361634.646276:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361634.646283:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429789312:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361634.646288:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d007352d80 x1875230429790080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361634.646309:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361634.646312:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361634.646314:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000004:00000024:2.0:1788361634.646318:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00080000:1.0:1788361634.646318:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2669 00000100:00080000:1.0:1788361634.646321:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788361634.646326:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361634.646335:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d007351180 x1875230429790464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361634.646363:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788361634.646367:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361634.646371:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d137f16000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788361634.646372:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429789312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.646381:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00080000:1.0:1788361634.646384:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d137f16000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361634.646396:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d007350380 x1875230429790848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361634.646407:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429789568:0@lo:38:kworker.0 00000100:00100000:1.0:1788361634.646424:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429790208:0@lo:400:kworker.0 00000100:00100000:2.0:1788361634.646441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361634.646464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.646471:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429789824:0@lo:38:kworker.0 00000100:00100000:1.0:1788361634.646495:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788361634.646502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361634.646506:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429789952:0@lo:400:kworker.0 00000100:00100000:2.0:1788361634.646524:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429790080:0@lo:38:kworker.0 00000100:00100000:2.0:1788361634.646558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361634.646578:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429790336:0@lo:400:kworker.0 00000100:00100000:2.0:1788361634.646583:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429790464:0@lo:38:kworker.0 00000100:00100000:3.0:1788361634.646620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.646623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361634.646652:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788361634.646659:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429790848:0@lo:38:kworker.0 00000100:00100000:3.0:1788361634.646663:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429789696:0@lo:400:kworker.0 00000100:00100000:1.0:1788361634.646669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.646696:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361634.646700:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429790720:0@lo:400:kworker.0 00000100:00100000:3.0:1788361634.646717:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790208 00000100:00100000:3.0:1788361634.646723:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790208 00000100:00100000:1.0:1788361634.646738:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.646745:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789568 00000100:00100000:3.0:1788361634.646764:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790336 00000100:00100000:3.0:1788361634.646769:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790336 00000100:00100000:1.0:1788361634.646775:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790720 00000100:00100000:1.0:1788361634.646781:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790720 00000100:00100000:3.0:1788361634.646809:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:3.0:1788361634.646818:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429790208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361634.646846:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:1.0:1788361634.646856:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429790336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361634.646875:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789568 00000100:00100000:2.0:1788361634.646904:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789824 00000100:00100000:3.0:1788361634.646909:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429790208:12345-0@lo:400:kworker.0 Request processed in 90us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.646909:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789824 00000100:00100000:1.0:1788361634.646917:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429790336:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.646922:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790464 00000100:00100000:3.0:1788361634.646924:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00100000:2.0:1788361634.646927:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790464 00000100:00100000:1.0:1788361634.646931:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1788361634.646937:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789952 00000100:00100000:2.0:1788361634.646941:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789952 00000100:00100000:3.0:1788361634.646947:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:3.0:1788361634.646959:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429790720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361634.646966:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790848 00000100:00100000:2.0:1788361634.646970:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790848 00000100:00100000:1.0:1788361634.646974:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1788361634.646985:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429789952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361634.646990:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1788361634.646996:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429790720:12345-0@lo:400:kworker.0 Request processed in 40us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.646998:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429789568:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361634.647010:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00010000:00080000:2.0:1788361634.647025:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2674 last 0 00000100:00080000:3.0:1788361634.647037:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361634.647043:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1788361634.647064:0:66126:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe2dcb 00000100:00100000:3.0:1788361634.647071:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429790720:0@lo:400:kworker.0 00000004:00100000:2.0:1788361634.647080:0:66126:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788361634.647094:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429790208:0@lo:400:kworker.0 00000100:00100000:3.0:1788361634.647121:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361634.647139:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429790592:0@lo:400:kworker.0 00000100:00100000:3.0:1788361634.647192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361634.647204:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429789952:12345-0@lo:400:kworker.0 Request processed in 221us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.647222:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1788361634.647225:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429790336:0@lo:400:kworker.0 00000100:00100000:1.0:1788361634.647239:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789696 00000100:00100000:1.0:1788361634.647244:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789696 00000100:00100000:1.0:1788361634.647276:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788361634.647284:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429789696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361634.647298:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d1171e5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361634.647320:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429789696:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.647327:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1788361634.647346:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429789568:12345-0@lo:38:kworker.0 Request processed in 347us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.647346:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788361634.647359:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1788361634.647366:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429789824:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361634.647375:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1788361634.647380:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429790464:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788361634.647382:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2674 last 0 00010000:00080000:2.0:1788361634.647402:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2674 last 0 00000020:00000080:1.0:1788361634.647412:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b69fa8920fe2dd2 00000004:00100000:1.0:1788361634.647420:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:2.0:1788361634.647439:0:66126:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1b69fa8920fe2dd9 00000100:00080000:1.0:1788361634.647446:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d104f3e000 : changing import state from RECOVER to FULL 00000004:00100000:2.0:1788361634.647449:0:66126:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361634.647469:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d1171e6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361634.647482:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875230429789824:12345-0@lo:38:kworker.0 Request processed in 126us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.647489:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788361634.647508:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875230429790464:12345-0@lo:38:kworker.0 Request processed in 124us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.647508:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788361634.647516:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429790848:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361634.647522:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00010000:00080000:1.0:1788361634.647534:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2674 last 0 00000100:00100000:2.0:1788361634.647545:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790080 00000100:00100000:2.0:1788361634.647549:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790080 00000020:00000080:1.0:1788361634.647572:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b69fa8920fe2de0 00000100:00100000:2.0:1788361634.647574:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:2.0:1788361634.647581:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429790080:12345-0@lo:38:kworker.0 00000004:00100000:1.0:1788361634.647583:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:2.0:1788361634.647598:0:23939:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d10f559800, cookie 0x1b69fa8920fe2c35 00000100:00080000:1.0:1788361634.647602:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d104f3c800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1788361634.647605:0:23939:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d10f559800 cur 2674 last 1788361629 00000004:00100000:2.0:1788361634.647618:0:23939:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788361634.647624:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429789696:0@lo:400:kworker.0 00000100:00080000:2.0:1788361634.647643:0:23939:0:(import.c:65:import_set_state_nolock()) ffff99d0055d7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361634.647649:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429790848:12345-0@lo:38:kworker.0 Request processed in 130us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361634.647656:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790592 00000100:00100000:3.0:1788361634.647662:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790592 00000100:00100000:1.0:1788361634.647670:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1788361634.647695:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429790080:12345-0@lo:38:kworker.0 Request processed in 112us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361634.647705:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:2.0:1788361634.647706:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:3.0:1788361634.647719:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429790592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361634.647738:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361634.647743:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788361634.647748:0:88905:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788361634.647749:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429789312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361634.647770:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429790592:12345-0@lo:400:kworker.0 Request processed in 56us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.647775:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429789952:0@lo:400:kworker.0 00010000:00080000:2.0:1788361634.647818:0:88905:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:2.0:1788361634.647840:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361634.647844:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:2.0:1788361634.647849:0:88905:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:2.0:1788361634.647852:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361634.647862:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d007350380 x1875230429790848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788361634.647863:0:88905:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406983808 t107374182407 from 192.168.204.35@tcp req@ffff99d12cfe1180 x1875230406983808/t0(107374182407) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:692/0 lens 528/0 e 0 to 0 dl 1788361642 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361634.647867:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1788361634.647875:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429789440 00000100:00100000:0.0:1788361634.647882:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429789440 00000100:00080000:1.0:1788361634.647894:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:1.0:1788361634.647903:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788361634.647909:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788361634.647912:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137f16000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788361634.647918:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788361634.647920:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429790592:0@lo:400:kworker.0 00000100:00100000:1.0:1788361634.647928:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429790848:0@lo:38:kworker.0 00000100:00100000:0.0:1788361634.647930:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429789440:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788361634.647954:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d10eaa5f80 x1875230429789568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361634.647964:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:0.0:1788361634.647981:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429789440:12345-0@lo:400:kworker.0 Request processed in 52us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361634.647988:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788361634.647996:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429789440:0@lo:400:kworker.0 00000004:00080000:3.0:1788361634.648855:0:88905:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 927us 00000100:00080000:1.0:1788361634.648959:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d10eaa5f80 x1875230429789568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361659 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361634.648968:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788361634.648973:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788361634.648977:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788361634.648982:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429789568:0@lo:38:kworker.0 00010000:00080000:1.0:1788361634.649063:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d108c7d500 x1875230429789824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361634.649075:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:1.0:1788361634.649942:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d108c7d500 x1875230429789824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361659 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361634.649950:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788361634.649954:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788361634.649957:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788361634.649962:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429789824:0@lo:38:kworker.0 00000100:00080000:1.0:1788361634.649985:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1788361634.650064:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788361634.650069:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788361634.650072:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:1.0:1788361634.650075:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d106904000 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:1.0:1788361634.650078:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788361634.650809:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429790080:0@lo:38:kworker.0 00010000:00080000:0.0:1788361634.650863:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d007351180 x1875230429790464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361634.650877:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1788361634.651913:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d007351180 x1875230429790464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361659 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361634.651924:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788361634.651929:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788361634.651933:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788361634.651938:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429790464:0@lo:38:kworker.0 00010000:00080000:1.0:1788361634.652735:0:89271:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788361634.652741:0:89271:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788361634.652747:0:89271:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788361634.653323:0:89271:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788361634.653483:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429790976:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788361634.653546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361634.653633:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429790976 00000100:00100000:3.0:1788361634.653640:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429790976 00000100:00100000:3.0:1788361634.653690:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:3.0:1788361634.653699:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429790976:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788361634.653723:0:8449:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d108c6f480 x1875230429790976/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:695/0 lens 224/0 e 0 to 0 dl 1788361645 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361634.653734:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429790976:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (189us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361634.653741:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00010000:00010000:3.0:1788361634.659588:0:88905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.659610:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.659623:0:88905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.659635:0:88905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.659642:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.659648:0:88905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660504:0:88905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660516:0:88905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660522:0:88905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660529:0:88905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361634.660533:0:88905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660540:0:88905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660553:0:88905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:3.0:1788361634.660556:0:88905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361634.660561:0:88905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660567:0:88905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2de7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361634.660581:0:88905:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008e236dd reply state 000000003172dedf transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660591:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.660597:0:88905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d1214c3500) 00010000:00010000:3.0:1788361634.660606:0:88905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361634.660609:0:88905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788361634.660714:0:88905:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788361634.660734:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.660737:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:3.0:1788361634.660741:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.660743:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000100:00100000:0.0:1788361634.662974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361634.663021:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406984320 00000100:00100000:1.0:1788361634.663032:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406984320 00000100:00100000:1.0:1788361634.663090:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1154 00000100:00100000:1.0:1788361634.663100:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406984320:12345-192.168.204.35@tcp:36:rm.0 00010000:00080000:1.0:1788361634.663117:0:66126:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:1.0:1788361634.663134:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406984320:12345-192.168.204.35@tcp:36:rm.0 Request processed in 36us (169us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361634.663142:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1154 00000020:00080000:2.0:1788361634.663186:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000001:00080000:3.0:1788361634.663231:0:88874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:1.0:1788361634.663268:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.663289:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.663297:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.663304:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361634.663308:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.663316:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.663334:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d1214c3500) 00010000:00010000:1.0:1788361634.663337:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361634.663341:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.663348:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2dee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788361634.663662:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:2.0:1788361634.663667:0:88905:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:2.0:1788361634.663670:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361634.663681:0:88905:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406984320 t107374182408 from 192.168.204.35@tcp req@ffff99d108c6d880 x1875230406984320/t0(107374182408) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 512/0 e 0 to 0 dl 1788361645 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361634.663769:0:88905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663782:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663793:0:88905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663804:0:88905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663812:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663819:0:88905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663933:0:88905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663942:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.663949:0:88905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664209:0:88905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664217:0:88905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664223:0:88905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664229:0:88905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361634.664233:0:88905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664240:0:88905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664394:0:88905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99d112e94d00) 00010000:00010000:2.0:1788361634.664399:0:88905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361634.664404:0:88905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664410:0:88905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e03 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664431:0:88905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664437:0:88905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664443:0:88905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664455:0:88905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eac00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361634.664459:0:88905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664465:0:88905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664473:0:88905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94a00) 00010000:00010000:2.0:1788361634.664476:0:88905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361634.664479:0:88905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664484:0:88905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2df5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361634.664496:0:88905:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dbf7208 reply state 000000003d7e9d96 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664505:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.664511:0:88905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d112e94500) 00010000:00010000:2.0:1788361634.664514:0:88905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361634.664516:0:88905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788361634.664588:0:88905:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361634.664603:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361634.664606:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1788361634.664609:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361634.664611:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:0.0:1788361634.667893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361634.667966:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985088 00000100:00100000:2.0:1788361634.667988:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985088 00000100:00100000:2.0:1788361634.668058:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1155 00000100:00100000:2.0:1788361634.668070:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406985088:12345-192.168.204.35@tcp:36:dd.0 00010000:00080000:2.0:1788361634.668095:0:67579:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:2.0:1788361634.668119:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406985088:12345-192.168.204.35@tcp:36:dd.0 Request processed in 52us (235us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361634.668127:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1155 00000020:00080000:3.0:1788361634.668253:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.668258:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:3.0:1788361634.668262:0:88905:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182407) 00000020:00080000:3.0:1788361634.668267:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.668277:0:88905:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406985088 t107374182410 from 192.168.204.35@tcp req@ffff99d108c6c380 x1875230406985088/t0(107374182410) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 488/0 e 0 to 0 dl 1788361645 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788361634.668497:0:88905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.668513:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.668526:0:88905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361634.668632:0:88905:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db844edd reply state 00000000346a3402 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.668645:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.668664:0:88905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:3.0:1788361634.668667:0:88905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361634.668671:0:88905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788361634.668771:0:88905:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788361634.668786:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.668789:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:3.0:1788361634.668792:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.668794:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:0.0:1788361634.672587:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361634.672641:0:66141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406985344 00000100:00100000:2.0:1788361634.672652:0:66141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406985344 00000100:00100000:2.0:1788361634.672726:0:66141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:2.0:1788361634.672737:0:66141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230406985344:12345-192.168.204.35@tcp:10:dd.0 00010000:00080000:2.0:1788361634.672756:0:66141:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:2.0:1788361634.672777:0:66141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230406985344:12345-192.168.204.35@tcp:10:dd.0 Request processed in 43us (200us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361634.672784:0:66141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000020:00080000:3.0:1788361634.672867:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.672871:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:3.0:1788361634.672875:0:88905:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:3.0:1788361634.672878:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.672888:0:88905:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406985344 t107374182411 from 192.168.204.35@tcp req@ffff99d108c6dc00 x1875230406985344/t0(107374182411) o10->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 440/0 e 0 to 0 dl 1788361645 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361634.673407:0:88905:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788361634.673425:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.673428:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:3.0:1788361634.673432:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.673435:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000100:00100000:0.0:1788361634.678037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361634.678309:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406990464 00000100:00100000:2.0:1788361634.678319:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406990464 00000100:00100000:2.0:1788361634.678407:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1156 00000100:00100000:2.0:1788361634.678418:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230406990464:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788361634.678445:0:66127:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d10695fb80 x1875230406990464/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 328/0 e 0 to 0 dl 1788361645 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361634.678469:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230406990464:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 55us (442us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361634.678476:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1156 00000020:00080000:3.0:1788361634.678521:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.678525:0:88905:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:3.0:1788361634.678529:0:88905:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788361634.678532:0:88905:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361634.678538:0:88905:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788361634.678540:0:88905:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788361634.678547:0:88905:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d10695fb80 x1875230406990464/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 328/0 e 0 to 0 dl 1788361645 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788361634.678579:0:88905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361634.678604:0:88905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710dcf expref: -99 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.678630:0:88905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 12 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.678644:0:88905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 12 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.678654:0:88905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be800, rc 0) 00010000:00080000:3.0:1788361634.678721:0:88905:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788361634.678734:0:88905:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1788361634.680092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361634.680135:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406990592 00000100:00100000:1.0:1788361634.680145:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406990592 00000100:00100000:1.0:1788361634.680197:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 843 00000100:00100000:1.0:1788361634.680211:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+12:2408:x1875230406990592:12345-192.168.204.35@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788361634.680227:0:66126:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d002d54e00 x1875230406990592/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 224/0 e 0 to 0 dl 1788361645 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361634.680251:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+12:2408:x1875230406990592:12345-192.168.204.35@tcp:400:ptlrpcd_rcv.0 Request processed in 43us (163us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361634.680272:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 843 00010000:00080000:3.0:1788361634.680309:0:88905:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788361634.680423:0:88905:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:2.0:1788361634.681732:0:88874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:2.0:1788361634.681746:0:88874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788361634.681771:0:88874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00010000:00010000:1.0:1788361634.681878:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681890:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681898:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681904:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361634.681909:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681918:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681935:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681941:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe2dfc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681965:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681971:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681976:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.681991:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361634.681995:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.682001:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.682010:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.682015:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe2e0a lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88905 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361634.682316:0:88905:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788361634.682351:0:88905:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788361634.682364:0:88905:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d108c6f480 x1875230429790976/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:695/0 lens 224/0 e 0 to 0 dl 1788361645 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788361634.682512:0:88905:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.35@tcp: req@ffff99d002d54e00 x1875230406990592/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 224/0 e 0 to 0 dl 1788361645 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788361634.682609:0:88905:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1788361634.683308:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788361634.683318:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d007351500 x1875230429790976/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361650 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361634.683329:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d007351500 x1875230429790976/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361650 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361634.683335:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788361634.683348:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788361634.683355:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000020fbf0e1): req@ffff99d108c7c000 x1875230429774976/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361629 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361634.683373:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429790976:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788361634.683437:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361634.683711:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429774976 00000100:00100000:0.0:1788361634.683724:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429774976 00000100:00100000:0.0:1788361634.683774:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:0.0:1788361634.683784:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429774976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788361634.683812:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444982784 avail 1298743296 00000100:00100000:0.0:1788361634.683879:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429774976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361634.683886:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00100000:1.0:1788361634.684135:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429774976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361634.684304:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361634.684314:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429791104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361634.684337:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.684532:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791104 00000100:00100000:2.0:1788361634.684537:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791104 00000100:00100000:2.0:1788361634.684578:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:2.0:1788361634.684586:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429791104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788361634.684600:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444982784 avail 1298743296 00000100:00100000:2.0:1788361634.684650:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429791104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.684657:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:1.0:1788361634.685156:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429791104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361634.687976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361634.688060:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361634.688163:0:66139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986368 00000100:00100000:0.0:1788361634.688172:0:66139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986368 00002000:00100000:0.0:1788361634.688225:0:66139:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99d007353480 x1875230406986368/t0(0) o4->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 496/0 e 0 to 0 dl 1788361645 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361634.688235:0:66139:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99d007353480 with x1875230406986368 00002000:00010000:0.0:1788361634.688246:0:66139:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 7 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361634.688328:0:66139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:0.0:1788361634.688339:0:66139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:ec302d84-8f96-49d3-8682-aefc474f8448+7:2410:x1875230406986368:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:2.0:1788361634.688352:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406990336 00000100:00100000:2.0:1788361634.688358:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406990336 00000100:00100000:2.0:1788361634.688393:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1157 00000100:00100000:2.0:1788361634.688401:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:68148:x1875230406990336:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361634.688412:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361634.688430:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710df9 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.688482:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.688496:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.688506:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361634.688548:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361634.688551:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361634.688599:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.688624:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe2e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710df9 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.688643:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710df9 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.688652:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94c00) 00010000:00010000:2.0:1788361634.688655:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361634.688658:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea400, rc 0) 00000100:00100000:2.0:1788361634.688710:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+9:68148:x1875230406990336:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 309us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.688717:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1157 00000100:00100000:0.0:1788361634.692352:0:66139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:2410:x1875230406986368:12345-192.168.204.35@tcp:4:dd.0 Request processed in 4004us (4373us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1788361634.692368:0:66139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00002000:00100000:0.0:1788361634.692383:0:66139:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99d007353480 x1875230406986368/t111669149697(0) o4->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:695/0 lens 496/448 e 0 to 0 dl 1788361645 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361634.692392:0:66139:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99d007353480 with x1875230406986368 00002000:00010000:0.0:1788361634.692405:0:66139:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 10 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361634.693752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361634.693790:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406986752 00000100:00100000:0.0:1788361634.693799:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406986752 00000100:00100000:0.0:1788361634.693872:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1158 00000100:00100000:0.0:1788361634.693881:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:2410:x1875230406986752:12345-192.168.204.35@tcp:16:kworker.0 00000001:00080000:2.0:1788361634.696593:0:88874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000100:00100000:0.0:1788361634.698209:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:2410:x1875230406986752:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 4321us (4455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361634.698221:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1158 00000100:00100000:2.0:1788361634.698394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361634.698614:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406990976 00000100:00100000:0.0:1788361634.698623:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406990976 00000100:00100000:0.0:1788361634.698665:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1159 00000100:00100000:0.0:1788361634.698674:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:68148:x1875230406990976:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361634.698708:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444982784 avail 1298743296 00000100:00100000:0.0:1788361634.698757:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:68148:x1875230406990976:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361634.698764:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1159 00000100:00100000:1.0:1788361634.702279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361634.702457:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991104 00000100:00100000:2.0:1788361634.702466:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991104 00000100:00100000:2.0:1788361634.702606:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1160 00000100:00100000:2.0:1788361634.702616:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:68148:x1875230406991104:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361634.702645:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:2.0:1788361634.702709:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:68148:x1875230406991104:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 95us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.702716:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1160 00000100:00080000:1.0:1788361634.703162:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000080:3.0:1788361634.705111:0:88905:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa08886ebe10 00100000:10000000:3.0:1788361634.705125:0:88905:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788361634.705942:0:88891:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:0.0:1788361634.705995:0:88891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88891:1875230429791232:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361634.706070:0:88891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361634.706098:0:88891:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361634.706102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361634.706122:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791232 00000100:00100000:3.0:1788361634.706125:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991232 00000100:00100000:0.0:1788361634.706129:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791232 00000100:00100000:3.0:1788361634.706133:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991232 00000100:00100000:0.0:1788361634.706165:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890 00000100:00100000:0.0:1788361634.706173:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88891:x1875230429791232:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788361634.706212:0:26168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -625 00002000:02000040:0.0:1788361634.706217:0:26168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1825) 00000100:00100000:3.0:1788361634.706505:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4891 00000100:00100000:3.0:1788361634.706512:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2408:x1875230406991232:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:3.0:1788361634.706538:0:26160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2674 last 0 00000020:00000080:3.0:1788361634.706562:0:26160:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe2e26 00002000:00100000:3.0:1788361634.706574:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d00541e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361634.706584:0:26160:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361634.706659:0:26160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361634.706688:0:26160:0:(import.c:65:import_set_state_nolock()) ffff99d005418800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361634.706741:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406991232:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 227us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361634.706750:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4891 00000004:00080000:2.0:1788361634.707952:0:88893:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1788361634.707996:0:88893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88893:1875230429791360:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361634.708059:0:88893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.708092:0:88893:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361634.708135:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791360 00000100:00100000:3.0:1788361634.708142:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791360 00000100:00100000:3.0:1788361634.708206:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:3.0:1788361634.708215:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:88893:x1875230429791360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361634.708236:0:26172:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -127 00002000:02000040:3.0:1788361634.708240:0:26172:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1825) 00000100:00100000:1.0:1788361634.714283:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361634.714323:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991360 00000100:00100000:1.0:1788361634.714332:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991360 00000100:00100000:1.0:1788361634.714393:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1490 00000100:00100000:1.0:1788361634.714404:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68148:x1875230406991360:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361634.714429:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361634.714487:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68148:x1875230406991360:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.714510:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1490 00000100:00080000:1.0:1788361634.714533:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1788361634.714590:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.714599:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714626:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.714630:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.714637:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714652:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714662:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714669:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714723:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361634.714855:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.714861:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714869:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.714872:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.714876:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714886:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714906:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.714914:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715280:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361634.715287:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715295:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785ea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.715300:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715310:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715328:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715336:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebffa1d6/0x1b69fa8920fe2e2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715354:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.715357:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715364:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785fa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.715367:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715387:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715398:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715407:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.715408:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.715410:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.715494:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.715499:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003720d771/0x1b69fa8920fe2e34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.715560:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.715566:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715575:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.715578:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.715582:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715591:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715600:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715618:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.715649:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361634.715655:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.715663:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.715667:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.715674:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.715686:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.715696:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.715698:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.715699:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.715759:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.715763:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba2295c1/0x1b69fa8920fe2e3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.715848:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.715854:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715862:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.715865:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.715869:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715878:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715887:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.715894:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715951:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.715957:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715964:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.715968:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715976:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715988:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.715997:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.715998:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.716006:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.716116:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.716121:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000728e4092/0x1b69fa8920fe2e42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.716184:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.716189:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716197:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.716200:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.716204:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716213:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716220:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716227:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716252:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.716257:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716265:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.716268:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716277:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716288:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716296:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.716297:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.716299:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.716361:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.716366:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7509e4/0x1b69fa8920fe2e49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.716433:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.716438:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716446:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.716449:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.716453:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716463:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716471:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716479:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716511:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.716516:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716522:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.716525:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716534:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716557:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.716565:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.716567:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.716569:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.716641:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.716646:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5884af/0x1b69fa8920fe2e50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.716698:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.716704:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716721:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.716724:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.716728:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716738:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716746:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.716754:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.716783:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361634.716788:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.716794:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.716797:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.716816:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.716884:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.716893:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.716895:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.716896:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.716965:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.716970:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b2f2c06/0x1b69fa8920fe2e57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.717022:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.717027:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717036:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.717039:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.717043:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717059:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717067:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717074:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717103:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.717108:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717115:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.717119:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717126:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717138:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717146:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.717148:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.717150:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.717225:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.717230:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075df593c/0x1b69fa8920fe2e5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.717283:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.717288:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717296:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.717299:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.717303:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717312:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717331:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717339:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717372:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.717376:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717394:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.717398:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717406:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717418:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717426:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.717428:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.717430:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.717490:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.717495:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe2e65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.717548:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.717553:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717561:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.717563:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.717568:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717577:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717585:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717603:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717632:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.717637:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717643:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.717647:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717655:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717666:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.717680:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.717682:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.717684:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.717719:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361634.717724:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d775ca/0x1b69fa8920fe2e6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.717774:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.717779:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717787:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.717790:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.717794:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717803:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717812:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717819:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717868:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361634.717911:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.717916:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717924:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.717927:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.717931:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717940:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717948:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717956:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.717968:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361634.718003:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718008:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718015:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718024:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718029:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718039:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718046:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718053:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718064:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788361634.718103:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718108:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718116:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718119:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718123:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718131:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718139:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718155:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718164:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788361634.718215:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718220:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718228:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718231:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718235:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718244:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718252:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718259:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718268:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788361634.718303:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718308:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718321:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718323:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718329:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718337:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718345:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718352:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718360:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788361634.718396:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718401:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718408:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718411:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718414:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718423:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718441:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718448:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718455:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788361634.718488:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718493:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718500:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718503:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718507:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718515:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718522:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718529:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718548:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788361634.718585:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718591:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718599:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718602:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718606:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718615:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718623:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718631:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718640:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788361634.718676:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718681:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718688:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718697:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718701:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718710:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718718:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718726:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718735:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788361634.718771:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718776:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718784:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718787:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718791:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718799:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718806:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718819:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718848:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788361634.718886:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718891:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718899:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.718902:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.718906:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718915:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718923:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718930:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718939:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1788361634.718974:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.718979:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.718998:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.719001:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.719006:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719016:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719024:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719032:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719039:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788361634.719044:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:1.0:1788361634.719047:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719059:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719064:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719074:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.719085:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.719089:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719092:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719107:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcbe852e/0x1b69fa8920fe2e73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719109:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.719116:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.719125:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719136:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719137:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788361634.719144:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719152:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361634.719163:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719174:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719185:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719206:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:1.0:1788361634.719208:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719222:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719230:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe635217/0x1b69fa8920fe2e7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719247:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00002000:00010000:0.0:1788361634.719251:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.719252:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719262:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719265:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719271:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719277:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:1.0:1788361634.719284:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719284:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.719290:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719306:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719312:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719318:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719326:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095aa627f/0x1b69fa8920fe2e81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719331:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719360:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788361634.719365:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719366:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1788361634.719376:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719379:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719387:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719398:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719406:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ac060d/0x1b69fa8920fe2e88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.719411:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.719417:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719426:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.719429:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361634.719434:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788361634.719434:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719441:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719448:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719452:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719458:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719464:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719474:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719497:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1788361634.719498:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719513:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719521:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe2e8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.719532:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.719536:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788361634.719539:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719542:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719557:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:1.0:1788361634.719558:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719561:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719571:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361634.719574:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719578:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719590:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719594:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719603:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040552794/0x1b69fa8920fe2e96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719610:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719625:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719637:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788361634.719638:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:1.0:1788361634.719642:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719651:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719654:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719665:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719676:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.719682:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.719684:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca1e9b65/0x1b69fa8920fe2e9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719691:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719702:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788361634.719702:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:1.0:1788361634.719709:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719709:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.719719:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719722:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719727:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719734:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719748:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719754:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719777:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719780:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719796:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:1.0:1788361634.719797:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c7b8f70/0x1b69fa8920fe2ea4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719814:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788361634.719818:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719847:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.719851:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719859:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.719860:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361634.719870:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719877:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719881:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.719885:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.719893:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719898:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1aa9c47/0x1b69fa8920fe2eab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719911:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.719933:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719940:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788361634.719942:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719945:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719963:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361634.719965:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:1.0:1788361634.719967:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719977:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719988:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.719995:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe2eb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.720007:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.720008:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788361634.720014:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720018:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720023:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720028:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720038:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.720043:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.720049:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720058:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720063:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720074:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720076:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720095:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe2eb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720097:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720121:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:1.0:1788361634.720124:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788361634.720128:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720135:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720139:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720146:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720157:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.720162:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.720164:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f47e38fe/0x1b69fa8920fe2ec0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720171:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720201:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.720206:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361634.720210:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788361634.720210:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720217:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720224:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720226:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720233:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720243:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720258:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720262:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720275:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720278:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e223c11/0x1b69fa8920fe2ec7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720301:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1788361634.720304:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788361634.720309:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720316:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720319:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720340:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361634.720348:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.720351:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720356:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720364:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099685d0c/0x1b69fa8920fe2ece lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720369:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.720377:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.720382:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720383:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788361634.720388:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720398:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720399:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720404:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720417:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720419:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720439:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720443:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720457:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b3e00d/0x1b69fa8920fe2ed5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.720478:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1788361634.720492:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788361634.720496:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720503:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720507:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720515:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720525:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720533:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c756ddb/0x1b69fa8920fe2edc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720547:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788361634.720551:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720558:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720560:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720578:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720588:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720595:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4e45cef/0x1b69fa8920fe2ee3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720607:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788361634.720610:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788361634.720617:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720617:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720634:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.720638:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720639:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720644:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720654:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720660:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720667:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720677:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720678:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe2ef1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720699:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe2eea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720727:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361634.720733:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720742:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720746:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720747:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361634.720754:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720758:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720769:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.720775:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720778:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720792:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720794:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe2ef8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720837:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720842:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.720848:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720851:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd478e66/0x1b69fa8920fe2eff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720867:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.720872:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.720877:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.720880:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.720882:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.720893:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720905:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720912:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe2f06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.720925:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.720928:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.720930:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.720938:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.720946:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.723340:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.723350:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723366:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.723370:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.723376:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723401:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723412:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723420:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723448:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.723529:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.723535:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723543:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.723546:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.723550:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723559:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723566:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723584:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723684:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788361634.723811:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.723818:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723841:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.723845:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.723849:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723859:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723868:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.723876:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724004:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788361634.724010:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724018:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.724027:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724036:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724051:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.724051:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361634.724057:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724059:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac1c782/0x1b69fa8920fe2f0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.724065:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.724068:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724074:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.724076:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724077:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724084:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.724087:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724088:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724095:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.724100:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe2f14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724104:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724110:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.724112:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.724113:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724115:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.724115:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724117:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.724295:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361634.724300:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe2f1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.724365:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.724370:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724379:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.724383:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.724387:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724397:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724406:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724414:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724428:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.724461:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.724466:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724473:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.724476:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.724486:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724495:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724501:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.724503:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724506:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724511:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724514:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.724518:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724523:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361634.724525:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724536:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724543:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe2f22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724556:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788361634.724558:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361634.724559:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724563:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724566:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.724569:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724571:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.724575:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.724578:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724588:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724589:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724596:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724599:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724607:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe2f29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724613:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724617:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724621:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.724626:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361634.724627:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724633:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724634:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.724637:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724644:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724653:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.724667:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.724672:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724672:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe2f30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724680:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.724683:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361634.724685:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.724687:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724687:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724688:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.724696:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724704:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724712:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724754:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.724792:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.724885:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724894:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.724897:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.724901:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724910:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724919:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724926:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724927:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361634.724932:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724939:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361634.724939:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.724942:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724945:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.724949:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724950:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724956:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.724959:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724962:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724967:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724970:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe2f37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.724983:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724983:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.724985:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.724990:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe2f3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.724990:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725002:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725004:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725005:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.725252:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.725258:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.725443:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.725449:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725457:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.725460:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.725465:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725474:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725482:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725490:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725521:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.725561:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.725565:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725573:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.725575:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.725579:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725589:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725597:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725605:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725618:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361634.725625:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361634.725629:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725636:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.725645:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725654:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725665:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725673:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe2f45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788361634.725682:0:26168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00010000:00010000:3.0:1788361634.725686:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.725689:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725694:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.725697:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725702:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725710:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725716:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe2f4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725731:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725732:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361634.725765:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88891:x1875230429791232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19589us (19690us total) trans 0 rc 0/0 00002000:00010000:3.0:1788361634.725773:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1788361634.725776:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890 00010000:00010000:3.0:1788361634.725778:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725785:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.725788:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.725792:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725800:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725848:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725857:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.725857:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725886:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361634.725905:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361634.725910:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.725917:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361634.725921:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.725928:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361634.725928:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725933:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.725939:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.725947:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe2f53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725949:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.725953:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.725956:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361634.725959:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.725961:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.725963:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.725965:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725973:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725981:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.725994:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.726032:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1788361634.726035:0:88891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88891:1875230429791232:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788361634.726048:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361634.726050:0:88891:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x4b0:0x0] 00010000:00010000:3.0:1788361634.726056:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.726059:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.726062:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726070:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726088:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726097:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361634.726114:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429791488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361634.726114:0:88891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88891:1875230429791616:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788361634.726156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361634.726156:0:88891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361634.726187:0:88891:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361634.726202:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791616 00000100:00100000:3.0:1788361634.726204:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791488 00000100:00100000:3.0:1788361634.726207:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791488 00000100:00100000:0.0:1788361634.726207:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791616 00000100:00100000:3.0:1788361634.726238:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1788361634.726238:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893 00000100:00100000:3.0:1788361634.726246:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429791488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361634.726246:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:88891:x1875230429791616:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:3.0:1788361634.726264:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00080000:0.0:1788361634.726275:0:26168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00000100:00100000:3.0:1788361634.726297:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429791488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361634.726303:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1788361634.726336:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429791488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361634.726355:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361634.726362:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361634.726367:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726375:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.726378:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726393:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726405:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726412:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe2f5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726426:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.726429:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726435:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.726439:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726445:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726455:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726462:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe2f61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726483:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.726484:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.726486:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.726524:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.726528:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726535:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.726539:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.726543:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726552:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726559:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726566:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726672:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.726710:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.726715:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726735:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.726738:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.726743:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726752:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726760:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726768:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726781:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788361634.726819:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.726841:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726850:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.726853:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.726857:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726865:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726883:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726891:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726902:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788361634.726910:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361634.726914:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726920:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.726924:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726931:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726943:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726951:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe2f68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726966:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361634.726974:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726982:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.726985:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.726994:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727005:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727013:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe2f6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727026:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.727029:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727036:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.727039:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727047:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727069:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe2f76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727089:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727091:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727093:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.727131:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.727136:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727221:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.727225:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.727230:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727240:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727248:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727256:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727278:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361634.727286:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.727290:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727296:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.727300:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727309:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727320:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727328:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe2f7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727342:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727344:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727345:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.727384:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.727390:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727398:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.727406:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.727411:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727421:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727430:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727437:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727450:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361634.727457:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.727461:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727467:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.727470:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727478:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727489:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727506:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe2f84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727520:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727521:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727523:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.727563:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1788361634.727642:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:88891:x1875230429791616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1395us (1494us total) trans 4294968748 rc 0/0 00000100:00100000:0.0:1788361634.727650:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893 00000100:00100000:0.0:1788361634.727689:0:88891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88891:1875230429791616:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361634.727702:0:88891:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00010000:00010000:3.0:1788361634.727715:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727725:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.727728:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.727731:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727741:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.727746:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.727749:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727772:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727880:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.727941:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.727946:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727954:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.727956:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.727960:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727969:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727976:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727983:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.727996:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361634.728003:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361634.728007:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.728007:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361634.728012:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728014:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.728017:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.728027:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361634.728030:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.728038:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.728049:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.728056:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b2ee3f7/0x1b69fa8920fe2f92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.728071:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.728072:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.728074:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.728101:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728112:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728119:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe2f8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728132:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.728134:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.728134:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.728136:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.728139:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361634.728253:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.728258:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728266:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.728269:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.728273:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728283:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728291:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728304:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728324:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788361634.728354:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00010000:3.0:1788361634.728362:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.728367:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728375:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.728378:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.728383:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728388:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.728391:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728393:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728400:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728400:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.728404:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728407:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728412:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728417:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361634.728422:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728429:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f541ca4/0x1b69fa8920fe2f99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728443:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788361634.728451:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.728452:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728456:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728459:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.728462:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728467:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.728470:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361634.728470:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728475:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728480:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728483:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728489:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007430d0d0/0x1b69fa8920fe2fa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728491:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728498:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728501:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.728502:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.728504:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.728510:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361634.728517:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361634.728520:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728527:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.728530:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728537:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728558:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728566:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a416d0/0x1b69fa8920fe2fa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728579:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.728580:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.728582:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361634.728583:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991488 00000100:00100000:2.0:1788361634.728589:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991488 00002000:00010000:3.0:1788361634.728625:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.728630:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728638:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.728640:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.728645:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728653:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361634.728660:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4894 00010000:00010000:3.0:1788361634.728661:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361634.728667:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2408:x1875230406991488:12345-192.168.204.35@tcp:8:lfs.0 00010000:00010000:3.0:1788361634.728668:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788361634.728715:0:26167:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp t0 exp 0000000000000000 cur 2674 last 0 00010000:00010000:3.0:1788361634.728734:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00000080:2.0:1788361634.728743:0:26167:0:(genops.c:1406:class_connect()) connect: client ec302d84-8f96-49d3-8682-aefc474f8448, cookie 0x1b69fa8920fe2fb5 00002000:00100000:2.0:1788361634.728754:0:26167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec302d84-8f96-49d3-8682-aefc474f8448/ffff99d137ea0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788361634.728765:0:26167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00010000:3.0:1788361634.728773:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.728778:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728786:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.728788:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.728792:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728800:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788361634.728803:0:26167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00010000:3.0:1788361634.728808:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.728814:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361634.728862:0:26167:0:(import.c:65:import_set_state_nolock()) ffff99d137ea6000 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1788361634.728881:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361634.728886:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728892:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.728895:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728913:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361634.728914:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406991488:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 246us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361634.728921:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4894 00010000:00010000:1.0:1788361634.728924:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728931:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028c75006/0x1b69fa8920fe2fae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728943:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.728946:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728953:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.728956:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728963:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728972:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.728979:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.728980:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.728988:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.729024:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729205:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361634.729266:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a16e5e8/0x1b69fa8920fe2fbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.729322:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.729326:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729339:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.729342:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.729346:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729355:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729363:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729370:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729391:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361634.729392:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.729397:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729404:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.729407:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729415:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729425:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.729428:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.729432:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729434:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb295b38/0x1b69fa8920fe2fc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729440:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.729443:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.729447:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729447:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.729448:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.729450:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729456:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729477:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729483:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729494:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361634.729512:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.729516:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729523:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.729526:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.729534:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.729539:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729544:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729546:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.729549:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.729553:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729555:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729562:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729563:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003277a5dc/0x1b69fa8920fe2fca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729570:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729576:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729577:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729578:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.729579:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729652:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361634.729697:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.729703:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729703:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361634.729708:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729711:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.729714:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361634.729716:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361634.729718:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729720:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729728:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729736:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729739:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729745:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729750:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe2fd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729763:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361634.729775:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361634.729778:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729784:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fee00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361634.729788:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729794:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.729798:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361634.729803:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729805:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729810:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:0.0:1788361634.729812:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d479f9dd/0x1b69fa8920fe2fd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729819:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.729842:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729852:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.729856:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.729858:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.729859:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729860:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729867:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729885:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361634.729903:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.729907:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729915:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.729918:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.729923:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.729926:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729927:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729935:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:1.0:1788361634.729937:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729938:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.729942:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729950:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729955:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e849edb/0x1b69fa8920fe2fdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.729958:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729968:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.729969:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729970:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.729971:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361634.729983:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361634.729991:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361634.730005:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.730012:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361634.730016:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361634.730021:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361634.730023:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.730026:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.730034:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=2674s v=(0 0) 00010000:00010000:3.0:1788361634.730036:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361634.730040:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.730049:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.730056:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.730063:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361634.730076:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361634.730111:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361634.730116:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.730123:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361634.730126:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.730135:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.730146:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.730165:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe2fed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361634.730188:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.730190:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361634.730192:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.730215:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.730225:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d30c40b/0x1b69fa8920fe2fe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361634.730238:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.730240:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.730249:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361634.730254:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361634.730400:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788361634.730605:0:26172:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00000100:00100000:3.0:1788361634.730666:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:88893:x1875230429791360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22451us (22604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361634.730679:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00000100:00100000:2.0:1788361634.730701:0:88893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88893:1875230429791360:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788361634.730719:0:88893:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1788361634.730793:0:88893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88893:1875230429791872:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361634.730803:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361634.730814:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429791744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361634.730851:0:88893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361634.730869:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361634.730874:0:88893:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361634.730890:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791872 00000100:00100000:2.0:1788361634.730895:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791872 00000100:00100000:2.0:1788361634.730934:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4895 00000100:00100000:2.0:1788361634.730942:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:88893:x1875230429791872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788361634.730977:0:26161:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:1.0:1788361634.731113:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429791744 00000100:00100000:1.0:1788361634.731117:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429791744 00000100:00100000:1.0:1788361634.731150:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1788361634.731167:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429791744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361634.731191:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361634.731230:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429791744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361634.731236:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:3.0:1788361634.731244:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429791744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361634.731901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361634.732276:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991616 00000100:00100000:0.0:1788361634.732283:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991616 00000100:00100000:0.0:1788361634.732340:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1493 00000100:00100000:0.0:1788361634.732357:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68148:x1875230406991616:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361634.732372:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788361634.732405:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361634.732425:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68148:x1875230406991616:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 70us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361634.732433:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1493 00000100:00100000:2.0:1788361634.733107:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:88893:x1875230429791872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2164us (2254us total) trans 4294968749 rc 0/0 00000100:00100000:2.0:1788361634.733114:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4895 00000100:00100000:3.0:1788361634.733220:0:88893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88893:1875230429791872:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361634.733235:0:88893:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00010000:00010000:0.0:1788361634.902225:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361635.164506:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788361635.925941:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361636.744940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361636.744971:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361636.744997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361636.745011:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991744 00000100:00100000:2.0:1788361636.745022:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991744 00000100:00100000:0.0:1788361636.745063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361636.745093:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:2.0:1788361636.745104:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230406991744:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361636.745158:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992256 00000100:00100000:3.0:1788361636.745163:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992256 00000100:00100000:2.0:1788361636.745197:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230406991744:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 94us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361636.745210:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:3.0:1788361636.745228:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1834 00000100:00100000:3.0:1788361636.745240:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406992256:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361636.745288:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406992256:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361636.745296:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1834 00000100:00100000:1.0:1788361636.745347:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992000 00000100:00100000:1.0:1788361636.745354:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992000 00000100:00100000:0.0:1788361636.745358:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406991872 00000100:00100000:0.0:1788361636.745364:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406991872 00000100:00100000:1.0:1788361636.745396:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 844 00000100:00100000:0.0:1788361636.745403:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 845 00000100:00100000:1.0:1788361636.745409:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406992000:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361636.745423:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:2409:x1875230406991872:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361636.745445:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406992000:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 41us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361636.745453:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 844 00000100:00100000:0.0:1788361636.745461:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:2409:x1875230406991872:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 47us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361636.745470:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 845 00000100:00080000:1.0:1788361636.745476:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361636.745718:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361636.745723:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361636.746048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361636.746436:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992128 00000100:00100000:3.0:1788361636.746449:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992128 00000100:00100000:3.0:1788361636.746695:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1835 00000100:00100000:3.0:1788361636.746719:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406992128:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361636.746874:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406992128:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 158us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361636.746884:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1835 00000100:00080000:0.0:1788361636.747160:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788361636.950130:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361637.744577:0:89454:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788361637.974045:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361638.581725:0:89502:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788361638.742422:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361638.742449:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429792000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361638.742525:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361638.742571:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429792128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361638.742581:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792000 00000100:00100000:1.0:1788361638.742590:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792000 00000100:00100000:2.0:1788361638.742598:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361638.742657:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792128 00000100:00100000:1.0:1788361638.742662:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792128 00000100:00100000:3.0:1788361638.742673:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:3.0:1788361638.742752:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429792000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361638.742792:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361638.742846:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429792000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361638.742851:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:3.0:1788361638.742865:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1788361638.742869:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429792128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788361638.742880:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361638.742904:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429792128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361638.742911:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1788361638.742948:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429792128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361638.742965:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429792000:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788361638.743028:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361638.743033:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788361638.997968:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361639.766102:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429792384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361639.766134:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429792512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361639.766140:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361639.766156:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429792640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361639.766282:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429793152:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.767739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.767793:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429792768:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.767794:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.767838:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429792256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361639.767840:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.767864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.767865:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429793280:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.767884:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429792896:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.767889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.767903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.767905:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429793792:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.767917:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429793408:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.767933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.767933:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.767947:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429793920:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.767947:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875230429794304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.767965:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.767965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.767981:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788361639.767987:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429793024:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.767997:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792640 00000100:00100000:2.0:1788361639.768005:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792640 00000100:00100000:3.0:1788361639.768006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.768022:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429793536:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.768042:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792384 00000100:00100000:2.0:1788361639.768044:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792384 00000100:00100000:2.0:1788361639.768055:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793408 00000100:00100000:2.0:1788361639.768058:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793408 00000100:00100000:3.0:1788361639.768059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.768065:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793920 00000100:00100000:2.0:1788361639.768067:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793920 00000100:00100000:3.0:1788361639.768088:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429794048:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.768090:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1788361639.768099:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429792640:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361639.768107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.768133:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792256 00000100:00100000:3.0:1788361639.768136:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792256 00000004:00000024:2.0:1788361639.768136:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444978688 avail 1298739200 00000100:00100000:3.0:1788361639.768173:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1788361639.768178:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429792640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.768179:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429792256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361639.768185:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00002000:00000024:3.0:1788361639.768192:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361639.768200:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:2.0:1788361639.768205:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429792384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361639.768220:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:3.0:1788361639.768222:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429792256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.768228:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1788361639.768244:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429792384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.768249:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:2.0:1788361639.768258:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:2.0:1788361639.768264:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429793408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.768265:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429792384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361639.768279:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429792256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361639.768289:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429793408:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.768301:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429793408:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.768303:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:2.0:1788361639.768315:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1788361639.768320:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429793920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.768332:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793280 00000100:00100000:3.0:1788361639.768335:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793280 00000100:00100000:2.0:1788361639.768352:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429793920:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.768358:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:3.0:1788361639.768359:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792896 00000100:00100000:3.0:1788361639.768361:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792896 00000100:00100000:3.0:1788361639.768372:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793792 00000100:00100000:3.0:1788361639.768375:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793792 00000100:00100000:2.0:1788361639.768383:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429792640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361639.768384:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429794304 00000100:00100000:3.0:1788361639.768386:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429794304 00000100:00100000:3.0:1788361639.768394:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793024 00000100:00100000:3.0:1788361639.768397:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793024 00000100:00100000:3.0:1788361639.768410:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1788361639.768414:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1788361639.768416:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429793280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.768420:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429792896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.768444:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429792896:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.768446:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429793280:12345-0@lo:400:kworker.0 Request processed in 31us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.768450:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1788361639.768456:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1788361639.768462:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1788361639.768465:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1788361639.768467:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429793792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.768470:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875230429794304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.768491:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875230429794304:12345-0@lo:400:kworker.0 Request processed in 20us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.768491:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429793792:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.768497:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1788361639.768555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361639.768589:0:88881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792768 00000100:00100000:0.0:1788361639.768593:0:88881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792768 00000100:00100000:0.0:1788361639.768616:0:88881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788361639.768622:0:88881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361639.768649:0:88881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429792768:12345-0@lo:400:kworker.0 Request processed in 28us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361639.768655:0:88881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788361639.769450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361639.769480:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429793664:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.769507:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361639.769531:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429794176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.769553:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361639.769590:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793152 00000100:00100000:1.0:1788361639.769595:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793152 00000100:00100000:2.0:1788361639.769652:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1788361639.769658:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1788361639.769667:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429793024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769689:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429792768:0@lo:400:kworker.0 00000100:00100000:0.0:1788361639.769699:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429793024:12345-0@lo:400:kworker.0 Request processed in 35us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.769700:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429793280:0@lo:400:kworker.0 00000100:00100000:0.0:1788361639.769706:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1788361639.769709:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429793792:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769718:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875230429794304:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769761:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429793024:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769780:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429792896:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769794:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429793920:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769856:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793536 00000100:00100000:2.0:1788361639.769860:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793536 00000100:00100000:2.0:1788361639.769887:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429794048 00000100:00100000:2.0:1788361639.769890:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429794048 00000100:00100000:2.0:1788361639.769907:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429793664 00000100:00100000:2.0:1788361639.769909:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429793664 00000100:00100000:2.0:1788361639.769924:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429794176 00000100:00100000:2.0:1788361639.769926:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429794176 00000100:00100000:2.0:1788361639.769946:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1788361639.769952:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429793536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.769989:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429793536:12345-0@lo:400:kworker.0 Request processed in 37us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.769996:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1788361639.770008:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:2.0:1788361639.770014:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429794048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.770042:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429794048:12345-0@lo:400:kworker.0 Request processed in 29us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.770048:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:2.0:1788361639.770059:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1788361639.770065:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429793664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.770107:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429793664:12345-0@lo:400:kworker.0 Request processed in 42us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.770113:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1788361639.770124:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1788361639.770136:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429794176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.770164:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429794176:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361639.770170:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00080000:2.0:1788361639.770195:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361639.770200:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361639.770202:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361639.770204:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361639.770246:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429792512 00000100:00100000:0.0:1788361639.770251:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429792512 00000100:00100000:0.0:1788361639.770275:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1788361639.770281:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429792512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361639.770294:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361639.770325:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429792512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361639.770331:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1788361639.770361:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429792512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361639.770408:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429793664:0@lo:400:kworker.0 00000100:00100000:0.0:1788361639.770416:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429794176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.771021:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1788361639.771030:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429793152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.771096:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429793152:12345-0@lo:400:kworker.0 Request processed in 68us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361639.771103:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1788361639.771160:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429793152:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.771271:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429793536:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.771294:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429794048:0@lo:400:kworker.0 00010000:00010000:1.0:1788361640.022994:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361640.036190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361640.036384:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992384 00000100:00100000:2.0:1788361640.036395:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992384 00000100:00100000:2.0:1788361640.036483:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1161 00000100:00100000:2.0:1788361640.036494:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:68617:x1875230406992384:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361640.036533:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444978688 avail 1298739200 00000100:00080000:0.0:1788361640.036603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361640.036623:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:68617:x1875230406992384:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 130us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361640.036632:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1161 00000100:00100000:1.0:1788361640.038922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361640.039124:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992512 00000100:00100000:0.0:1788361640.039133:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992512 00000100:00080000:2.0:1788361640.039184:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361640.039206:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1162 00000100:00100000:0.0:1788361640.039219:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:68617:x1875230406992512:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361640.039253:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361640.039319:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:68617:x1875230406992512:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361640.039326:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1162 00000100:00100000:3.0:1788361640.041565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361640.041770:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992640 00000100:00100000:0.0:1788361640.041780:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992640 00000100:00100000:0.0:1788361640.041898:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1498 00000100:00100000:0.0:1788361640.041910:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68617:x1875230406992640:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361640.041942:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788361640.041945:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361640.042012:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68617:x1875230406992640:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 105us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361640.042020:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1498 00000100:00100000:1.0:1788361640.044182:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361640.044267:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406992768 00000100:00100000:0.0:1788361640.044277:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406992768 00000100:00100000:0.0:1788361640.044395:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1499 00000100:00080000:2.0:1788361640.044402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361640.044409:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68617:x1875230406992768:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361640.044442:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361640.044506:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:68617:x1875230406992768:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361640.044513:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1499 00000100:00100000:1.0:1788361640.064024:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361640.065209:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993024 00000100:00100000:3.0:1788361640.065220:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993024 00000100:00100000:3.0:1788361640.065301:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1163 00000100:00100000:3.0:1788361640.065312:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:68633:x1875230406993024:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:3.0:1788361640.065331:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361640.065350:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe200/0x1b69fa8920fe2ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e00 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065473:0:80345:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 9 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065491:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065505:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065517:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065609:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065631:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065636:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065642:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361640.065646:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065653:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065664:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:3.0:1788361640.065668:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361640.065672:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065678:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe2ffb lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065727:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe200/0x1b69fa8920fe2ff4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e00 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065736:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94c00) 00010000:00010000:3.0:1788361640.065739:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361640.065742:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe200/0x1b69fa8920fe2ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e00 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.065752:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371fe200, rc 0) 00000100:00100000:3.0:1788361640.065859:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+9:68633:x1875230406993024:12345-192.168.204.35@tcp:101:cat.0 Request processed in 513us (1809us total) trans 111669149698 rc 301/301 00000100:00100000:3.0:1788361640.065866:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1163 00000100:00100000:3.0:1788361640.071137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361640.071603:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993152 00000100:00100000:2.0:1788361640.071614:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993152 00000100:00100000:2.0:1788361640.071680:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1164 00000100:00100000:2.0:1788361640.071690:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+9:68633:x1875230406993152:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:2.0:1788361640.071724:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361640.071761:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe3009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e07 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.071850:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.071866:0:66901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 10 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.071874:0:66901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.071906:0:66901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 10 pid: 88905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.071919:0:66901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 10 pid: 88905 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361640.071934:0:66901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141099c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66901:1875230429794432:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361640.072018:0:66901:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11f01be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361640.075393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361640.075498:0:66901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141099c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66901:1875230429794432:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361640.075522:0:66901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361640.075577:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993280 00000100:00100000:0.0:1788361640.075584:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993280 00010000:00010000:0.0:1788361640.075613:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 11 pid: 88905 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361640.075651:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2586 00000100:00100000:0.0:1788361640.075662:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2410:x1875230406993280:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361640.075676:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1788361640.075696:0:6509:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:0.0:1788361640.075698:0:6509:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788361610 00000004:00010000:0.0:1788361640.075701:0:6509:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788361606 00000004:00010000:0.0:1788361640.075703:0:6509:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788361610 00010000:00010000:0.0:1788361640.075709:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 11 pid: 88905 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361640.075722:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 11 pid: 88905 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361640.075749:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe2e11 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710dcf expref: 11 pid: 88905 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361640.075767:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:0.0:1788361640.075772:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361640.075781:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361640.075802:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361640.075866:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361640.075963:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:2410:x1875230406993280:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 301us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361640.075972:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2586 00010000:00010000:2.0:1788361640.075982:0:66901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.075992:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361640.076163:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361640.076186:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.076214:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe3009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e07 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.076227:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e07 expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361640.076234:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:2.0:1788361640.076237:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361640.076239:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eac00, rc 0) 00000100:00100000:2.0:1788361640.076264:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+9:68633:x1875230406993152:12345-192.168.204.35@tcp:101:cat.0 Request processed in 4576us (5138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361640.076271:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1164 00000100:00100000:1.0:1788361640.077933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361640.078017:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993408 00000100:00100000:3.0:1788361640.078026:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993408 00000100:00100000:3.0:1788361640.078215:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1165 00000100:00100000:3.0:1788361640.078225:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+9:68633:x1875230406993408:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:3.0:1788361640.078244:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361640.078261:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe3017 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e0e expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.078311:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe3017 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e0e expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.078326:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe3017 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e0e expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361640.078345:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:3.0:1788361640.078349:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361640.078352:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ffc00, rc 0) 00000100:00100000:3.0:1788361640.078443:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:68633:x1875230406993408:12345-192.168.204.35@tcp:101:cat.0 Request processed in 219us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361640.078451:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1165 00000100:00100000:3.0:1788361640.080120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361640.080380:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993536 00000100:00100000:1.0:1788361640.080389:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993536 00000100:00100000:1.0:1788361640.080440:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1166 00000100:00100000:1.0:1788361640.080450:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:2409:x1875230406993536:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:1.0:1788361640.080468:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361640.080487:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ae00/0x1b69fa8920fe301e lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e15 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361640.080516:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ae00/0x1b69fa8920fe301e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e15 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361640.080562:0:66127:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:1.0:1788361640.080566:0:66127:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788361610 -> 1788361610 00000004:00010000:1.0:1788361640.080568:0:66127:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788361606 -> 1788361606 00000004:00010000:1.0:1788361640.080571:0:66127:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788361610 -> 1788361610 00000004:00010000:1.0:1788361640.080573:0:66127:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:1.0:1788361640.080577:0:66127:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:1.0:1788361640.080585:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ae00/0x1b69fa8920fe301e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e15 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361640.080597:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99d1214c3c00) 00010000:00010000:1.0:1788361640.080601:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361640.080604:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166ae00, rc 0) 00000100:00100000:1.0:1788361640.080657:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2409:x1875230406993536:12345-192.168.204.35@tcp:101:cat.0 Request processed in 208us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361640.080664:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1166 00000100:00100000:0.0:1788361640.083473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361640.083554:0:66140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993664 00000100:00100000:1.0:1788361640.083564:0:66140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993664 00002000:00100000:1.0:1788361640.083627:0:66140:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99d002d55880 x1875230406993664/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:701/0 lens 488/0 e 0 to 0 dl 1788361651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361640.083639:0:66140:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99d002d55880 with x1875230406993664 00000100:00100000:1.0:1788361640.083681:0:66140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788361640.083691:0:66140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2411:x1875230406993664:12345-192.168.204.35@tcp:3:cat.0 00000100:00100000:1.0:1788361640.084041:0:66140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:2411:x1875230406993664:12345-192.168.204.35@tcp:3:cat.0 Request processed in 350us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788361640.084049:0:66140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00002000:00100000:1.0:1788361640.084062:0:66140:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99d002d55880 x1875230406993664/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:701/0 lens 488/4536 e 0 to 0 dl 1788361651 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361640.084070:0:66140:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99d002d55880 with x1875230406993664 00000100:00100000:0.0:1788361640.087087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361640.087189:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406993920 00000100:00100000:1.0:1788361640.087201:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406993920 00000100:00100000:1.0:1788361640.087248:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 224 00000100:00100000:1.0:1788361640.087257:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+11:68633:x1875230406993920:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:1.0:1788361640.087495:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+12:68633:x1875230406993920:12345-192.168.204.35@tcp:35:cat.0 Request processed in 240us (430us total) trans 111669149699 rc 0/0 00000100:00100000:1.0:1788361640.087512:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 224 00000001:00080000:1.0:1788361640.794881:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968748 is committed 00000001:00100000:1.0:1788361640.794941:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00080000:3.0:1788361640.795379:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968749 is committed 00000001:00100000:3.0:1788361640.795396:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00080000:2.0:1788361640.795616:0:88874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:1.0:1788361641.046021:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361641.863380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361641.863421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361641.863440:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994048 00000100:00100000:0.0:1788361641.863450:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994048 00000100:00100000:2.0:1788361641.863460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361641.863499:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994304 00000100:00100000:1.0:1788361641.863505:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994304 00000100:00100000:0.0:1788361641.863513:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:0.0:1788361641.863523:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406994048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361641.863538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361641.863550:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994176 00000100:00100000:1.0:1788361641.863555:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994176 00000100:00100000:1.0:1788361641.863587:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 852 00000100:00100000:1.0:1788361641.863598:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406994304:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361641.863609:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 853 00000100:00100000:3.0:1788361641.863627:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:2409:x1875230406994176:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361641.863700:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406994048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 178us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361641.863708:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:2.0:1788361641.863736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361641.863776:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994560 00000100:00100000:0.0:1788361641.863781:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994560 00000100:00100000:0.0:1788361641.863815:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994432 00000100:00100000:0.0:1788361641.863819:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994432 00000100:00100000:0.0:1788361641.863887:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1840 00000100:00100000:2.0:1788361641.863895:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1841 00000100:00100000:0.0:1788361641.863897:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406994560:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361641.863910:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406994432:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361641.863938:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406994560:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 43us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361641.863948:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1840 00000100:00100000:2.0:1788361641.863949:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:ec302d84-8f96-49d3-8682-aefc474f8448+5:2409:x1875230406994432:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361641.863976:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1841 00000100:00100000:3.0:1788361641.864681:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:2409:x1875230406994176:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1057us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361641.864681:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406994304:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1080us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361641.864699:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 853 00000100:00100000:1.0:1788361641.864852:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 852 00010000:00010000:2.0:1788361642.070098:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361643.094181:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361643.173364:0:89696:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00000100:00100000:3.0:1788361643.862085:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429794560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361643.862184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361643.862297:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429794560 00000100:00100000:2.0:1788361643.862308:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429794560 00000100:00100000:2.0:1788361643.862397:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1788361643.862409:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429794560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361643.862447:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361643.862500:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429794560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361643.862507:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00080000:3.0:1788361643.862938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361643.863012:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429794560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361643.863103:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361643.863111:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429794688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361643.863144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361643.863250:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429794688 00000100:00100000:1.0:1788361643.863256:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429794688 00000100:00080000:3.0:1788361643.863307:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361643.863635:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:1.0:1788361643.863658:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429794688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361643.863699:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361643.863753:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429794688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361643.863761:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1788361643.863810:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429794688:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788361644.117934:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361644.120474:0:89744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 11:07:22 (1788361642) 00000100:00100000:3.0:1788361644.175913:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361644.175955:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994688 00000100:00100000:3.0:1788361644.175964:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994688 00000100:00100000:3.0:1788361644.176043:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1167 00000100:00100000:3.0:1788361644.176055:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:69365:x1875230406994688:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361644.176077:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361644.176151:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe3025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e1c expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176216:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176241:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176251:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176266:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176274:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176280:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176322:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176329:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176335:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176341:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361644.176345:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176353:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176364:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94c00) 00010000:00010000:3.0:1788361644.176374:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361644.176380:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176386:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe302c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176400:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176406:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176413:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176418:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fee00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361644.176421:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176428:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176436:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d0010ecd00) 00010000:00010000:3.0:1788361644.176440:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361644.176443:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176449:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe3033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176482:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe3025 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e1c expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176499:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94c00) 00010000:00010000:3.0:1788361644.176501:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361644.176506:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe3025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e1c expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.176516:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371fe600, rc 0) 00000100:00100000:3.0:1788361644.176573:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:69365:x1875230406994688:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 520us (671us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361644.176581:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1167 00000100:00080000:3.0:1788361644.176606:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361644.180237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.180741:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406994944 00000100:00100000:0.0:1788361644.180752:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406994944 00000100:00100000:0.0:1788361644.180816:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1168 00000100:00100000:0.0:1788361644.180846:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+10:69365:x1875230406994944:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788361644.180870:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361644.180874:0:66901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361644.180901:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe2e1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710df9 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.180919:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94c00) 00010000:00010000:0.0:1788361644.180935:0:66901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361644.180949:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe303a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e23 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181070:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181083:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181093:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181107:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181115:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181136:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181544:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181553:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181561:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361644.181571:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1788361644.181595:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181603:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181609:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181616:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181622:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361644.181627:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181634:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181654:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d108901e00) 00010000:00010000:0.0:1788361644.181657:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361644.181661:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181668:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3041 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361644.181682:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b58072b reply state 0000000034612255 transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181693:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181700:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d108901c00) 00010000:00010000:0.0:1788361644.181703:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361644.181706:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361644.181732:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe303a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181749:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 11 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.181757:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d108901900) 00010000:00010000:0.0:1788361644.181760:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361644.181762:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308400, rc 0) 00000100:00100000:0.0:1788361644.181847:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+12:69365:x1875230406994944:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1021us (1613us total) trans 111669149700 rc 0/0 00000100:00100000:0.0:1788361644.181857:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1168 00000100:00100000:3.0:1788361644.184193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361644.184406:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406995200 00000100:00100000:1.0:1788361644.184416:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406995200 00000100:00100000:1.0:1788361644.184474:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1169 00000100:00100000:1.0:1788361644.184484:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:69365:x1875230406995200:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361644.184506:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361644.184527:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a600/0x1b69fa8920fe305d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e2a expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.184748:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.184763:0:66128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 13 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.184772:0:66128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.184805:0:66128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 13 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.184819:0:66128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 13 pid: 66901 timeout: 2784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361644.184863:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429794816:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788361644.184946:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361644.186973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361644.187018:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406995328 00000100:00100000:3.0:1788361644.187026:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406995328 00000100:00100000:2.0:1788361644.187051:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429794816:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361644.187074:0:66128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187097:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 14 pid: 66901 timeout: 2784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361644.187139:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2587 00000100:00100000:3.0:1788361644.187148:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec302d84-8f96-49d3-8682-aefc474f8448+14:2410:x1875230406995328:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361644.187159:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361644.187165:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 14 pid: 66901 timeout: 2784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187175:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 14 pid: 66901 timeout: 2784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187203:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe304f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e23 expref: 14 pid: 66901 timeout: 2784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187218:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d108901900) 00010000:00010000:3.0:1788361644.187223:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187231:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187239:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.187268:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361644.187309:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec302d84-8f96-49d3-8682-aefc474f8448+13:2410:x1875230406995328:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.187317:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2587 00010000:00010000:2.0:1788361644.187430:0:66128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187438:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361644.187456:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:2.0:1788361644.187580:0:66128:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x4b1:0x0], count =625 00000004:00080000:2.0:1788361644.187586:0:66128:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x4b1:0x0]+625 in llog 00000004:00080000:2.0:1788361644.187619:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x722:0x0], index 0: 0 00010000:00010000:2.0:1788361644.187722:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187739:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187745:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187751:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361644.187755:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187761:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187770:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d108901900) 00010000:00010000:2.0:1788361644.187772:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361644.187776:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187781:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe3064 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187846:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a600/0x1b69fa8920fe305d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e2a expref: 13 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187855:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d105570200) 00010000:00010000:2.0:1788361644.187858:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361644.187862:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a600/0x1b69fa8920fe305d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e2a expref: 13 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361644.187876:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166a600, rc 0) 00000100:00100000:2.0:1788361644.187920:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:69365:x1875230406995200:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 3438us (3731us total) trans 111669149701 rc 301/301 00000100:00100000:2.0:1788361644.187928:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1169 00000100:00100000:3.0:1788361644.190451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361644.190646:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406995584 00000100:00100000:1.0:1788361644.190657:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406995584 00000100:00100000:1.0:1788361644.190711:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 225 00000100:00100000:1.0:1788361644.190722:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+12:69365:x1875230406995584:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788361644.191205:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:69365:x1875230406995584:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 484us (758us total) trans 111669149702 rc 0/0 00000100:00100000:1.0:1788361644.191214:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 225 00000100:00100000:0.0:1788361644.193203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361644.193433:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406995840 00000100:00100000:1.0:1788361644.193443:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406995840 00000100:00100000:1.0:1788361644.193489:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 226 00000100:00100000:1.0:1788361644.193501:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a29450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+13:69365:x1875230406995840:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788361644.193951:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a29450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+14:69365:x1875230406995840:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 452us (756us total) trans 111669149703 rc 0/0 00000100:00100000:1.0:1788361644.193960:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 226 00000001:00080000:2.0:1788361644.613229:0:88874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:1.0:1788361644.613236:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.613249:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.613257:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.613282:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361644.613287:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.613294:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.613310:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d108901c00) 00010000:00010000:1.0:1788361644.613314:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361644.613318:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.613324:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3048 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361644.649118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361644.651357:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406995968 00000100:00100000:3.0:1788361644.651373:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406995968 00000100:00100000:3.0:1788361644.651447:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1170 00000100:00100000:3.0:1788361644.651456:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+9:69374:x1875230406995968:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361644.651481:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361644.651504:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe3072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e31 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.651568:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff200/0x1b69fa8920fe3079 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.651589:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff200/0x1b69fa8920fe3079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.651601:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff200/0x1b69fa8920fe3079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361644.651647:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361644.651651:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361644.651675:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff200/0x1b69fa8920fe3079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.651698:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe3072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e31 expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.651712:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff200/0x1b69fa8920fe3079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e31 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361644.651720:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecc00) 00010000:00010000:3.0:1788361644.651723:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361644.651725:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ff200, rc 0) 00000100:00100000:3.0:1788361644.651790:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:69374:x1875230406995968:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 335us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.651797:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1170 00000100:00100000:3.0:1788361644.655044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.655249:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996096 00000100:00100000:0.0:1788361644.655258:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996096 00000100:00100000:0.0:1788361644.655307:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1171 00000100:00100000:0.0:1788361644.655316:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+10:69374:x1875230406996096:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361644.655349:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444978688 avail 1298739200 00000100:00100000:0.0:1788361644.655413:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+10:69374:x1875230406996096:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 98us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.655420:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1171 00000100:00100000:3.0:1788361644.657907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.657974:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996224 00000100:00100000:0.0:1788361644.657992:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996224 00000100:00100000:0.0:1788361644.658059:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1172 00000100:00100000:0.0:1788361644.658067:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:69374:x1875230406996224:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361644.658099:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361644.658148:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:69374:x1875230406996224:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.658156:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1172 00000100:00080000:3.0:1788361644.658208:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361644.661079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.661128:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996352 00000100:00100000:0.0:1788361644.661138:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996352 00000100:00100000:0.0:1788361644.661197:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1502 00000100:00100000:0.0:1788361644.661206:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:69374:x1875230406996352:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361644.661229:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361644.661280:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:69374:x1875230406996352:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.661287:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1502 00000100:00080000:2.0:1788361644.661319:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361644.663370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.663743:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996480 00000100:00100000:0.0:1788361644.663757:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996480 00000100:00100000:0.0:1788361644.663841:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1503 00000100:00100000:0.0:1788361644.663852:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:69374:x1875230406996480:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361644.663874:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361644.663926:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+5:69374:x1875230406996480:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 76us (563us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361644.664032:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361644.666150:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1503 00000100:00100000:3.0:1788361644.704160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.705334:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996736 00000100:00100000:0.0:1788361644.705347:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996736 00000100:00100000:0.0:1788361644.705412:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1173 00000100:00100000:0.0:1788361644.705423:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+10:69381:x1875230406996736:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00010000:0.0:1788361644.705481:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361644.705510:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff200/0x1b69fa8920fe3079 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e31 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.705526:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecc00) 00010000:00010000:0.0:1788361644.705537:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361644.705599:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.705678:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.705699:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.705714:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.705734:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.705741:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706231:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706255:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706261:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706267:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361644.706272:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706280:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706290:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d136764300) 00010000:00010000:0.0:1788361644.706293:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361644.706297:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706304:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3080 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361644.706320:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006678ac40 reply state 00000000641a7635 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706340:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.706346:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d136764100) 00010000:00010000:0.0:1788361644.706349:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361644.706351:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361644.706444:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+11:69381:x1875230406996736:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 1022us (2290us total) trans 111669149704 rc 0/0 00000100:00100000:0.0:1788361644.706452:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1173 00000100:00100000:2.0:1788361644.719877:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361644.720348:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996864 00000100:00100000:1.0:1788361644.720360:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996864 00000100:00100000:1.0:1788361644.720415:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1174 00000100:00100000:1.0:1788361644.720427:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+11:69384:x1875230406996864:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:1.0:1788361644.720450:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361644.720478:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166aa00/0x1b69fa8920fe308e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e38 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.720544:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b600/0x1b69fa8920fe3095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.720558:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b600/0x1b69fa8920fe3095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.720582:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b600/0x1b69fa8920fe3095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361644.720902:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361644.720907:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361644.720930:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b600/0x1b69fa8920fe3095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.720957:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166aa00/0x1b69fa8920fe308e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e38 expref: 13 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.720973:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b600/0x1b69fa8920fe3095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e38 expref: 12 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.721071:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c600) 00010000:00010000:1.0:1788361644.721075:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361644.721079:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166b600, rc 0) 00000100:00100000:1.0:1788361644.721302:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+12:69384:x1875230406996864:12345-192.168.204.35@tcp:101:rm.0 Request processed in 877us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361644.721310:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1174 00000100:00100000:1.0:1788361644.726793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.726902:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996992 00000100:00100000:0.0:1788361644.726914:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996992 00000100:00100000:0.0:1788361644.727053:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1175 00000100:00100000:0.0:1788361644.727063:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+12:69384:x1875230406996992:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:0.0:1788361644.727084:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361644.727105:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe309c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e3f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.727164:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.727177:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.727188:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.727198:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.727214:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.727221:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729668:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729686:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729697:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361644.729749:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:0.0:1788361644.729754:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361644.729775:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729787:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729799:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729804:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729810:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729843:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729850:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361644.729854:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729862:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729875:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c600) 00010000:00010000:0.0:1788361644.729878:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361644.729882:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729888:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729900:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729906:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729911:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729915:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361644.729918:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729931:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729939:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d136764100) 00010000:00010000:0.0:1788361644.729941:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361644.729943:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729948:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.729996:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe309c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e3f expref: 14 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.730009:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e3f expref: 13 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.730015:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99d136764300) 00010000:00010000:0.0:1788361644.730018:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361644.730020:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309a00, rc 0) 00000100:00100000:0.0:1788361644.730094:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+13:69384:x1875230406996992:12345-192.168.204.35@tcp:101:rm.0 Request processed in 3032us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.730102:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1175 00000100:00100000:2.0:1788361644.738458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361644.740251:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997248 00000100:00100000:0.0:1788361644.740264:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997248 00000100:00100000:0.0:1788361644.740330:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1176 00000100:00100000:0.0:1788361644.740341:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+13:69384:x1875230406997248:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1788361644.740414:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361644.740439:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe30b1 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e3f expref: 13 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740458:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99d136764300) 00010000:00010000:0.0:1788361644.740475:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b600/0x1b69fa8920fe3095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e38 expref: 12 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740485:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c600) 00010000:00010000:0.0:1788361644.740491:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361644.740513:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740524:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740534:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740543:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740550:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740556:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740640:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740658:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740666:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740869:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740878:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740885:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740893:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740898:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740905:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740922:0:66127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361644.740937:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740944:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740950:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740962:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361644.740967:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740974:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.740994:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99d136764b00) 00010000:00010000:0.0:1788361644.740997:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788361644.741000:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741006:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe30c6 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741021:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741026:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741032:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741037:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741041:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361644.741044:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741061:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741068:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d136764400) 00010000:00010000:0.0:1788361644.741070:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361644.741072:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741078:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe30b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361644.741092:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f30b769 reply state 000000007714b08e transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741104:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.741105:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361644.741116:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361644.741116:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d136764100) 00010000:00010000:0.0:1788361644.741121:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361644.741126:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361644.741130:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361644.741135:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.741159:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.741172:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99d136764b00) 00010000:00010000:1.0:1788361644.741175:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361644.741179:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361644.741185:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe30cd lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361644.741210:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+13:69384:x1875230406997248:12345-192.168.204.35@tcp:36:rm.0 Request processed in 869us (2761us total) trans 111669149705 rc 0/0 00010000:00010000:1.0:1788361644.741212:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361644.741215:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361644.741219:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361644.741220:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1176 00000100:00100000:1.0:1788361644.886161:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429794944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361644.886172:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429795200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361644.886436:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429795072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361644.886735:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.886736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.886792:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429795456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.886794:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429795712:0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.887532:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.887538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.887581:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429795968:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.887635:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429796224:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.889871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.889889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.889923:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429795584:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.889930:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429796736:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.889974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.890018:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788361644.890027:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429795328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361644.890035:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429794944 00000100:00100000:0.0:1788361644.890044:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429794944 00000100:00100000:3.0:1788361644.890054:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.890070:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429795840:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.890096:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795200 00000100:00100000:3.0:1788361644.890100:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795200 00000100:00100000:0.0:1788361644.890114:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795328 00000100:00100000:0.0:1788361644.890119:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795328 00000100:00100000:3.0:1788361644.890133:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795072 00000100:00100000:3.0:1788361644.890136:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795072 00000100:00100000:0.0:1788361644.890153:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1788361644.890161:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1788361644.890166:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429794944:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361644.890171:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429795200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361644.890194:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361644.890249:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429795200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.890256:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1788361644.890272:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000004:00000024:0.0:1788361644.890314:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444978688 avail 1298739200 00000100:00100000:0.0:1788361644.890354:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429794944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 192us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.890361:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:0.0:1788361644.890376:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:0.0:1788361644.890383:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429795328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788361644.890396:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:0.0:1788361644.890424:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429795328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.890430:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:0.0:1788361644.890466:0:88879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795456 00000100:00100000:0.0:1788361644.890470:0:88879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795456 00000100:00100000:0.0:1788361644.890492:0:88879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788361644.890498:0:88879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429795456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.890524:0:88879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429795456:12345-0@lo:400:kworker.0 Request processed in 27us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.890530:0:88879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788361644.890572:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429795072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361644.890586:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361644.890636:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429795072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 357us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.890643:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1788361644.890669:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795712 00000100:00100000:3.0:1788361644.890673:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795712 00000100:00100000:3.0:1788361644.890710:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1788361644.890717:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429795712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.890751:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429795712:12345-0@lo:400:kworker.0 Request processed in 34us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.890757:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1788361644.890782:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796224 00000100:00100000:3.0:1788361644.890785:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796224 00000100:00100000:3.0:1788361644.890811:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796736 00000100:00100000:3.0:1788361644.890814:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796736 00000100:00100000:3.0:1788361644.890855:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:0.0:1788361644.890862:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1788361644.890865:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429796224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.890874:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429796736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.890907:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429796224:12345-0@lo:400:kworker.0 Request processed in 44us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.890916:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:0.0:1788361644.890916:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429796736:12345-0@lo:400:kworker.0 Request processed in 44us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.890926:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00080000:3.0:1788361644.890947:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361644.890953:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361644.890955:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361644.891344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.891387:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429796480:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891396:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795968 00000100:00100000:3.0:1788361644.891402:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795968 00000100:00100000:1.0:1788361644.891417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.891462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.891483:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429796992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891560:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796480 00000100:00100000:3.0:1788361644.891565:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796480 00000100:00100000:0.0:1788361644.891578:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429796352:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891592:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795840 00000100:00100000:3.0:1788361644.891596:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795840 00000100:00100000:0.0:1788361644.891603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.891621:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429796864:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891626:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1788361644.891636:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429795968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.891647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.891681:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429795712:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891696:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429795968:12345-0@lo:400:kworker.0 Request processed in 61us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.891700:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429796224:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891712:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1788361644.891714:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 2 00000100:00100000:0.0:1788361644.891730:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429796736:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891731:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1788361644.891742:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429796480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.891752:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429795200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361644.891772:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429796480:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.891778:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1788361644.891787:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429795328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361644.891791:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1788361644.891799:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429795840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891850:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429795840:12345-0@lo:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.891857:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1788361644.891866:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.891877:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796992 00000100:00100000:3.0:1788361644.891882:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796992 00000100:00100000:0.0:1788361644.891897:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429794944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361644.891903:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1788361644.891909:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.891917:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429795456:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.891931:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429795968:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891940:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429796992:12345-0@lo:400:kworker.0 Request processed in 30us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.891946:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788361644.891946:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429796480:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.891967:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429796992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.891969:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796352 00000100:00100000:3.0:1788361644.891973:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796352 00000100:00100000:3.0:1788361644.892006:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796864 00000100:00100000:3.0:1788361644.892010:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796864 00000100:00100000:0.0:1788361644.892020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.892029:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1788361644.892035:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429796352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.892044:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429796096:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.892081:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.892085:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429796352:12345-0@lo:400:kworker.0 Request processed in 49us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.892094:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:0.0:1788361644.892104:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429796608:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.892110:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:3.0:1788361644.892119:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429796864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.892144:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361644.892161:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429796864:12345-0@lo:400:kworker.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.892168:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:0.0:1788361644.892182:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 2 00000100:00100000:3.0:1788361644.892195:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429795584 00000100:00100000:3.0:1788361644.892200:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429795584 00000100:00100000:3.0:1788361644.892228:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1788361644.892236:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429795584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.892389:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796096 00000100:00100000:1.0:1788361644.892394:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796096 00000100:00100000:1.0:1788361644.892419:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429796608 00000100:00100000:1.0:1788361644.892423:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429796608 00000100:00100000:1.0:1788361644.892453:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1788361644.892460:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429796096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.892493:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429796096:12345-0@lo:400:kworker.0 Request processed in 34us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361644.892499:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1788361644.892513:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:1.0:1788361644.892521:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429796608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.892552:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429796608:12345-0@lo:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361644.892557:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000100:00100000:3.0:1788361644.892636:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429795584:12345-0@lo:400:kworker.0 Request processed in 401us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361644.892643:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00080000:3.0:1788361644.892662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361644.892666:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361644.892692:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429795840:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.892704:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429796352:0@lo:400:kworker.0 00000100:00100000:3.0:1788361644.892715:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429796864:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.893228:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429795072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361644.893245:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429795584:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.893255:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429796096:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.893264:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429796608:0@lo:400:kworker.0 00010000:00010000:2.0:1788361645.142404:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361646.165938:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361646.983970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361646.984005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361646.984035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361646.984064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361646.984072:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997888 00000100:00100000:3.0:1788361646.984078:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997632 00000100:00100000:0.0:1788361646.984086:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361646.984096:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997632 00000100:00100000:0.0:1788361646.984108:0:88880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997376 00000100:00100000:0.0:1788361646.984114:0:88880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997376 00000100:00100000:1.0:1788361646.984119:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997504 00000100:00100000:1.0:1788361646.984123:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997504 00000100:00100000:0.0:1788361646.984159:0:88880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:1.0:1788361646.984163:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 860 00000100:00100000:0.0:1788361646.984169:0:88880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406997376:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361646.984171:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+13:2410:x1875230406997504:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361646.984176:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 861 00000100:00100000:3.0:1788361646.984187:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406997632:12345-192.168.204.35@tcp:400:kworker.0 00010000:00000080:1.0:1788361646.984195:0:67579:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1185e8380 x1875230406997504/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:707/0 lens 224/224 e 0 to 0 dl 1788361657 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361646.984335:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997888 00000100:00100000:2.0:1788361646.984391:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997760 00000100:00100000:2.0:1788361646.984394:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997760 00000100:00100000:2.0:1788361646.984413:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1846 00000100:00100000:2.0:1788361646.984419:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406997888:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361646.984469:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+13:2410:x1875230406997504:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 299us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361646.984470:0:88880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230406997376:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 303us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361646.984474:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230406997632:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 286us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361646.984480:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 860 00000100:00100000:0.0:1788361646.984480:0:88880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:3.0:1788361646.984494:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 861 00000100:00100000:0.0:1788361646.984517:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1847 00000100:00080000:3.0:1788361646.984521:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361646.984526:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406997760:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:3.0:1788361646.984543:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361646.984548:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361646.984550:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361646.984999:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406997760:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 474us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361646.985007:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1847 00000100:00100000:2.0:1788361646.985154:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+5:2410:x1875230406997888:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 733us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361646.985162:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1846 00010000:00010000:0.0:1788361647.191378:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361648.088797:0:90139:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788361648.123731:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.123869:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406998016 00000100:00100000:3.0:1788361648.123879:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406998016 00000100:00080000:0.0:1788361648.123930:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361648.123999:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1177 00000100:00100000:3.0:1788361648.124010:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:69450:x1875230406998016:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361648.124028:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361648.124050:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe30d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e46 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.124111:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe30db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.124126:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe30db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.124139:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe30db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361648.124182:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361648.124186:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361648.124205:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe30db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.124228:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe30d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e46 expref: 15 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.124260:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe30db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e46 expref: 14 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.124268:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec000) 00010000:00010000:3.0:1788361648.124271:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361648.124274:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371fe600, rc 0) 00010000:00000080:3.0:1788361648.124282:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1185e9180 x1875230406998016/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 576/688 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361648.124350:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+14:69450:x1875230406998016:12345-192.168.204.35@tcp:101:dd.0 Request processed in 342us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361648.124358:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1177 00000100:00100000:0.0:1788361648.130027:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361648.130253:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406998272 00000100:00100000:2.0:1788361648.130264:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406998272 00000100:00100000:2.0:1788361648.130328:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1178 00000100:00100000:2.0:1788361648.130340:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+14:69450:x1875230406998272:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361648.130365:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361648.130368:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361648.130397:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe600/0x1b69fa8920fe30db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e46 expref: 14 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130429:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec000) 00010000:00010000:2.0:1788361648.130441:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361648.130458:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe30e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e4d expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130603:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130617:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130628:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130644:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130652:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130658:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130723:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe30f7 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130730:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe30f7 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130737:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe30f7 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361648.130752:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1788361648.130856:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130864:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130870:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130876:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130883:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361648.130888:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130895:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130905:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d007048c00) 00010000:00010000:2.0:1788361648.130908:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361648.130912:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130932:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe30e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130943:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130949:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130962:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130969:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361648.130972:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130978:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130987:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d007048600) 00010000:00010000:2.0:1788361648.130989:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361648.130992:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.130998:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe30f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.131044:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe30e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e4d expref: 16 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.131064:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe30f7 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e4d expref: 15 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.131072:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:2.0:1788361648.131074:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361648.131077:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eae00, rc 0) 00010000:00000080:2.0:1788361648.131084:0:67579:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1185eaa00 x1875230406998272/t111669149706(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 776/848 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361648.131265:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+15:69450:x1875230406998272:12345-192.168.204.35@tcp:101:dd.0 Request processed in 925us (1245us total) trans 111669149706 rc 0/0 00000100:00100000:2.0:1788361648.131273:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1178 00000100:00100000:0.0:1788361648.134864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.134907:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406998400 00000100:00100000:3.0:1788361648.134926:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406998400 00000100:00100000:3.0:1788361648.134988:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1179 00000100:00100000:3.0:1788361648.135011:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+15:69450:x1875230406998400:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361648.135035:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361648.135188:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe3105 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e54 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.135226:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe310c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.135239:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe310c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.135251:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe310c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.135430:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff800/0x1b69fa8920fe3105 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e54 expref: 17 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.135448:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe310c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e54 expref: 16 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.135458:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:3.0:1788361648.135466:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361648.135471:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371fee00, rc 0) 00010000:00000080:3.0:1788361648.135479:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1185eb480 x1875230406998400/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 568/1344 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361648.135548:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+16:69450:x1875230406998400:12345-192.168.204.35@tcp:101:dd.0 Request processed in 540us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361648.135556:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1179 00000100:00100000:3.0:1788361648.140047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361648.140579:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406998656 00000100:00100000:0.0:1788361648.140589:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406998656 00000100:00100000:0.0:1788361648.140647:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1180 00000100:00100000:0.0:1788361648.140657:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+16:69450:x1875230406998656:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:0.0:1788361648.140708:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361648.140734:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eae00/0x1b69fa8920fe30f7 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e4d expref: 16 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.140752:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:0.0:1788361648.140757:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361648.140970:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.140985:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.140994:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361648.141039:0:66128:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:0.0:1788361648.141061:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b029d4bc reply state 000000009874f6af transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.141078:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.141097:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:0.0:1788361648.141100:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361648.141103:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788361648.141138:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed4380 x1875230406998656/t111669149708(0) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 488/456 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361648.141242:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+18:69450:x1875230406998656:12345-192.168.204.35@tcp:36:dd.0 Request processed in 586us (1203us total) trans 111669149708 rc 0/0 00000100:00100000:0.0:1788361648.141250:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1180 00000020:00080000:0.0:1788361648.141255:0:66128:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361648.143072:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.143152:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406998784 00000100:00100000:3.0:1788361648.143161:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406998784 00000100:00100000:3.0:1788361648.143207:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1181 00000100:00100000:3.0:1788361648.143217:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+18:69450:x1875230406998784:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361648.143236:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361648.143253:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe311a lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e5b expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.143299:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe311a lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e5b expref: 19 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.143325:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe311a lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e5b expref: 19 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.143343:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:3.0:1788361648.143346:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361648.143349:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ff400, rc 0) 00010000:00000080:3.0:1788361648.143356:0:66127:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1185eb100 x1875230406998784/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 376/584 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361648.143438:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+19:69450:x1875230406998784:12345-192.168.204.35@tcp:101:dd.0 Request processed in 222us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361648.143446:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1181 00000100:00100000:2.0:1788361648.145573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361648.145846:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999040 00000100:00100000:0.0:1788361648.145855:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999040 00000100:00100000:0.0:1788361648.146018:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1182 00000100:00100000:0.0:1788361648.146029:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+19:69450:x1875230406999040:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361648.146050:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361648.146053:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361648.146075:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff400/0x1b69fa8920fe311a lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e5b expref: 19 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146090:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:0.0:1788361648.146094:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361648.146105:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3121 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e62 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146149:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe3128 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146172:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe3128 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146182:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe3128 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361648.146292:0:66126:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6a3:0x0], count =127 00000004:00080000:0.0:1788361648.146300:0:66126:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6a3:0x0]+127 in llog 00000004:00080000:0.0:1788361648.146328:0:66126:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00000004:00080000:0.0:1788361648.146335:0:66126:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x723:0x0], index 0: 0 00010000:00010000:0.0:1788361648.146470:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe3128 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 21 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146479:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:0.0:1788361648.146481:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361648.146503:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3121 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 21 pid: 66126 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146517:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe3128 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 20 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.146558:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:0.0:1788361648.146562:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361648.146564:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309000, rc 0) 00010000:00000080:0.0:1788361648.146572:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d141098700 x1875230406999040/t111669149709(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 376/608 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361648.146637:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+20:69450:x1875230406999040:12345-192.168.204.35@tcp:101:dd.0 Request processed in 610us (1070us total) trans 111669149709 rc 0/0 00000100:00100000:0.0:1788361648.146650:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1182 00000100:00100000:0.0:1788361648.151084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361648.151534:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999168 00000100:00100000:1.0:1788361648.151544:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999168 00000100:00080000:0.0:1788361648.151662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361648.152410:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4896 00000100:00100000:1.0:1788361648.152422:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec302d84-8f96-49d3-8682-aefc474f8448+5:69450:x1875230406999168:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361648.152440:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361648.152465:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe312f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e69 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361648.152488:0:8535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361648.152509:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=2688s v=(0 0) 00010000:00010000:1.0:1788361648.152513:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361648.152523:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe312f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e69 expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.152539:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe312f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e69 expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.152551:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166bc00, rc 0) 00000100:00100000:1.0:1788361648.152611:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:69450:x1875230406999168:12345-192.168.204.35@tcp:101:dd.0 Request processed in 192us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361648.152618:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4896 00000100:00100000:0.0:1788361648.156375:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.159156:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999296 00000100:00100000:3.0:1788361648.159172:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999296 00000100:00100000:3.0:1788361648.159239:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4897 00000100:00100000:3.0:1788361648.159251:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ec302d84-8f96-49d3-8682-aefc474f8448+5:69450:x1875230406999296:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361648.159271:0:26166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361648.159295:0:26166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe3136 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e70 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361648.159320:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361648.159344:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=2688s v=(0 0) 00010000:00010000:3.0:1788361648.159348:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361648.159359:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe3136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e70 expref: 6 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.159393:0:26166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe3136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e70 expref: 6 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.159407:0:26166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ff800, rc 0) 00000100:00100000:3.0:1788361648.159473:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ec302d84-8f96-49d3-8682-aefc474f8448+6:69450:x1875230406999296:12345-192.168.204.35@tcp:101:dd.0 Request processed in 225us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361648.159481:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4897 00000100:00080000:2.0:1788361648.159505:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361648.161221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361648.161305:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999424 00000100:00100000:0.0:1788361648.161313:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999424 00000100:00100000:0.0:1788361648.161434:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4898 00000100:00100000:0.0:1788361648.161444:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+6:69450:x1875230406999424:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361648.161459:0:26167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361648.161476:0:26167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a8332f/0x1b69fa8920fe313d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e77 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361648.161498:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361648.161514:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=2688s v=(0 0) 00010000:00010000:0.0:1788361648.161518:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361648.161525:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a8332f/0x1b69fa8920fe313d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e77 expref: 7 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.161539:0:26167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001a8332f/0x1b69fa8920fe313d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e77 expref: 7 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.161549:0:26167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308400, rc 0) 00000100:00100000:0.0:1788361648.161599:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+7:69450:x1875230406999424:12345-192.168.204.35@tcp:101:dd.0 Request processed in 157us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361648.161606:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4898 00000100:00100000:1.0:1788361648.165817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361648.165891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.166047:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999552 00000100:00100000:3.0:1788361648.166057:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999552 00002000:00010000:3.0:1788361648.166111:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1826 (1048576->18446744073709551615) 00002000:00100000:3.0:1788361648.166117:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ef3480 with x1875230406999552 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1788361648.166130:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d136ef3480. 00000100:00100000:3.0:1788361648.166152:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999680 00000100:00100000:3.0:1788361648.166156:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999680 00002000:00010000:3.0:1788361648.166170:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1827 (0->18446744073709551615) 00002000:00100000:3.0:1788361648.166173:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ef2300 with x1875230406999680 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361648.166180:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ef2300. 00000100:00100000:3.0:1788361648.166200:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 593 00000100:00100000:3.0:1788361648.166209:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230406999552:12345-192.168.204.35@tcp:10:dd.0 00000100:00100000:0.0:1788361648.166423:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 594 00002000:00010000:3.0:1788361648.166428:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1788361648.166432:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb mtime from disk: 0 -> 1788361647 00000100:00100000:0.0:1788361648.166435:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230406999680:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:3.0:1788361648.166436:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361648.166443:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb ctime from disk: 0 -> 1788361647 00002000:00010000:3.0:1788361648.166447:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788361648.166527:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230406999552:12345-192.168.204.35@tcp:10:dd.0 Request processed in 307us (708us total) trans 4294968750 rc 0/0 00000100:00100000:3.0:1788361648.166536:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 593 00002000:00010000:3.0:1788361648.166541:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1826 (1048576->18446744073709551615) 00002000:00100000:3.0:1788361648.166544:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ef3480 with x1875230406999552 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1788361648.166549:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788361648.166550:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d136ef3480. 00002000:00010000:0.0:1788361648.166555:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb mtime from disk: 0 -> 1788361647 00002000:00010000:0.0:1788361648.166559:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361648.166561:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb ctime from disk: 0 -> 1788361647 00002000:00010000:0.0:1788361648.166563:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788361648.166587:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ec302d84-8f96-49d3-8682-aefc474f8448+8:2409:x1875230406999680:12345-192.168.204.35@tcp:10:dd.0 Request processed in 156us (697us total) trans 4294968749 rc 0/0 00000100:00100000:0.0:1788361648.166593:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 594 00002000:00010000:0.0:1788361648.166596:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1827 (0->18446744073709551615) 00002000:00100000:0.0:1788361648.166599:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ef2300 with x1875230406999680 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361648.166603:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ef2300. 00000100:00100000:1.0:1788361648.202176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.202300:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999936 00000100:00100000:3.0:1788361648.202309:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999936 00000100:00100000:1.0:1788361648.202383:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 227 00000100:00100000:1.0:1788361648.202393:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+20:69450:x1875230406999936:12345-192.168.204.35@tcp:35:dd.0 00010000:00000080:1.0:1788361648.202636:0:66129:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ef2680 x1875230406999936/t111669149710(0) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 392/456 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361648.202697:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+21:69450:x1875230406999936:12345-192.168.204.35@tcp:35:dd.0 Request processed in 305us (530us total) trans 111669149710 rc 0/0 00000100:00100000:1.0:1788361648.202706:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 227 00000100:00100000:2.0:1788361648.213230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.213330:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407000064 00000100:00100000:3.0:1788361648.213339:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407000064 00000100:00100000:3.0:1788361648.213416:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1183 00000100:00100000:3.0:1788361648.213428:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+21:69451:x1875230407000064:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361648.213454:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361648.213477:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe200/0x1b69fa8920fe3144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e7e expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.213544:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe314b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.213557:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe314b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.213569:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe314b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361648.213611:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361648.213615:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361648.213633:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe314b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.213678:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fe200/0x1b69fa8920fe3144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e7e expref: 23 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.213695:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe314b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e7e expref: 22 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.213703:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec600) 00010000:00010000:3.0:1788361648.213706:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361648.213710:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371fea00, rc 0) 00010000:00000080:3.0:1788361648.213717:0:80345:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d141098380 x1875230407000064/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 576/688 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361648.213784:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+22:69451:x1875230407000064:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 358us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361648.213791:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1183 00010000:00010000:1.0:1788361648.213906:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361648.215930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361648.216147:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407000320 00000100:00100000:3.0:1788361648.216156:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407000320 00000100:00100000:3.0:1788361648.216210:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1184 00000100:00100000:3.0:1788361648.216219:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+22:69451:x1875230407000320:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361648.216238:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361648.216255:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe3152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e85 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216415:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216429:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216453:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216467:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216473:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216480:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216556:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216563:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216569:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216576:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216581:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffe00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361648.216585:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216592:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216604:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec600) 00010000:00010000:3.0:1788361648.216613:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361648.216618:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216625:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffe00/0x1b69fa8920fe3159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216638:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216644:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216649:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216654:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffa00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361648.216657:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216663:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216670:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d0010ec900) 00010000:00010000:3.0:1788361648.216672:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361648.216675:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216680:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffa00/0x1b69fa8920fe3160 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216708:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe3152 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e85 expref: 23 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216723:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec600) 00010000:00010000:3.0:1788361648.216726:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361648.216730:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ff000/0x1b69fa8920fe3152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e85 expref: 23 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361648.216801:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ff000, rc 0) 00010000:00000080:3.0:1788361648.216809:0:66127:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d108c7df80 x1875230407000320/t0(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 800/608 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361648.216930:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+22:69451:x1875230407000320:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 711us (1015us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361648.216937:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1184 00000100:00100000:0.0:1788361648.218560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361648.218610:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407000448 00000100:00100000:1.0:1788361648.218617:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407000448 00000100:00100000:1.0:1788361648.218694:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1185 00000100:00100000:1.0:1788361648.218701:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+22:69451:x1875230407000448:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:1.0:1788361648.218752:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218763:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218769:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218778:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218782:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218786:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218866:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218927:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.218940:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361648.218993:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:1.0:1788361648.219043:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361648.219135:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219148:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219154:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219160:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219167:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219173:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166ba00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361648.219177:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219184:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219195:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec600) 00010000:00010000:1.0:1788361648.219199:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361648.219203:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219208:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ba00/0x1b69fa8920fe3167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219224:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219228:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219231:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219234:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361648.219236:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219241:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219248:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d103a4cc00) 00010000:00010000:1.0:1788361648.219250:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361648.219252:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219258:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166a400/0x1b69fa8920fe316e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219271:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219277:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219283:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219294:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166be00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361648.219297:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219304:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219311:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:1.0:1788361648.219314:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361648.219317:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.219322:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166be00/0x1b69fa8920fe3175 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1788361648.219341:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007350700 x1875230407000448/t0(0) o34->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 472/728 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361648.219396:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+22:69451:x1875230407000448:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 695us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361648.219403:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1185 00000100:00100000:2.0:1788361648.238097:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361648.238224:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407000704 00000100:00100000:0.0:1788361648.238234:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407000704 00000100:00100000:0.0:1788361648.238328:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1186 00000100:00100000:0.0:1788361648.238338:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+22:69453:x1875230407000704:12345-192.168.204.35@tcp:101:md5sum.0 00010000:00010000:0.0:1788361648.238358:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361648.238377:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe317c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e8c expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238447:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238461:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238487:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238501:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238508:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238515:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238615:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe3191 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238624:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe3191 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238631:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe3191 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361648.238640:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:0.0:1788361648.238712:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238720:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238726:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238732:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238745:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361648.238749:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238757:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238769:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec600) 00010000:00010000:0.0:1788361648.238772:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361648.238776:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238782:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe3183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238796:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238801:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238807:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238812:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361648.238815:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238876:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238897:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d10af5c700) 00010000:00010000:0.0:1788361648.238900:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361648.238903:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361648.238909:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe318a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.239135:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe317c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e8c expref: 25 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.239153:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe3191 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e8c expref: 24 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361648.239161:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:1.0:1788361648.239164:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361648.239173:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309a00, rc 0) 00010000:00000080:1.0:1788361648.239181:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109b100 x1875230407000704/t111669149711(0) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 800/872 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361648.239238:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+24:69453:x1875230407000704:12345-192.168.204.35@tcp:101:md5sum.0 Request processed in 901us (1153us total) trans 111669149711 rc 0/0 00000100:00100000:1.0:1788361648.239245:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1186 00000100:00100000:0.0:1788361648.243436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361648.243532:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407000832 00000100:00100000:2.0:1788361648.243542:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407000832 00002000:00100000:2.0:1788361648.243587:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff99d007350a80 x1875230407000832/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 488/0 e 0 to 0 dl 1788361659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361648.243624:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007350a80 with x1875230407000832 ext(0->32767) 00002000:00010000:2.0:1788361648.243630:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007350a80 00000100:00100000:2.0:1788361648.243667:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 595 00000100:00100000:2.0:1788361648.243677:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:2411:x1875230407000832:12345-192.168.204.35@tcp:3:md5sum.0 00000100:00100000:2.0:1788361648.246078:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:2411:x1875230407000832:12345-192.168.204.35@tcp:3:md5sum.0 Request processed in 2395us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361648.246092:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 595 00002000:00100000:2.0:1788361648.246103:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff99d007350a80 x1875230407000832/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 488/440 e 0 to 0 dl 1788361659 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361648.246118:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007350a80 with x1875230407000832 ext(0->32767) 00002000:00010000:2.0:1788361648.246125:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007350a80 00000100:00100000:0.0:1788361648.250672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361648.250762:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407000960 00000100:00100000:2.0:1788361648.250789:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407000960 00002000:00100000:2.0:1788361648.250868:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff99d002d54700 x1875230407000960/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 488/0 e 0 to 0 dl 1788361659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361648.250879:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d002d54700 with x1875230407000960 ext(32768->1048575) 00002000:00010000:2.0:1788361648.250886:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d002d54700 00000100:00100000:2.0:1788361648.250909:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 596 00000100:00100000:2.0:1788361648.250929:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ec302d84-8f96-49d3-8682-aefc474f8448+8:2409:x1875230407000960:12345-192.168.204.35@tcp:3:md5sum.0 00000100:00100000:2.0:1788361648.254460:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ec302d84-8f96-49d3-8682-aefc474f8448+8:2409:x1875230407000960:12345-192.168.204.35@tcp:3:md5sum.0 Request processed in 3525us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361648.254472:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 596 00002000:00100000:2.0:1788361648.254484:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff99d002d54700 x1875230407000960/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 488/440 e 0 to 0 dl 1788361659 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361648.254494:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d002d54700 with x1875230407000960 ext(32768->1048575) 00002000:00010000:2.0:1788361648.254501:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d002d54700 00000100:00100000:0.0:1788361648.266390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361648.266596:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407001216 00000100:00100000:1.0:1788361648.266607:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407001216 00000100:00100000:1.0:1788361648.266671:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 228 00000100:00100000:1.0:1788361648.266682:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+24:69453:x1875230407001216:12345-192.168.204.35@tcp:35:md5sum.0 00010000:00000080:1.0:1788361648.267266:0:66130:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d002d56d80 x1875230407001216/t111669149712(0) o35->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 392/456 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361648.267319:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec302d84-8f96-49d3-8682-aefc474f8448+25:69453:x1875230407001216:12345-192.168.204.35@tcp:35:md5sum.0 Request processed in 640us (939us total) trans 111669149712 rc 0/0 00000100:00100000:1.0:1788361648.267327:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 228 00000100:00100000:0.0:1788361648.283469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361648.283975:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407001344 00000100:00100000:2.0:1788361648.283987:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407001344 00000100:00100000:2.0:1788361648.284052:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1187 00000100:00100000:2.0:1788361648.284062:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+25:69455:x1875230407001344:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:2.0:1788361648.284137:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284156:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284168:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284196:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284203:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284210:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284281:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284290:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284296:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361648.284334:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1788361648.284339:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361648.284352:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284366:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284372:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284379:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284397:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284403:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361648.284407:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284414:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284426:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec600) 00010000:00010000:2.0:1788361648.284429:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361648.284433:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284440:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe319f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284455:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284461:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284467:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284472:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361648.284475:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284490:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284498:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d007048c00) 00010000:00010000:2.0:1788361648.284500:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361648.284502:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284508:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe31a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284522:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284528:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284534:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284539:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361648.284542:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284546:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284552:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:2.0:1788361648.284555:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361648.284557:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361648.284574:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe31ad lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1788361648.284595:0:67579:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d002d56a00 x1875230407001344/t0(0) o34->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:709/0 lens 472/728 e 0 to 0 dl 1788361659 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361648.284665:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+25:69455:x1875230407001344:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 604us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361648.284673:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1187 00000100:00100000:0.0:1788361648.983294:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429797120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361648.983366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361648.983417:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361648.983425:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429797248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361648.983452:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361648.983555:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797120 00000100:00100000:3.0:1788361648.983564:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797120 00000100:00100000:2.0:1788361648.983564:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797248 00000100:00100000:2.0:1788361648.983571:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797248 00000100:00100000:2.0:1788361648.983636:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1788361648.983646:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429797248:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361648.983739:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1788361648.983750:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429797120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788361648.983754:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788361648.983769:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361648.983845:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429797120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361648.983853:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1788361648.984086:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429797248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361648.984094:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00080000:0.0:1788361648.984772:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361648.984778:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361648.984818:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429797120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361648.984818:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429797248:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1788361649.197023:0:90236:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788361649.197077:0:90236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.197090:0:90236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.197097:0:90236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.197104:0:90236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.197217:0:90236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361649.197220:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788361649.197223:0:90236:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788361649.197229:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.197239:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361649.197244:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.197254:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361649.197255:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361649.197262:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361649.197267:0:90236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1788361649.197279:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361649.197285:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361649.197288:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788361649.197290:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1788361649.197295:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d137f16000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788361649.197317:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.197324:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361649.197355:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429797376:0@lo:39:umount.0 00010000:00010000:2.0:1788361649.197359:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.197369:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe2cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2cc8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361649.197370:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429797504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361649.197389:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.197392:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.197394:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361649.197439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361649.197440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361649.197478:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797376 00000100:00100000:3.0:1788361649.197487:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797376 00000100:00100000:0.0:1788361649.197517:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797504 00000100:00100000:0.0:1788361649.197523:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797504 00000100:00100000:3.0:1788361649.197550:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1788361649.197561:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429797376:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788361649.197586:0:66126:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2de0 00000100:00080000:3.0:1788361649.197601:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d104f3c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788361649.197625:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1788361649.197634:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429797504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361649.197655:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361649.197671:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166a200/0x1b69fa8920fe2cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2cc1 expref: 24 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1788361649.197683:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1364fc000 x1875230429797376/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:710/0 lens 224/224 e 0 to 0 dl 1788361660 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788361649.197684:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361649.197725:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361649.197997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3653:x1875230429797504:12345-0@lo:103:ldlm_bl.0 Request processed in 363us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361649.198002:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429797504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361649.198009:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1788361649.198040:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875230429797376:12345-0@lo:39:umount.0 Request processed in 479us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361649.198047:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000020:00000080:3.0:1788361649.198067:0:66126:0:(genops.c:906:class_export_put()) final put ffff99d104f3a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788361649.198102:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d104f3a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788361649.198172:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d104f3c800 for lustre-MDT0000 00000100:00080000:2.0:1788361649.198350:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137f16000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788361649.198433:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429797376:0@lo:39:umount.0 00000100:00080000:1.0:1788361649.198702:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361649.198705:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361649.198708:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788361649.199623:0:90236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199633:0:90236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199638:0:90236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199642:0:90236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199660:0:90236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361649.199666:0:90236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199687:0:90236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199693:0:90236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199699:0:90236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.199704:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361649.199723:0:90236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361649.199726:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199730:0:90236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.199741:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785fe00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:1.0:1788361649.199744:0:90236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361649.199747:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199756:0:90236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199763:0:90236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199784:0:90236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361649.199790:0:90236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199797:0:90236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199840:0:90236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199845:0:90236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.199847:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361649.199855:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.199856:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.199858:0:90236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788361649.199863:0:90236:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788361649.199876:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785ee00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361649.199877:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361649.199882:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361649.199885:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361649.199888:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:01000004:1.0:1788361649.199891:0:90236:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 10000000:01000000:0.0:1788361649.199892:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000000:1.0:1788361649.199908:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1788361649.199914:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788361649.199915:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788361649.199922:0:90236:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 10000000:00010000:2.0:1788361649.199925:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361649.199934:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361649.199936:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361649.199938:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788361649.199942:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788361649.199951:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361649.199959:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.199962:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361649.199965:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361649.199974:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785f000 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:2.0:1788361649.199977:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1788361649.199979:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.199987:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.199989:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361649.199990:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.200009:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785fe00/0x1b69fa8920fe2bef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2bf6 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.200012:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785ee00/0x1b69fa8920fe2ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2ceb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361649.200013:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.200033:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788361649.200034:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788361649.200039:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788361649.200039:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.200040:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788361649.200043:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788361649.200045:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.200049:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361649.200052:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e600 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361649.200057:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.200058:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361649.200067:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361649.200075:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361649.200076:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361649.200085:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361649.200088:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788361649.200090:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788361649.200096:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361649.200108:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.200115:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361649.200121:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.200124:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361649.200144:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe2cb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2cba expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.200148:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe2be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe2be8 expref: -99 pid: 88873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361649.200159:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361649.200162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361649.200165:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361649.200168:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361649.200180:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361649.200180:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429797632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361649.200184:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361649.200199:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429798016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361649.200328:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429797888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361649.200554:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361649.200593:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797632 00000100:00100000:3.0:1788361649.200600:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797632 00000100:00100000:2.0:1788361649.200601:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361649.200613:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361649.200622:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429797760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361649.200649:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797888 00000100:00100000:2.0:1788361649.200654:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797888 00000100:00100000:3.0:1788361649.200656:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1788361649.200659:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361649.200670:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429797632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361649.200682:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361649.200689:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429797760 00000100:00100000:2.0:1788361649.200693:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429797760 00010000:00010000:3.0:1788361649.200699:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe2bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2bef expref: 24 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361649.200704:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1788361649.200715:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429797888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361649.200720:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361649.200725:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361649.200735:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1788361649.200746:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429797760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361649.200749:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe2cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2cb3 expref: 24 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.200756:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788361649.200762:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429797632:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (207us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361649.200768:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bfe00/0x1b69fa8920fe2ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2ce4 expref: 24 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361649.200775:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00010000:00010000:2.0:1788361649.200786:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361649.200814:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429797760:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361649.200839:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00010000:00010000:0.0:1788361649.201113:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361649.201153:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3652:x1875230429797888:12345-0@lo:103:ldlm_bl.0 Request processed in 442us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.201159:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1788361649.201180:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361649.201242:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429797760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361649.201252:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798016 00000100:00100000:3.0:1788361649.201257:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798016 00000100:00100000:3.0:1788361649.201285:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1788361649.201291:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3653:x1875230429798016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361649.201298:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361649.201307:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe2be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2be1 expref: 20 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361649.201317:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361649.201346:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3653:x1875230429798016:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361649.201358:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1788361649.201383:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429797888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361649.201483:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429797632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361649.201510:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429798016:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788361649.201745:0:90236:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788361649.202361:0:88874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00010000:00010000:1.0:1788361649.202392:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202402:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202408:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202415:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361649.202419:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202427:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202442:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d136764100) 00010000:00010000:1.0:1788361649.202453:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361649.202457:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202464:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3087 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202480:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202486:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202493:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202497:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361649.202500:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202506:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202514:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d136764100) 00010000:00010000:1.0:1788361649.202517:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361649.202519:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202526:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe30bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202541:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202554:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202560:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202565:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361649.202568:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202573:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202582:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d007048800) 00010000:00010000:1.0:1788361649.202584:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361649.202587:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361649.202592:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3113 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361649.202658:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788361649.202665:0:90236:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d1171e2800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361649.202670:0:90236:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d104f3d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361649.202674:0:90236:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d1171e0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361649.202678:0:90236:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d10f559800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361649.202684:0:90236:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d10f55e000 ec302d84-8f96-49d3-8682-aefc474f8448 192.168.204.35@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 111669149712 stale:0 00000020:00080000:3.0:1788361649.202689:0:90236:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99d136cb4d40) has exports, disconnecting them 00000020:00080000:3.0:1788361649.202693:0:90236:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d1171e2800), last request at 1788361634 00000020:00000080:3.0:1788361649.202699:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2dd9 00000100:00080000:3.0:1788361649.202707:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d1171e6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788361649.202758:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d1171e2800): rc 0 00000020:00000080:3.0:1788361649.202761:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d1171e2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788361649.202779:0:90236:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d104f3d000), last request at 1788361644 00000020:00000080:3.0:1788361649.202791:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2dd2 00000100:00080000:3.0:1788361649.202796:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d104f3e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788361649.202837:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361649.202870:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788361649.202941:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1171e6800 for lustre-MDT0000 00000020:00080000:3.0:1788361649.202965:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d104f3d000): rc 0 00000020:00000080:3.0:1788361649.202968:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d104f3d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788361649.202978:0:90236:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d1171e0000), last request at 1788361644 00000020:00000080:3.0:1788361649.202981:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2dcb 00000100:00080000:3.0:1788361649.202988:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d1171e5800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788361649.202993:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d104f3d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1788361649.203002:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d1171e0000): rc 0 00000020:00000080:3.0:1788361649.203005:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d1171e0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788361649.203012:0:90236:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d10f559800), last request at 1788361629 00000020:00000080:3.0:1788361649.203023:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c35 00000020:00000080:0.0:1788361649.203031:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d104f3e000 for lustre-MDT0000 00000020:00000080:0.0:1788361649.203038:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788361649.203042:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d0055d7800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361649.203044:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361649.203060:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1171e5800 for lustre-MDT0000 00010000:00010000:1.0:1788361649.203078:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.203082:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788361649.203101:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d10f559800): rc 0 00000020:00000080:3.0:1788361649.203103:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d10f559800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788361649.203115:0:90236:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.35@tcp (ffff99d10f55e000), last request at 1788361648 00000020:00000080:3.0:1788361649.203118:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c2e 00000020:00000080:0.0:1788361649.203129:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f559800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788361649.203163:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d0055d7800 for lustre-MDT0000 00000020:00010000:3.0:1788361649.203182:0:90236:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d10f55e000: total 0 00000100:00080000:3.0:1788361649.203187:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d137d1f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788361649.203202:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d10f55e000): rc 0 00000004:00000080:3.0:1788361649.203209:0:90236:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa0881d83ae0 00000020:00010000:2.0:1788361649.203216:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d10f55e000: total 0 00000100:00080000:3.0:1788361649.203226:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788361649.203229:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788361649.203293:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d10f55e000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788361649.203317:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe3128 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 8 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203346:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe314b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e7e expref: 7 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203363:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe3017 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e0e expref: 6 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203374:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309a00/0x1b69fa8920fe3191 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e8c expref: 5 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203402:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166ae00/0x1b69fa8920fe301e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e15 expref: 4 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203416:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fee00/0x1b69fa8920fe310c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e54 expref: 3 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203430:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eac00/0x1b69fa8920fe3010 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e07 expref: 2 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.203445:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d10f55e000, canceled 7 locks, left on hash table 0. 00000100:00080000:3.0:1788361649.204670:0:90236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788361649.204698:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d141652000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361649.204856:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429798144:0@lo:39:umount.0 00000100:00100000:0.0:1788361649.204948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361649.205273:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798144 00000100:00100000:3.0:1788361649.205280:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798144 00000100:00100000:3.0:1788361649.205333:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:3.0:1788361649.205342:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429798144:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788361649.205366:0:23938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c66 00000100:00080000:3.0:1788361649.205372:0:23938:0:(import.c:65:import_set_state_nolock()) ffff99d116c07000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361649.205386:0:23938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411438 00000100:00100000:3.0:1788361649.205804:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3649:x1875230429798144:12345-0@lo:39:umount.0 Request processed in 439us (831us total) trans 77309411439 rc 0/0 00000100:00100000:3.0:1788361649.205812:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00080000:0.0:1788361649.205936:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d141652000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788361649.205943:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429798144:0@lo:39:umount.0 00010000:00010000:1.0:1788361649.206012:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361649.206204:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361649.206208:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 3 00000004:00080000:3.0:1788361649.206225:0:90236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788361649.206285:0:90236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788361649.206300:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d136cc4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361649.206353:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429798272:0@lo:9:umount.0 00000100:00100000:0.0:1788361649.206386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361649.206431:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361649.206434:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 3 00000004:00080000:3.0:1788361649.206445:0:90236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361649.206452:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798272 00000100:00100000:1.0:1788361649.206458:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798272 00000100:00100000:1.0:1788361649.206505:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899 00000100:00100000:1.0:1788361649.206513:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429798272:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788361649.206530:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c90 00000100:00080000:3.0:1788361649.206534:0:90236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788361649.206537:0:15123:0:(import.c:65:import_set_state_nolock()) ffff99d003820000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788361649.206547:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d1171e5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361649.206577:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429798400:0@lo:9:umount.0 00000001:00000004:1.0:1788361649.206580:0:15123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968749 00000100:00100000:0.0:1788361649.206608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361649.206643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361649.206657:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798400 00000100:00100000:0.0:1788361649.206662:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798400 00000100:00100000:0.0:1788361649.206702:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4900 00000100:00100000:1.0:1788361649.206706:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429798272:12345-0@lo:9:umount.0 Request processed in 192us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.206715:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429798400:12345-0@lo:9:umount.0 00000100:00100000:1.0:1788361649.206719:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899 00000020:00000080:0.0:1788361649.206732:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c9e 00000100:00080000:0.0:1788361649.206739:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99d003825000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361649.206772:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968750 00000020:00080000:3.0:1788361649.207279:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d136cb4d40) has no exports 00000100:00100000:0.0:1788361649.207410:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429798400:12345-0@lo:9:umount.0 Request processed in 698us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.207425:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4900 00000100:00080000:0.0:1788361649.207451:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361649.207926:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1171e5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361649.207935:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361649.207937:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361649.207941:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429798400:0@lo:9:umount.0 00000100:00080000:3.0:1788361649.207951:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d136cc4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361649.207957:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361649.207958:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361649.207960:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429798272:0@lo:9:umount.0 00010000:00010000:1.0:1788361649.208021:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361649.208077:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788361649.208487:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d136cb4d40) has no exports 00010000:00010000:1.0:1788361649.237919:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361649.259759:0:6512:0:(genops.c:906:class_export_put()) final put ffff99d10f55e000/ec302d84-8f96-49d3-8682-aefc474f8448 00010000:00010000:2.0:1788361649.259789:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.259792:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.259794:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361649.259818:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f55e000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-MDT0000 00000020:00000080:1.0:1788361649.259908:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137d1f000 for lustre-MDT0000 00000020:00000080:3.0:1788361649.276252:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c4a 00000020:00000080:3.0:1788361649.276269:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d10608e800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788361649.276335:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788361649.276346:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361649.276356:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361649.276359:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d137c019c0) has no exports 00000020:00000080:1.0:1788361649.276465:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10608e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788361649.276988:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c43 00000020:00000080:3.0:1788361649.276995:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d005030800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361649.277052:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361649.277061:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788361649.277064:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d10f771000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788361649.277067:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f771000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788361649.277075:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361649.277309:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005030800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788361649.277393:0:90236:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d10e5e0960 - data ffff99d11764f870/ffff99d137e65800 00000020:01000000:3.0:1788361649.277528:0:90236:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d00697e900 - data ffff99d11750f5e8/ffff99d137c8b400 00000100:00080000:2.0:1788361649.309755:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788361649.309764:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361649.309779:0:90236:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d136ed5500 x1875230429798144/t77309411439(77309411439) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361659 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361649.309803:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788361649.312798:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788361649.312805:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 4 00000004:00080000:2.0:1788361649.312943:0:90236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361649.312946:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788361649.313188:0:88890:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361649.313193:0:88890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1788361649.313206:0:88890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:2.0:1788361649.314047:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788361649.314051:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 4 00000004:00080000:2.0:1788361649.314096:0:90236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361649.314099:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788361649.314277:0:88892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361649.314283:0:88892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:1.0:1788361649.314290:0:88892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1788361649.315424:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c04 00000020:00000080:1.0:1788361649.315434:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d002090800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361649.315550:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002090800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361649.316149:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c19 00000020:00000080:1.0:1788361649.316154:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d10f55a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361649.316164:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788361649.316169:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361649.316179:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361649.316184:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99d136cb19c0) has no exports 00000020:00000080:0.0:1788361649.316185:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f55a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788361649.316383:0:90236:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788361649.316388:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c97 00000020:00000080:1.0:1788361649.316392:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d13fd15000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361649.316400:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361649.316404:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361649.316420:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd15000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361649.316459:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361649.316462:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d003a08000) has no exports 00000020:00000080:1.0:1788361649.316479:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c89 00000020:00000080:1.0:1788361649.316483:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d1171e4000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788361649.316944:0:90236:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361649.316949:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361649.316952:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 5 00000004:00080000:1.0:1788361649.316956:0:90236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361649.316958:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361649.316983:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361649.316991:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361649.316999:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c7b 00000020:00000080:1.0:1788361649.317003:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d005034800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361649.317060:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361649.317064:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361649.317069:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361649.317072:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99d003a099c0) has no exports 00000020:00000080:1.0:1788361649.317076:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c74 00000020:00000080:1.0:1788361649.317080:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d139ff4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361649.317200:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788361649.317208:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1171e5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788361649.317213:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d005037000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361649.317215:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005037000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788361649.317219:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361649.317287:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005034800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788361649.317728:0:90236:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361649.317732:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361649.317734:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 5 00000004:00080000:1.0:1788361649.317737:0:90236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361649.317738:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361649.317764:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d139ff4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361649.317981:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361649.317989:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788361649.318001:0:90236:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788361649.318007:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c5f 00000020:00000080:1.0:1788361649.318012:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d12c4e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361649.318035:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136cc4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788361649.318041:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d12c4e7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361649.318043:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788361649.318047:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361649.318208:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788361649.318213:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361649.318219:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361649.318222:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99d137c04d40) has no exports 00000020:00000080:1.0:1788361649.318227:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c58 00000020:00000080:1.0:1788361649.318239:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d141655800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361649.318264:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788361649.319285:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141655800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788361649.319315:0:90236:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788361649.319318:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788361649.319322:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788361649.319327:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361649.319378:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361649.319386:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361649.319416:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361649.319429:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361649.319432:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d12c4e5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361649.319435:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788361649.319444:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361649.319462:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141652000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788361649.319470:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d12c4e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361649.319473:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788361649.319479:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361649.319532:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c20 00000020:00000080:0.0:1788361649.319539:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d10f55d000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788361649.319550:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788361649.319554:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f55d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788361649.319555:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361649.319563:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361649.319566:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99d136cb0000) has no exports 00000020:00000080:0.0:1788361649.319586:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361649.319589:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361649.319591:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d13fd9e800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788361649.319599:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788361649.319603:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361649.319633:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2c27 00000020:00000080:0.0:1788361649.319637:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d10f55c800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361649.319653:0:90236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d13fd79000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788361649.319657:0:90236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d13fd79000 3 00000020:01000004:0.0:1788361649.319659:0:90236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d13fd79000 from lustre-MDT0000 00000020:00000080:0.0:1788361649.319678:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361649.319682:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788361649.319684:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d12c4e0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788361649.319686:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d12c4e0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788361649.319692:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788361649.319721:0:90236:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:00000080:2.0:1788361649.319722:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f55c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788361649.319724:0:90236:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788361649.319729:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788361649.319732:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361649.319735:0:90236:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788361649.319742:0:90236:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d11e636800 1f5c0251-1795-40ef-8392-cb147010b7b5 192.168.204.35@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361649.319749:0:90236:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d006c8c800 c8a6f36d-efb9-41cf-af98-5917323f2b0d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361649.320435:0:90236:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff99d10531b380) has exports, disconnecting them 00000020:00080000:0.0:1788361649.320443:0:90236:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.35@tcp (ffff99d11e636800), last request at 1788361631 00000020:00000080:0.0:1788361649.320464:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2da8 00000020:00010000:0.0:1788361649.320468:0:90236:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d11e636800: total 0 00000100:00080000:0.0:1788361649.320472:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d11e637000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361649.320527:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d11e636800): rc 0 00000020:00080000:0.0:1788361649.320531:0:90236:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d006c8c800), last request at 1788361629 00000020:00000080:0.0:1788361649.320571:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2bc5 00000020:00010000:0.0:1788361649.320574:0:90236:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d006c8c800: total 0 00000100:00080000:0.0:1788361649.320577:0:90236:0:(import.c:65:import_set_state_nolock()) ffff99d006c8c000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788361649.320702:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d11e636800: total 0 00010000:00010000:2.0:1788361649.320738:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d11e636800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788361649.320767:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bea00/0x1b69fa8920fe2db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710de4 expref: 5 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320797:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bf600/0x1b69fa8920fe2dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710df2 expref: 4 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320817:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bf000/0x1b69fa8920fe2daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ddd expref: 3 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320846:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bfc00/0x1b69fa8920fe2dbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710deb expref: 2 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320855:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d11e636800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788361649.320874:0:8454:0:(genops.c:906:class_export_put()) final put ffff99d11e636800/1f5c0251-1795-40ef-8392-cb147010b7b5 00000020:00010000:2.0:1788361649.320884:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d006c8c800: total 1 00010000:00010000:2.0:1788361649.320887:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.320916:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d006c8c800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788361649.320931:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe2d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d70 expref: 16 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320943:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231be600/0x1b69fa8920fe2d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d00 expref: 15 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320965:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe2d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d62 expref: 14 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320974:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012ebe00/0x1b69fa8920fe2cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2cf2 expref: 13 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.320984:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe2d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d1c expref: 12 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321019:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe2d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d7e expref: 11 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788361649.321056:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d006c8c800): rc 0 00000020:00080000:0.0:1788361649.321062:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99d10531b380) has no exports 00010000:00010000:0.0:1788361649.321071:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361649.321127:0:88880:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d136e07400:88880] 1 exiting: rc = 0 00010000:00010000:2.0:1788361649.321229:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231be400/0x1b69fa8920fe2d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d0e expref: 8 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321247:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012ebc00/0x1b69fa8920fe2d93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d8c expref: 7 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321260:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e800/0x1b69fa8920fe2da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d9a expref: 6 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321270:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785f800/0x1b69fa8920fe2d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d2a expref: 5 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321279:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1231bf200/0x1b69fa8920fe2d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d38 expref: 4 pid: 88879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321289:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe2d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d46 expref: 3 pid: 88881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321314:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe2d5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe2d54 expref: 2 pid: 88880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361649.321324:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d006c8c800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788361649.321345:0:8454:0:(genops.c:906:class_export_put()) final put ffff99d006c8c800/c8a6f36d-efb9-41cf-af98-5917323f2b0d 00010000:00010000:2.0:1788361649.321351:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.321353:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361649.321356:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361649.321364:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e636800/1f5c0251-1795-40ef-8392-cb147010b7b5 for MGS 00000100:00100000:3.0:1788361649.321368:0:88881:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d136e07c00:88881] 2 exiting: rc = 0 00000020:00000080:2.0:1788361649.321391:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8c800/c8a6f36d-efb9-41cf-af98-5917323f2b0d for MGS 00000020:00000080:2.0:1788361649.321404:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e637000 for MGS 00000020:00000080:2.0:1788361649.321408:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006c8c000 for MGS 00000100:00100000:0.0:1788361649.321517:0:88879:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d139833a00:88879] 0 exiting: rc = 1 00000100:00100000:0.0:1788361649.321583:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321593:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321601:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321674:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321685:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321691:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321698:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321704:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321710:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321716:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321721:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321727:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321733:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321739:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321749:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321758:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321774:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321779:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321786:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321792:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321799:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321805:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321810:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321816:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321847:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321854:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321861:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321868:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321875:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321885:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321901:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321909:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321916:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321923:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321929:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321935:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321940:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321946:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321951:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321956:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321962:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321966:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321972:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321977:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321981:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321986:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321992:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.321997:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322003:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322010:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322020:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322041:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322047:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322052:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322063:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322067:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322073:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322079:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322085:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322090:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322096:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322101:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322106:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361649.322110:0:90236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788361649.322955:0:90236:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d1046e2a20 - data ffff99d12cba66c0/ffff99d136fdd000 00000020:01000000:0.0:1788361649.323084:0:90236:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d004597120 - data ffff99d12c9d4e58/ffff99d117064800 00000020:00000080:0.0:1788361649.323598:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2bbe 00000020:00000080:0.0:1788361649.323606:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d006c8b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361649.323623:0:90236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d13fd79000 from MGS, refs=2 00000020:01000004:0.0:1788361649.323627:0:90236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d13fd79000 2 00000020:01000004:0.0:1788361649.323630:0:90236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d13fd79000 from MGS 00000020:00000080:0.0:1788361649.323656:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361649.323663:0:90236:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788361649.323666:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d006c89000/MGS 00000020:00000080:0.0:1788361649.323669:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c89000/MGS for MGS 00000020:00000080:2.0:1788361649.323672:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788361649.323675:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788361649.323737:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788361649.323740:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361649.323749:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361649.323755:0:90236:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d137f16800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361649.323765:0:90236:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99d10531cd40) has exports, disconnecting them 00000020:00080000:0.0:1788361649.323770:0:90236:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d137f16800), last request at 1788361629 00000020:00000080:0.0:1788361649.323774:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2cd6 00000020:00080000:0.0:1788361649.323791:0:90236:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d137f16800): rc 0 00000020:00000080:0.0:1788361649.323796:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d137f16800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788361649.323859:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f16800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788361649.324879:0:90236:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788361649.324885:0:90236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361649.324888:0:90236:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788361649.324906:0:90236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361649.324925:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137f16000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788361649.325029:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361649.325037:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788361649.325041:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d137f14000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788361649.325044:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f14000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788361649.325050:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788361649.325114:0:90236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d13fd79000 1 00000020:00000080:2.0:1788361649.325121:0:90236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2bb0 00000020:00000080:2.0:1788361649.325128:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d006c8f000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788361649.325138:0:90236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788361649.325151:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361649.325158:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361649.325161:0:90236:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361649.325165:0:90236:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d001c619c0) has no exports 00000020:00000080:2.0:1788361649.363800:0:90236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361649.363812:0:90236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788361649.363817:0:90236:0:(genops.c:906:class_export_put()) final put ffff99d1055ab000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361649.363887:0:90236:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1055ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788361649.363918:0:90236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788361649.364253:0:90236:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d136ec5000 00000020:02000400:2.0:1788361649.364314:0:90236:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788361650.006156:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429798528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361650.006267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361650.006307:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429798912:0@lo:400:kworker.0 00000100:00100000:2.0:1788361650.006340:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429799040:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.006373:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429798784:0@lo:400:kworker.0 00000100:00100000:3.0:1788361650.006389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361650.006412:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798528 00000100:00100000:2.0:1788361650.006423:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798528 00000100:00100000:1.0:1788361650.006429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361650.006441:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.006467:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429799296:0@lo:400:kworker.0 00000100:00100000:3.0:1788361650.006480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361650.006493:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:2.0:1788361650.006504:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1875230429798528:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361650.006517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788361650.006526:0:8448:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788361650.006543:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798912 00000100:00100000:3.0:1788361650.006552:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798912 00000100:00100000:1.0:1788361650.006568:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798784 00000100:00100000:1.0:1788361650.006574:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798784 00000100:00100000:2.0:1788361650.006589:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1875230429798528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (321us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361650.006599:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1788361650.006626:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1788361650.006644:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429798912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361650.006669:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429798656:0@lo:400:kworker.0 00000100:00100000:3.0:1788361650.006711:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429798912:12345-0@lo:400:kworker.0 Request processed in 72us (321us total) trans 0 rc 0/0 00000400:00000100:0.0:1788361650.006725:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429798656 offset 0 length 224: 4 00000100:00100000:3.0:1788361650.006726:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1788361650.006778:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788361650.006806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361650.006866:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429799680:0@lo:400:kworker.0 00000100:00100000:0.0:1788361650.006901:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361650.006936:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799296 00000100:00100000:0.0:1788361650.006941:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799296 00000100:00100000:2.0:1788361650.007021:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799168 00000100:00100000:2.0:1788361650.007028:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799168 00000100:00100000:0.0:1788361650.007033:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:0.0:1788361650.007038:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3652:x1875230429799296:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361650.007044:0:8449:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361650.007078:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3652:x1875230429799296:12345-0@lo:400:kworker.0 Request processed in 39us (572us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361650.007085:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00080000:0.0:1788361650.007119:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788361650.007125:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788361650.007128:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788361650.007136:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361650.007140:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2674 00000100:00080000:0.0:1788361650.007147:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361650.007174:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1364fe300 x1875230429799808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361650.007196:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429799296:0@lo:400:kworker.0 00000100:00100000:0.0:1788361650.007260:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799680 00000100:00100000:0.0:1788361650.007263:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799680 00000100:00100000:1.0:1788361650.007335:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1788361650.007342:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875230429798784:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788361650.007349:0:66128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361650.007398:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875230429798784:12345-0@lo:400:kworker.0 Request processed in 56us (971us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361650.007404:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1788361650.007444:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799424 00000100:00100000:1.0:1788361650.007449:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799424 00000100:00100000:1.0:1788361650.007479:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:1.0:1788361650.007484:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429799424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.007598:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429799424:12345-0@lo:400:kworker.0 Request processed in 113us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361650.007604:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00080000:1.0:1788361650.007622:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361650.007627:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361650.007660:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429798912:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.007671:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.007714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361650.007745:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429799552:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.007771:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:1.0:1788361650.007803:0:3650:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788361650.007806:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361650.007809:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99d106904000 already not connected (conn 40, was 39): CONNECTING 00000100:00100000:1.0:1788361650.007836:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799040 00000100:00100000:1.0:1788361650.007839:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799040 00000100:00100000:1.0:1788361650.007854:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1788361650.007858:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875230429799040:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788361650.007864:0:66128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361650.007903:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875230429799040:12345-0@lo:400:kworker.0 Request processed in 43us (188us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361650.007909:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:1.0:1788361650.007926:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361650.007929:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361650.007932:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788361650.007936:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361650.007938:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2674 00000100:00080000:1.0:1788361650.007942:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361650.007961:0:3650:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d110549c00 x1875230429799936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361650.007971:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429799040:0@lo:400:kworker.0 00000100:00080000:1.0:1788361650.007994:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361650.007996:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361650.007998:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788361650.007999:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361650.008006:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2674 00000100:00080000:1.0:1788361650.008009:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361650.008018:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d110549180 x1875230429800064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361650.008025:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429798784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.008048:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799552 00000100:00100000:1.0:1788361650.008050:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799552 00000100:00100000:1.0:1788361650.008069:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1788361650.008073:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429799552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.008103:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429799552:12345-0@lo:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361650.008109:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1788361650.008129:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429799808:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361650.008155:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361650.008174:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429799936:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788361650.008194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361650.008469:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429800064:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361650.008497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361650.008525:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799808 00000100:00100000:1.0:1788361650.008530:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799808 00000100:00100000:1.0:1788361650.008553:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:1.0:1788361650.008558:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429799808:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788361650.008578:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361650.008613:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429799808:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 53us (457us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361650.008627:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:1.0:1788361650.008646:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429799936 00000100:00100000:1.0:1788361650.008650:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429799936 00000100:00100000:1.0:1788361650.008662:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800064 00000100:00100000:1.0:1788361650.008664:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800064 00000100:00100000:1.0:1788361650.008679:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788361650.008684:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429799936:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788361650.008695:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361650.008726:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429799936:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (530us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361650.008732:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788361650.008743:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1788361650.008746:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429800064:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788361650.008754:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361650.008777:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429800064:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29us (281us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361650.008783:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:1.0:1788361650.008795:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361650.008812:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361650.008816:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361650.008819:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429799808:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788361650.008854:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361650.008858:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361650.008860:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429799936:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788361650.008866:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361650.008874:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361650.008876:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429800064:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361650.008924:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429799552:0@lo:400:kworker.0 00000100:00100000:2.0:1788361650.009169:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1788361650.009372:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1788361650.009384:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429799680:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361650.009394:0:66127:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361650.009444:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429799168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361650.009469:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429799680:12345-0@lo:400:kworker.0 Request processed in 86us (2565us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361650.009479:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1788361650.009510:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429799168:12345-0@lo:400:kworker.0 Request processed in 138us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361650.009532:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788361650.009533:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00080000:3.0:1788361650.009553:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361650.009558:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361650.009562:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361650.009568:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361650.009573:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2674 00000100:00080000:3.0:1788361650.009580:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361650.009649:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136ed6300 x1875230429800192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361650.009674:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429799680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361650.009717:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429800192:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361650.009760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361650.009814:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800192 00000100:00100000:2.0:1788361650.009852:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800192 00000100:00100000:2.0:1788361650.009890:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1788361650.009896:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429800192:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788361650.009915:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361650.009964:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429800192:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 66us (203us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361650.009971:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00080000:1.0:1788361650.010782:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361650.010790:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361650.010793:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429800192:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788361650.263902:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361650.571299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361650.571363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361650.571574:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407001600 00000100:00100000:1.0:1788361650.571582:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407001600 00000100:00100000:1.0:1788361650.571646:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4901 00000100:00100000:1.0:1788361650.571657:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407001600:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:3.0:1788361650.571709:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407001472 00000100:00100000:3.0:1788361650.571714:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407001472 00002000:00100000:3.0:1788361650.571747:0:24840:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff99d1364fc380 x1875230407001472/t0(0) o4->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:711/0 lens 488/0 e 0 to 0 dl 1788361661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361650.571756:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1364fc380 with x1875230407001472 ext(1048576->2097151) 00002000:00010000:3.0:1788361650.571763:0:24840:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d1364fc380 00000100:00080000:2.0:1788361650.571771:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361650.571787:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 597 00000100:00100000:3.0:1788361650.571794:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:2411:x1875230407001472:12345-192.168.204.35@tcp:4:md5sum.0 00000001:00100000:0.0:1788361650.575019:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361650.575029:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d003827800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788361650.575058:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968750 is committed 00000020:00000080:1.0:1788361650.575138:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d003827800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788361650.575191:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d003825000 for lustre-OST0001 00000100:00100000:2.0:1788361650.575472:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ec302d84-8f96-49d3-8682-aefc474f8448+8:2411:x1875230407001600:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 3811us (4101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361650.575483:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4901 00000100:00100000:3.0:1788361650.591863:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:2411:x1875230407001472:12345-192.168.204.35@tcp:4:md5sum.0 Request processed in 20059us (20564us total) trans 4294968751 rc 0/0 00000100:00100000:3.0:1788361650.591886:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 597 00002000:00100000:3.0:1788361650.591898:0:24840:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff99d1364fc380 x1875230407001472/t4294968751(0) o4->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:711/0 lens 488/448 e 0 to 0 dl 1788361661 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361650.591908:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1364fc380 with x1875230407001472 ext(1048576->2097151) 00002000:00010000:3.0:1788361650.591915:0:24840:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d1364fc380 00010000:00010000:2.0:1788361651.286289:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361652.105968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361652.106013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361652.106039:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407001856 00000100:00100000:3.0:1788361652.106050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361652.106054:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407001856 00000100:00100000:1.0:1788361652.106115:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407001984 00000100:00100000:1.0:1788361652.106119:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407001984 00000400:00000100:3.0:1788361652.106172:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407001728 offset 0 length 224: 4 00000100:00100000:1.0:1788361652.106210:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 864 00000100:00100000:3.0:1788361652.106217:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361652.106228:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230407001984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361652.106293:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1195 00000100:00100000:0.0:1788361652.106308:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2409:x1875230407001856:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:0.0:1788361652.106320:0:66128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:1.0:1788361652.106367:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230407001984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 143us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361652.106377:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 864 00000100:00080000:1.0:1788361652.106415:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361652.106574:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407002240 00000100:00100000:2.0:1788361652.106580:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407002240 00000100:00080000:1.0:1788361652.106608:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361652.106623:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407002112 00000100:00100000:2.0:1788361652.106626:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407002112 00000100:00100000:1.0:1788361652.106642:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1850 00000100:00100000:1.0:1788361652.106653:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:2410:x1875230407002240:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361652.106704:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:2410:x1875230407002240:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 54us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361652.106743:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1851 00000100:00100000:2.0:1788361652.106754:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:ec302d84-8f96-49d3-8682-aefc474f8448+8:2410:x1875230407002112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361652.106788:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:ec302d84-8f96-49d3-8682-aefc474f8448+8:2410:x1875230407002112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 37us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361652.106795:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1851 00000100:00100000:0.0:1788361652.106930:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2409:x1875230407001856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 620us (975us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361652.106944:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1195 00000100:00080000:0.0:1788361652.107059:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361652.107229:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1850 00000100:00100000:3.0:1788361652.109862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361652.109981:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407002368 00000100:00100000:2.0:1788361652.109995:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407002368 00000100:00100000:2.0:1788361652.110094:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1196 00000100:00100000:2.0:1788361652.110104:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875230407002368:12345-192.168.204.35@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788361652.110157:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361652.110243:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875230407002368:12345-192.168.204.35@tcp:38:ptlrpcd_00_00.0 Request processed in 138us (427us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361652.110254:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1196 00010000:00010000:0.0:1788361652.310509:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361653.334181:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361654.103054:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361654.103079:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429800320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361654.103153:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361654.103304:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800320 00000100:00100000:3.0:1788361654.103314:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800320 00000100:00100000:3.0:1788361654.103385:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:3.0:1788361654.103395:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429800320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361654.103426:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361654.103488:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429800320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361654.103511:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1788361654.103542:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429800320:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788361654.103575:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361654.106554:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429800448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361654.106628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361654.107372:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800448 00000100:00100000:0.0:1788361654.107383:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800448 00000100:00080000:2.0:1788361654.107555:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361654.107971:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1788361654.107983:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429800448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788361654.108015:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788361654.108082:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429800448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361654.108096:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1788361654.108120:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429800448:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788361654.108709:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361654.108715:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d004106800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788361654.108742:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968749 is committed 00000020:00000080:2.0:1788361654.108910:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d004106800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788361654.108956:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d003820000 for lustre-OST0000 00010000:00010000:1.0:1788361654.358098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361655.126130:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361655.126138:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361655.126141:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361655.126150:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2690 00000100:00080000:2.0:1788361655.126156:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361655.126165:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361655.126188:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d13651fb80 x1875230429800704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361655.126217:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361655.126220:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361655.126222:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361655.126225:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2690 00000100:00080000:2.0:1788361655.126228:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361655.126240:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361655.126253:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a08000 x1875230429800960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361655.126279:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361655.126282:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361655.126284:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361655.126287:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2690 00000100:00080000:2.0:1788361655.126289:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361655.126293:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361655.126306:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a09f80 x1875230429801216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361655.126333:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361655.126337:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361655.126339:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361655.126344:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2690 00000100:00100000:3.0:1788361655.126356:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429800832:0@lo:400:kworker.0 00000100:00080000:2.0:1788361655.126357:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788361655.126357:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429801088:0@lo:400:kworker.0 00000100:00080000:2.0:1788361655.126362:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361655.126378:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a0aa00 x1875230429801600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361655.126424:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429800576:0@lo:400:kworker.0 00000100:00100000:0.0:1788361655.126434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361655.126436:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429801344:0@lo:400:kworker.0 00000400:00000100:2.0:1788361655.126457:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429800576 offset 0 length 224: 4 00000100:00100000:3.0:1788361655.126475:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361655.126495:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429801472:0@lo:400:kworker.0 00000100:00100000:0.0:1788361655.126502:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361655.126526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361655.126545:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801344 00000100:00100000:3.0:1788361655.126552:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801344 00000100:00100000:0.0:1788361655.126556:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801088 00000100:00100000:2.0:1788361655.126573:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429800704:0@lo:38:kworker.0 00000100:00100000:3.0:1788361655.126592:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801472 00000100:00100000:3.0:1788361655.126595:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801472 00000100:00100000:3.0:1788361655.126618:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:2.0:1788361655.126621:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361655.126626:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429801344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361655.126637:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429800960:0@lo:38:kworker.0 00000100:00100000:2.0:1788361655.126654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361655.126669:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429801344:12345-0@lo:400:kworker.0 Request processed in 43us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361655.126669:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429801216:0@lo:38:kworker.0 00000100:00100000:3.0:1788361655.126676:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:2.0:1788361655.126688:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361655.126690:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:3.0:1788361655.126696:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429801472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361655.126703:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429801600:0@lo:38:kworker.0 00000100:00100000:2.0:1788361655.126719:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361655.126725:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429801472:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361655.126730:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1788361655.126751:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800832 00000100:00100000:2.0:1788361655.126755:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800832 00000100:00100000:3.0:1788361655.126761:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800704 00000100:00100000:3.0:1788361655.126764:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800704 00000100:00100000:3.0:1788361655.126793:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429800960 00000100:00100000:2.0:1788361655.126795:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801600 00000100:00100000:3.0:1788361655.126797:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429800960 00000100:00100000:2.0:1788361655.126797:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801600 00000100:00100000:2.0:1788361655.126808:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1788361655.126814:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429800832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361655.126815:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1788361655.126819:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429800704:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361655.126854:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361655.126874:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429800832:12345-0@lo:400:kworker.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361655.126881:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1788361655.126883:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429800704:12345-0@lo:38:kworker.0 Request processed in 63us (262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361655.126889:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1788361655.126894:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1788361655.126897:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788361655.126898:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429801600:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361655.126901:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429800960:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788361655.126908:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1788361655.126910:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361655.126929:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429800960:12345-0@lo:38:kworker.0 Request processed in 26us (273us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361655.126929:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429801600:12345-0@lo:38:kworker.0 Request processed in 29us (208us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361655.126935:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788361655.126937:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:2.0:1788361655.126951:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361655.126991:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429801472:0@lo:400:kworker.0 00000100:00100000:2.0:1788361655.127019:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429801344:0@lo:400:kworker.0 00000100:00080000:2.0:1788361655.127066:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361655.127070:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361655.127074:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429800704:0@lo:38:kworker.0 00000100:00080000:2.0:1788361655.127082:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788361655.127085:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801216 00000100:00080000:2.0:1788361655.127085:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361655.127088:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801216 00000100:00100000:2.0:1788361655.127088:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429800960:0@lo:38:kworker.0 00000100:00080000:2.0:1788361655.127094:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361655.127097:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361655.127099:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429801600:0@lo:38:kworker.0 00000100:00100000:3.0:1788361655.127108:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:3.0:1788361655.127112:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429801216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361655.127122:0:8449:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361655.127147:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429800832:0@lo:400:kworker.0 00000100:00100000:3.0:1788361655.127151:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429801216:12345-0@lo:38:kworker.0 Request processed in 38us (462us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361655.127156:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00080000:2.0:1788361655.127170:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361655.127173:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361655.127176:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429801216:0@lo:38:kworker.0 00000100:00100000:0.0:1788361655.127306:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801088 00000100:00100000:0.0:1788361655.127350:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1788361655.127358:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429801088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361655.127383:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361655.127400:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429801088:12345-0@lo:400:kworker.0 Request processed in 42us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361655.127407:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1788361655.127421:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429801088:0@lo:400:kworker.0 00000001:00100000:3.0:1788361655.131453:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788361655.131471:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411439 is committed 00000020:00000080:3.0:1788361655.131477:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d116c03800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361655.131538:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c03800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788361655.131646:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d116c07000 for lustre-MDT0001 00010000:00010000:2.0:1788361655.382013:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788361656.153928:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968751 is committed 00010000:00010000:0.0:1788361656.406103:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361657.224613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361657.224667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361657.224787:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407002752 00000100:00100000:2.0:1788361657.224798:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407002752 00000100:00100000:2.0:1788361657.224900:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 867 00000100:00100000:2.0:1788361657.224910:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407002752:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361657.224983:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407002752:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 74us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361657.225008:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 867 00000400:00000100:3.0:1788361657.225264:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407002496 offset 0 length 224: 4 00000100:00100000:3.0:1788361657.225293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00080000:1.0:1788361657.225337:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361657.226356:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361657.226456:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407002624 00000100:00100000:2.0:1788361657.226465:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407002624 00000100:00100000:2.0:1788361657.226507:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1200 00000100:00100000:2.0:1788361657.226513:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407002624:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:2.0:1788361657.226536:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361657.226592:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407002624:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 78us (238us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361657.226599:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1200 00000100:00100000:1.0:1788361657.227807:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003008 00000100:00100000:1.0:1788361657.227815:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003008 00000100:00100000:1.0:1788361657.227883:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407002880 00000100:00100000:1.0:1788361657.227887:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407002880 00000100:00100000:1.0:1788361657.227912:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1854 00000100:00100000:1.0:1788361657.227920:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407003008:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361657.227970:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407003008:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361657.227977:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1854 00000100:00100000:1.0:1788361657.227990:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1855 00000100:00100000:1.0:1788361657.227997:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407002880:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361657.228020:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407002880:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361657.228026:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1855 00000100:00080000:2.0:1788361657.229067:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361657.229076:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788361657.430443:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361658.454049:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361659.222022:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361659.222038:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429801856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361659.222077:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361659.222090:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429801728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361659.222109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361659.222130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361659.222251:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801728 00000100:00100000:1.0:1788361659.222251:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429801856 00000100:00100000:3.0:1788361659.222259:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801728 00000100:00100000:1.0:1788361659.222259:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429801856 00000100:00100000:1.0:1788361659.222322:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1788361659.222334:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1788361659.222339:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429801856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361659.222355:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429801728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361659.222376:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788361659.222376:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361659.222384:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361659.222424:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429801728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (294us total) trans 0 rc 0/0 00002000:00000024:1.0:1788361659.222429:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361659.222434:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1788361659.222490:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429801856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361659.222498:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429801728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361659.222502:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:0.0:1788361659.222517:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429801856:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788361659.479014:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361660.246895:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361660.246903:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361660.246907:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361660.246916:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2695 00000100:00080000:3.0:1788361660.246922:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361660.246928:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361660.246951:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1076a4000 x1875230429802112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361660.246983:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361660.246987:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361660.246989:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361660.246992:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2695 00000100:00080000:3.0:1788361660.246995:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361660.247014:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361660.247027:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5a300 x1875230429802368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361660.247043:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361660.247045:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361660.247047:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361660.247050:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2695 00000100:00080000:3.0:1788361660.247052:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361660.247056:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361660.247067:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5b480 x1875230429802624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361660.247113:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361660.247116:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361660.247118:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361660.247121:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2695 00000100:00080000:3.0:1788361660.247124:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361660.247127:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361660.247138:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5aa00 x1875230429803008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361660.247198:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429801984:0@lo:400:kworker.0 00000400:00000100:2.0:1788361660.247250:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429801984 offset 0 length 224: 4 00000100:00100000:2.0:1788361660.247290:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429802880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361660.247355:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361660.247361:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429802752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361660.247415:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802880 00000100:00100000:2.0:1788361660.247424:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802880 00000100:00100000:2.0:1788361660.247476:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802752 00000100:00100000:2.0:1788361660.247479:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802752 00000100:00100000:2.0:1788361660.247503:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1788361660.247511:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429802880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247559:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429802880:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361660.247566:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1788361660.247583:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1788361660.247589:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429802752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247618:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429802752:12345-0@lo:400:kworker.0 Request processed in 30us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361660.247625:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1788361660.247669:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429802752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247693:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429802880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247736:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429802112:0@lo:38:kworker.0 00000100:00100000:0.0:1788361660.247755:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429802240:0@lo:400:kworker.0 00000100:00100000:2.0:1788361660.247768:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361660.247793:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429802368:0@lo:38:kworker.0 00000100:00100000:0.0:1788361660.247798:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361660.248279:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802112 00000100:00100000:1.0:1788361660.248285:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802112 00000100:00100000:1.0:1788361660.248321:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802240 00000100:00100000:1.0:1788361660.248325:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802240 00000100:00100000:1.0:1788361660.248357:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1788361660.248364:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429802240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361660.248435:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1788361660.248439:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429802112:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361660.248457:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361660.248570:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361660.248578:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429802496:0@lo:400:kworker.0 00000100:00100000:0.0:1788361660.248605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361660.248646:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802496 00000100:00100000:0.0:1788361660.248650:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802496 00000100:00100000:0.0:1788361660.248676:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1788361660.248696:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429802496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361660.248745:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429802496:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361660.248752:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:0.0:1788361660.248775:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361660.248795:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429802496:0@lo:400:kworker.0 00000100:00100000:3.0:1788361660.249648:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429802112:12345-0@lo:38:kworker.0 Request processed in 1203us (1877us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361660.249667:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788361660.249710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429802240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361660.249767:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429802240:12345-0@lo:400:kworker.0 Request processed in 1402us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361660.249775:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1788361660.250133:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361660.250162:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429802624:0@lo:38:kworker.0 00000100:00100000:0.0:1788361660.250178:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802368 00000100:00100000:0.0:1788361660.250185:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802368 00000100:00100000:2.0:1788361660.250196:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361660.250219:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429803008:0@lo:38:kworker.0 00000100:00100000:2.0:1788361660.250239:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361660.250281:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429802624 00000100:00100000:1.0:1788361660.250287:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429802624 00000100:00100000:1.0:1788361660.250312:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1788361660.250317:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429802624:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361660.250345:0:23939:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361660.250375:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429802624:12345-0@lo:38:kworker.0 Request processed in 57us (179us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361660.250381:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:0.0:1788361660.250574:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803008 00000100:00100000:0.0:1788361660.250579:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803008 00000100:00100000:3.0:1788361660.250583:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1788361660.250590:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429802368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361660.250603:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788361660.250604:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361660.250611:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361660.250615:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429802112:0@lo:38:kworker.0 00000100:00080000:2.0:1788361660.250636:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788361660.250638:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429802368:12345-0@lo:38:kworker.0 Request processed in 47us (554us total) trans 0 rc -19/-19 00000100:00080000:2.0:1788361660.250642:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361660.250648:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429802368:0@lo:38:kworker.0 00000100:00100000:3.0:1788361660.250653:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00080000:2.0:1788361660.250662:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361660.250667:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361660.250670:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429802624:0@lo:38:kworker.0 00000100:00100000:0.0:1788361660.250675:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1788361660.250692:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429803008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788361660.250704:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361660.250737:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429803008:12345-0@lo:38:kworker.0 Request processed in 45us (496us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361660.250743:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:2.0:1788361660.252501:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361660.252511:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361660.252516:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429803008:0@lo:38:kworker.0 00010000:00010000:0.0:1788361660.502254:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361661.526091:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788361662.345150:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407003136 offset 0 length 224: 4 00000100:00100000:2.0:1788361662.345194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361662.345237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361662.345273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361662.345309:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003392 00000100:00100000:0.0:1788361662.345320:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003392 00000100:00100000:2.0:1788361662.345327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361662.345356:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003520 00000100:00100000:2.0:1788361662.345361:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003520 00000100:00100000:0.0:1788361662.345390:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003264 00000100:00100000:0.0:1788361662.345394:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003264 00000100:00100000:2.0:1788361662.345401:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003648 00000100:00100000:2.0:1788361662.345406:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003648 00000100:00100000:0.0:1788361662.345422:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 870 00000100:00100000:0.0:1788361662.345435:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230407003392:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361662.345442:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1858 00000100:00100000:0.0:1788361662.345511:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230407003392:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361662.345520:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 870 00000100:00100000:2.0:1788361662.345521:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407003520:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361662.345550:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1204 00000100:00100000:0.0:1788361662.345556:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230407003264:12345-192.168.204.35@tcp:38:kworker.0 00000100:00100000:2.0:1788361662.345563:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407003520:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361662.345572:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1858 00010000:00020000:0.0:1788361662.345580:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361662.345591:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1859 00000100:00100000:2.0:1788361662.345607:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230407003648:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361662.345611:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230407003264:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 51us (282us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361662.345620:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1204 00000100:00080000:0.0:1788361662.345653:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361662.345654:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+6:2411:x1875230407003648:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361662.345658:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361662.345662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361662.345666:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1859 00010000:00010000:1.0:1788361662.550031:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361663.574679:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361664.342003:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361664.342030:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429803136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361664.342106:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361664.342237:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803136 00000100:00100000:1.0:1788361664.342246:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803136 00000100:00100000:1.0:1788361664.342315:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1788361664.342327:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429803136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361664.342357:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361664.342425:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429803136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361664.342438:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00080000:1.0:1788361664.342466:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361664.343331:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361664.343344:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429803264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361664.343504:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361664.343760:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803264 00000100:00100000:1.0:1788361664.343766:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803264 00000100:00100000:0.0:1788361664.343806:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429803136:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788361664.343889:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361664.343998:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788361664.344009:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429803264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361664.344033:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361664.344079:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429803264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361664.344086:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:0.0:1788361664.344113:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429803264:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788361664.598960:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361665.366040:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361665.366048:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361665.366052:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361665.366061:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2700 00000100:00080000:3.0:1788361665.366066:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361665.366073:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361665.366095:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b58380 x1875230429803520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361665.366131:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361665.366133:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361665.366135:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361665.366139:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2700 00000100:00080000:3.0:1788361665.366141:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361665.366145:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361665.366156:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5b100 x1875230429803776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361665.366160:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429803520:0@lo:38:kworker.0 00000100:00100000:0.0:1788361665.366226:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361665.366476:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361665.366479:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361665.366481:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361665.366485:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2700 00000100:00080000:3.0:1788361665.366487:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361665.366490:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361665.366503:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b58a80 x1875230429804032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361665.366527:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361665.366530:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361665.366531:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361665.366534:0:79303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2700 00000100:00080000:3.0:1788361665.366537:0:79303:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361665.366539:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361665.366549:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5a680 x1875230429804416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361665.366800:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429803392:0@lo:400:kworker.0 00000400:00000100:3.0:1788361665.366859:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429803392 offset 0 length 224: 4 00000100:00100000:3.0:1788361665.366897:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429804288:0@lo:400:kworker.0 00000100:00100000:3.0:1788361665.366924:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361665.366951:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361665.366956:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429803648:0@lo:400:kworker.0 00000100:00100000:3.0:1788361665.367000:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804288 00000100:00100000:3.0:1788361665.367015:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804288 00000100:00100000:3.0:1788361665.367066:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1788361665.367074:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429804288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361665.367130:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429804288:12345-0@lo:400:kworker.0 Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.367137:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1788361665.367310:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429803904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361665.367343:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429804160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361665.367367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361665.367399:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804160 00000100:00100000:3.0:1788361665.367402:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804160 00000100:00100000:3.0:1788361665.367427:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1788361665.367432:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429804160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361665.367467:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429804160:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.367472:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1788361665.367513:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429804160:0@lo:400:kworker.0 00000100:00100000:1.0:1788361665.367749:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803520 00000100:00100000:1.0:1788361665.367754:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803520 00000100:00100000:0.0:1788361665.367773:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429803776:0@lo:38:kworker.0 00000100:00100000:1.0:1788361665.367781:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1788361665.367787:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429803520:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361665.367803:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361665.367806:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361665.367839:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429804032:0@lo:38:kworker.0 00000100:00100000:1.0:1788361665.367854:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429803520:12345-0@lo:38:kworker.0 Request processed in 66us (1628us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361665.367871:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1788361665.367871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361665.367883:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803776 00000100:00100000:1.0:1788361665.367887:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803776 00000100:00100000:0.0:1788361665.367889:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429804416:0@lo:38:kworker.0 00000100:00100000:1.0:1788361665.367910:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1788361665.367913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361665.367914:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429803776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361665.367932:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788361665.367943:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361665.367948:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361665.367951:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429803520:0@lo:38:kworker.0 00000100:00100000:1.0:1788361665.367957:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429803776:12345-0@lo:38:kworker.0 Request processed in 41us (149us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361665.367963:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1788361665.367973:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804416 00000100:00100000:1.0:1788361665.367976:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804416 00000100:00100000:1.0:1788361665.367996:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1788361665.368000:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429804416:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361665.368009:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361665.368035:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429804416:12345-0@lo:38:kworker.0 Request processed in 34us (121us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361665.368041:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00080000:0.0:1788361665.368054:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361665.368059:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361665.368062:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429803776:0@lo:38:kworker.0 00000100:00080000:0.0:1788361665.368070:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361665.368074:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361665.368077:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429804416:0@lo:38:kworker.0 00000100:00100000:1.0:1788361665.368086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361665.368098:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803904 00000100:00100000:0.0:1788361665.368101:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803904 00000100:00080000:1.0:1788361665.368134:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361665.368154:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1788361665.368162:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429803904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361665.368219:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429803904:12345-0@lo:400:kworker.0 Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361665.368226:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1788361665.368335:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429803904:0@lo:400:kworker.0 00000100:00100000:1.0:1788361665.368368:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804032 00000100:00100000:1.0:1788361665.368372:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804032 00000100:00100000:1.0:1788361665.368402:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00100000:1.0:1788361665.368407:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429804032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361665.368428:0:8449:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361665.368478:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429804032:12345-0@lo:38:kworker.0 Request processed in 69us (605us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361665.368485:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00100000:1.0:1788361665.368504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361665.368533:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429804288:0@lo:400:kworker.0 00000100:00100000:1.0:1788361665.368551:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429803648 00000100:00100000:1.0:1788361665.368555:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429803648 00000100:00100000:1.0:1788361665.368609:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1788361665.368617:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429803648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361665.368653:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429803648:12345-0@lo:400:kworker.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361665.368659:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:1.0:1788361665.368674:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361665.368689:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429803648:0@lo:400:kworker.0 00000100:00080000:0.0:1788361665.371289:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361665.371299:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361665.371303:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429804032:0@lo:38:kworker.0 00010000:00010000:2.0:1788361665.622075:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788361665.866247:0:90853:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788361665.866253:0:90853:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788361665.866255:0:90853:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788361665.866380:0:90853:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d005033800 00000020:01000004:2.0:1788361665.866395:0:90853:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788361665.866410:0:90853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788361665.866422:0:90853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d003a0cd40) 00000020:00000080:2.0:1788361665.866441:0:90853:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788361665.933468:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788361665.935031:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.936127:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.936320:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.936499:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.936756:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.936938:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.937117:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.937296:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.937665:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.937882:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.938093:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.938272:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.938456:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.938664:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.938866:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.939058:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.939240:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.939474:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.939706:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.939962:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.940130:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.940310:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.940477:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.940659:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.940856:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.941026:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.941253:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.941484:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.941751:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.941983:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.942164:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788361665.942357:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788361665.942507:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788361665.943558:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.946760:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788361665.947103:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788361665.947323:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788361665.947526:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788361665.947768:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.947976:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788361665.948154:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.948327:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.948522:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.948759:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.948956:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788361665.949127:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.950332:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.950659:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.950871:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.951243:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.951465:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788361665.951648:0:90853:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788361665.952578:0:90853:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788361665.952850:0:90853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788361665.952858:0:90853:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788361665.952871:0:90853:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe31bb 00000020:01000004:3.0:1788361665.952877:0:90853:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788361665.952889:0:90853:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788361665.952894:0:90853:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d005033800 from MGS 00000020:01000004:3.0:1788361665.952897:0:90853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788361665.952907:0:90853:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d001c619c0) 00000020:00000080:3.0:1788361665.952919:0:90853:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788361665.952984:0:90853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d005033800 from MGS, refs=2 00080000:01000000:3.0:1788361665.952989:0:90853:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788361665.952994:0:90853:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe31c9 00010000:00010000:3.0:1788361665.953135:0:90853:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788361665.956589:0:90853:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788361665.957456:0:90858:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788361665.957499:0:90853:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788361665.957555:0:90853:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361665.958200:0:90853:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788361665.958451:0:90853:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361665.958620:0:90853:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788361665.958627:0:90853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788361665.962604:0:90853:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788361665.962619:0:90853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788361665.963914:0:90853:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788361665.963925:0:90853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361665.964932:0:90853:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361665.964959:0:90853:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788361665.964961:0:90853:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788361665.964965:0:90853:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1788361665.964972:0:90853:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788361665.964979:0:90853:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788361665.964988:0:90853:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788361665.964990:0:90853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788361665.964998:0:90853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d136ed7480 x1875230429798656/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361665.965069:0:90853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d13651d180 x1875230429800576/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361665.965084:0:90853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d136ed4700 x1875230429801984/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361665.965098:0:90853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d136b58000 x1875230429803392/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361681 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788361665.965108:0:90853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788361665.965110:0:90853:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788361665.965112:0:90853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788361665.965115:0:90853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1788361665.965141:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429801984:0@lo:400:kworker.0 00000100:00100000:1.0:1788361665.965239:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429800576:0@lo:400:kworker.0 00000100:00100000:1.0:1788361665.965279:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429803392:0@lo:400:kworker.0 00000100:00100000:0.0:1788361665.965357:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429798656:0@lo:400:kworker.0 10000000:01000000:3.0:1788361665.965418:0:90853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788361665.965438:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965449:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965455:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788361665.965473:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965485:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785fc00/0x1b69fa8920fe2d8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965500:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965517:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965523:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965527:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965531:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1231bf400/0x1b69fa8920fe2cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2cf9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965650:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965657:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965662:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965673:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965677:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe2d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965685:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965692:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965696:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965700:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965705:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d14166b000/0x1b69fa8920fe2d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965725:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965731:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965736:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965741:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965746:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d14166a800/0x1b69fa8920fe2d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d4d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965754:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965761:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965766:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965770:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965773:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785f400/0x1b69fa8920fe2d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965783:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965788:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965933:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965955:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965960:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785f200/0x1b69fa8920fe2d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d77 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.965972:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.965978:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.965984:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.965987:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.965990:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d14166b200/0x1b69fa8920fe2d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2da1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.966002:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.966009:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.966014:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.966017:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.966022:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe2d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.966035:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.966042:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.966057:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361665.966062:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.966067:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1231bee00/0x1b69fa8920fe2d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.966080:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.966087:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.966092:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361665.966096:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.966101:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d14166b800/0x1b69fa8920fe2d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.966110:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.966117:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.966121:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361665.966126:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.966129:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1231be200/0x1b69fa8920fe2d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.966139:0:90853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361665.966156:0:90853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361665.966162:0:90853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361665.966165:0:90853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361665.966169:0:90853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785e000/0x1b69fa8920fe2d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe2d85 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361665.966188:0:90853:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99d1054f2000 already not connected (conn 50, was 0): DISCONN 00000100:00080000:3.0:1788361665.966195:0:90853:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361665.966200:0:90853:0:(import.c:510:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 2669 00000100:00080000:3.0:1788361665.966208:0:90853:0:(import.c:624:import_select_connection()) MGC192.168.204.135@tcp: import ffff99d1054f2000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361665.966235:0:90853:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5bb80 x1875230429804544/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361665.966256:0:90853:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788361665.966324:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429804544:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788361665.966397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361665.966502:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804544 00000100:00100000:3.0:1788361665.966510:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804544 00000100:00100000:3.0:1788361665.966651:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361665.966659:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875230429804544:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788361665.966686:0:90859:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo t0 exp 0000000000000000 cur 2705 last 0 00000020:00000080:3.0:1788361665.966713:0:90859:0:(genops.c:1406:class_connect()) connect: client c8a6f36d-efb9-41cf-af98-5917323f2b0d, cookie 0x1b69fa8920fe31d0 00000100:00080000:3.0:1788361665.966916:0:90859:0:(import.c:65:import_set_state_nolock()) ffff99d00541c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361665.966979:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:3649:x1875230429804544:12345-0@lo:250:mount.lustre.0 Request processed in 319us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.966987:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361665.967015:0:3649:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 27 00000100:00080000:2.0:1788361665.967024:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361665.967029:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361665.967032:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361665.967035:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361665.967036:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361665.967048:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361665.967053:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429804544:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1788361665.967081:0:48377:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.135@tcp 10000000:01000000:2.0:1788361665.967100:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788361665.967103:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788361665.967105:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361665.967106:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.967108:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.967109:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.967111:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.967112:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361665.967114:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.967116:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788361665.967155:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788361665.967160:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:2.0:1788361665.967164:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788361665.967167:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788361665.967168:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788361665.967169:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:0.0:1788361665.967171:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429804672:0@lo:253:kworker.0 00000020:01000004:2.0:1788361665.967172:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.967175:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.967177:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.967180:0:48377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361665.967181:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.967182:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788361665.967207:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788361665.967212:0:48377:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788361665.967216:0:48377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00100000:0.0:1788361665.967217:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788361665.967218:0:48377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788361665.967222:0:48377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.967223:0:48377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.967224:0:48377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.967225:0:48377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.967226:0:48377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361665.967227:0:48377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.967228:0:48377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788361665.967242:0:48377:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788361665.967268:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429804800:0@lo:253:kworker.0 00000100:00100000:2.0:1788361665.967295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.967663:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361665.967670:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429804928:0@lo:253:kworker.0 00000100:00100000:0.0:1788361665.967676:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804672 00000100:00100000:0.0:1788361665.967682:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804672 00000100:00100000:0.0:1788361665.967713:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804800 00000100:00100000:0.0:1788361665.967717:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804800 00000100:00100000:2.0:1788361665.967719:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361665.967732:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429804928 00000100:00100000:0.0:1788361665.967736:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429804928 00000100:00100000:0.0:1788361665.967752:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788361665.967759:0:90853:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000100:00100000:0.0:1788361665.967764:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3652:x1875230429804672:12345-0@lo:253:kworker.0 00000020:01000004:2.0:1788361665.967775:0:90853:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 20000000:01000000:0.0:1788361665.967789:0:90862:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:2.0:1788361665.967843:0:90853:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788361665.967848:0:90853:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788361665.967956:0:90853:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788361665.967982:0:90853:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788361665.967986:0:90853:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788361665.967989:0:90853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361665.967990:0:90853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.967991:0:90853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.967992:0:90853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.967993:0:90853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.967995:0:90853:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361665.967997:0:90853:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361665.967998:0:90853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.968000:0:90853:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788361665.968003:0:90853:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 10000000:01000000:0.0:1788361665.968003:0:90863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:2.0:1788361665.968007:0:90853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361665.968009:0:90853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361665.968010:0:90853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.968011:0:90853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.968012:0:90853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.968013:0:90853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.968014:0:90853:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361665.968015:0:90853:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361665.968016:0:90853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.968016:0:90853:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788361665.968030:0:90853:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788361665.968040:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805056:0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361665.968074:0:90862:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 115 00000100:00100000:2.0:1788361665.968085:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.968097:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361665.968878:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805056 00000100:00100000:1.0:1788361665.968890:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805056 00000100:00100000:3.0:1788361665.968894:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361665.968915:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3650:x1875230429804800:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788361665.968938:0:90859:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361665.969597:0:90864:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788361665.969602:0:90864:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788361665.969605:0:90864:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788361665.969609:0:90864:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788361665.969778:0:90864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788361665.970046:0:90862:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361665.970065:0:90862:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361665.971516:0:90862:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361665.971619:0:90862:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788361665.971634:0:90859:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788361665.971920:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3652:x1875230429804672:12345-0@lo:253:kworker.0 Request processed in 4158us (4702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361665.971930:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361665.971966:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361665.971977:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3650:x1875230429804928:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788361665.972000:0:90862:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788361665.972048:0:90863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361665.972053:0:90863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361665.972074:0:90863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972090:0:90863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361665.972100:0:90863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048468s 00010000:00010000:1.0:1788361665.972105:0:90863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972112:0:90863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972119:0:90863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972127:0:90863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972133:0:90863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166ac00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361665.972137:0:90863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972145:0:90863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972158:0:90863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972165:0:90863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.972184:0:90863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166ac00/0x1b69fa8920fe31d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788361665.972241:0:3652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788361665.972244:0:3652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361665.972246:0:3652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.972247:0:3652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.972248:0:3652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.972250:0:3652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.972251:0:3652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361665.972253:0:3652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.972255:0:3652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788361665.972259:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429804672:0@lo:253:kworker.0 20000000:01000000:3.0:1788361665.973762:0:90859:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361665.973777:0:90859:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788361665.973810:0:90862:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361665.973987:0:90863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361665.973991:0:90863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361665.974009:0:90863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.974023:0:90863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361665.974031:0:90863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048468s 00010000:00010000:1.0:1788361665.974036:0:90863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.974044:0:90863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.974052:0:90863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.974059:0:90863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.974061:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3650:x1875230429804800:12345-0@lo:253:kworker.0 Request processed in 5140us (6753us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361665.974073:0:90863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166ae00 already unused, calling callback (ffffffffc0c1d300) 00000100:00100000:3.0:1788361665.974077:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788361665.974078:0:90863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.974089:0:90863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.974114:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788361665.974119:0:90863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.974126:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:90853:x1875230429805056:12345-0@lo:253:mount.lustre.0 00010000:00010000:1.0:1788361665.974131:0:90863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.974139:0:90863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe31de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361665.974170:0:90859:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361665.974174:0:90859:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788361665.974177:0:90859:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788361665.974183:0:90859:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:2.0:1788361665.974265:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788361665.974268:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788361665.974270:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.974271:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.974272:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.974273:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.974275:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361665.974276:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.974277:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788361665.974281:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429804800:0@lo:253:kworker.0 00000100:00100000:3.0:1788361665.976274:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:90853:x1875230429805056:12345-0@lo:253:mount.lustre.0 Request processed in 2146us (8182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.976285:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361665.976388:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361665.976402:0:90853:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788361665.976405:0:90853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361665.976406:0:90853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361665.976408:0:90853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.976409:0:90853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.976410:0:90853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.976411:0:90853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.976412:0:90853:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361665.976414:0:90853:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361665.976415:0:90853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.976416:0:90853:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788361665.976437:0:90853:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d005033800 from lustre-MDT0000 10000000:01000000:2.0:1788361665.976477:0:90853:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788361665.976480:0:90853:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788361665.976501:0:90853:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d005033800 10000000:01000000:2.0:1788361665.976505:0:90853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788361665.976510:0:90853:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99d005033800 10000000:01000000:2.0:1788361665.976513:0:90853:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788361665.976517:0:90853:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d005033800 from 1 10000000:01000000:2.0:1788361665.976520:0:90853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788361665.976619:0:90853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.976631:0:90853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.976641:0:90853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361665.976660:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361665.976693:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.976730:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361665.976774:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805184 00000100:00100000:1.0:1788361665.976781:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805184 00000100:00100000:1.0:1788361665.976818:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361665.976849:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:90853:x1875230429805184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361665.976859:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361665.976871:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166a000/0x1b69fa8920fe31ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe31e5 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.976889:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166a000/0x1b69fa8920fe31ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe31e5 expref: 7 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.976898:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166a000/0x1b69fa8920fe31ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe31e5 expref: 7 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.976907:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166a000, rc 0) 00000100:00100000:1.0:1788361665.976938:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:90853:x1875230429805184:12345-0@lo:101:mount.lustre.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361665.976944:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361665.977048:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361665.977060:0:90853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.977068:0:90853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361665.977081:0:90853:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788361665.977098:0:90853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.977105:0:90853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361665.977117:0:90853:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788361665.977120:0:90853:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361665.977124:0:90853:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d005033800 10000000:01000000:2.0:1788361665.977126:0:90853:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788361665.977129:0:90853:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788361665.977131:0:90853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361665.977145:0:90853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.977152:0:90853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.977159:0:90853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361665.977171:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361665.977199:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.977284:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e3c0 going to sleep for 11 seconds 20000000:01000000:0.0:1788361665.977345:0:90862:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361665.977360:0:90862:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788361665.977520:0:90863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361665.977540:0:90863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361665.977552:0:90863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.977561:0:90863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361665.977578:0:90863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048468s 00010000:00010000:1.0:1788361665.977582:0:90863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.977589:0:90863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.977596:0:90863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.977602:0:90863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.977613:0:90863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361665.977617:0:90863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.977621:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805312 00010000:00010000:1.0:1788361665.977624:0:90863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.977625:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805312 00010000:00010000:1.0:1788361665.977634:0:90863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361665.977642:0:90863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.977656:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788361665.977658:0:90863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe31fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361665.977662:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:90853:x1875230429805312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361665.977670:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361665.977794:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1371ffa00/0x1b69fa8920fe3201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe31f3 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.977810:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1371ffa00/0x1b69fa8920fe3201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe31f3 expref: 8 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.977818:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1371ffa00/0x1b69fa8920fe3201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe31f3 expref: 8 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361665.977849:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ffa00, rc 0) 00000100:00100000:3.0:1788361665.977879:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90853:x1875230429805312:12345-0@lo:101:mount.lustre.0 Request processed in 217us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.977885:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361665.977941:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3650:x1875230429804928:12345-0@lo:253:kworker.0 Request processed in 5967us (10223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361665.977957:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788361665.978005:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788361665.978007:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788361665.978008:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361665.978008:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361665.978010:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361665.978010:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361665.978011:0:3650:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361665.978012:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361665.978013:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788361665.978015:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429804928:0@lo:253:kworker.0 00000100:00100000:2.0:1788361665.978035:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361665.978043:0:90853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361665.978057:0:90853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361665.978106:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361665.978129:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.978156:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361665.978203:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805440 00000100:00100000:3.0:1788361665.978207:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805440 00000100:00100000:3.0:1788361665.978264:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361665.978269:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d121185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:90853:x1875230429805440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361665.978366:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d121185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90853:x1875230429805440:12345-0@lo:501:mount.lustre.0 Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.978370:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361665.978409:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361665.978429:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361665.978458:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.978550:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361665.978595:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805568 00000100:00100000:1.0:1788361665.978599:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805568 00000100:00100000:1.0:1788361665.978618:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361665.978624:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d121187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90853:x1875230429805568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361665.979297:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d121187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90853:x1875230429805568:12345-0@lo:503:mount.lustre.0 Request processed in 670us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361665.979305:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361665.979314:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429805568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361665.979929:0:90865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90865:1875230429805696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361665.979968:0:90865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361665.980042:0:90865:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361665.980075:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805696 00000100:00100000:3.0:1788361665.980080:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805696 00000100:00100000:3.0:1788361665.980152:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361665.980160:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d121186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90865:x1875230429805696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361665.980856:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d121186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90865:x1875230429805696:12345-0@lo:502:llog_process_th.0 Request processed in 695us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361665.980864:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361665.980961:0:90865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90865:1875230429805696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361665.980986:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361665.980996:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361665.980999:0:90865:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361665.981004:0:90865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788361665.981007:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361665.981021:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d003a0b380) 00000020:00000080:2.0:1788361665.981043:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788361665.981047:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788361665.981121:0:90865:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788361665.981127:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe320f 00000020:00000080:2.0:1788361665.981368:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788361665.981372:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361665.981375:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361665.981376:0:90865:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361665.981379:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361665.981382:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361665.981383:0:90865:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788361665.981386:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361665.981393:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d003a099c0) 00000020:00000080:2.0:1788361665.981404:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788361665.981409:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788361665.981410:0:90865:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788361665.981413:0:90865:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788361665.981419:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361665.981460:0:90865:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d005033800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788361665.981470:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d003a08000) 00000020:00000080:2.0:1788361665.981479:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788361665.981526:0:90865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788361665.981531:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe3224 00000020:00000080:2.0:1788361665.981695:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788361665.981703:0:90865:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788361665.981707:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b69fa8920fe322b 00080000:01000000:2.0:1788361665.981712:0:90865:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788361665.981714:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe3232 00010000:00010000:2.0:1788361666.032459:0:90865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788361666.032684:0:90865:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: ec302d84-8f96-49d3-8682-aefc474f8448 idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:2.0:1788361666.032728:0:90865:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:2.0:1788361666.032751:0:90865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:2.0:1788361666.032994:0:90865:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788361666.033066:0:90865:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d11f2df300: xid 1875230406995840, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:2.0:1788361666.033075:0:90865:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d11f2df540: xid 1875230406995584, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:2.0:1788361666.033473:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d0042e4d40) 00000020:00000080:2.0:1788361666.033490:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788361666.033557:0:90865:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788361666.033573:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe324e 00000020:00000080:2.0:1788361666.034105:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361666.040542:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b69fa8920fe3255 00000020:00000080:0.0:1788361666.041638:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788361666.041651:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361666.041657:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361666.041659:0:90865:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788361666.041663:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361666.041666:0:90865:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788361666.041667:0:90865:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361666.041668:0:90865:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361666.041670:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361666.041672:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361666.041673:0:90865:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361666.041676:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361666.041681:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361666.041683:0:90865:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788361666.041687:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788361666.041738:0:90865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788361666.041760:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361666.041764:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361666.041765:0:90865:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788361666.041769:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361666.041777:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361666.041779:0:90865:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788361666.041782:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361666.041787:0:90865:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:0.0:1788361666.041812:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361666.041842:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d10531b380) 00000020:00000080:0.0:1788361666.041863:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788361666.041870:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788361666.041927:0:90865:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788361666.041933:0:90865:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788361666.041947:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe3263 00010000:00080000:0.0:1788361666.041985:0:90865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d116c01800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788361666.043457:0:90865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788361666.045219:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361666.045235:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788361666.045277:0:90865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788361666.045304:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe326a 00000100:00080000:3.0:1788361666.045315:0:90865:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361666.045321:0:90865:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99d116c01800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361666.045360:0:90865:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5bb80 x1875230429805824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361666.045397:0:90865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788361666.045483:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429805824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361666.045561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788361666.045705:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361666.045710:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.045712:0:90865:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788361666.045715:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361666.045718:0:90865:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788361666.045720:0:90865:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361666.045722:0:90865:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361666.045723:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361666.045726:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.045728:0:90865:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361666.045730:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361666.045735:0:90865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788361666.045739:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.045740:0:90865:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788361666.045743:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361666.045747:0:90865:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1788361666.045767:0:90865:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788361666.045770:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361666.045783:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d001c60000) 00000020:00000080:3.0:1788361666.045799:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788361666.045804:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361666.045888:0:90865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788361666.045895:0:90865:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788361666.045900:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe3278 00010000:00080000:3.0:1788361666.045928:0:90865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d141657800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361666.046114:0:90865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788361666.046474:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805824 00000100:00100000:1.0:1788361666.046482:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805824 00000100:00100000:1.0:1788361666.046509:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00100000:1.0:1788361666.046516:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429805824:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788361666.046538:0:23939:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2706 last 0 00000020:00000080:1.0:1788361666.046579:0:23939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe327f 00000004:00100000:1.0:1788361666.046591:0:23939:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788361666.046679:0:23939:0:(import.c:65:import_set_state_nolock()) ffff99d11e630800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361666.046742:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429805824:12345-0@lo:38:llog_process_th.0 Request processed in 225us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.046750:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00000100:00100000:1.0:1788361666.046790:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361666.046797:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788361666.046804:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788361666.046808:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788361666.046817:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c01800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788361666.046843:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429805824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361666.046950:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429805952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361666.046980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.047056:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429805952 00000100:00100000:1.0:1788361666.047061:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429805952 00000100:00100000:1.0:1788361666.047122:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00100000:1.0:1788361666.047129:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429805952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788361666.047150:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361666.047181:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429805952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.047187:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000040:01000000:3.0:1788361666.047293:0:90865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361666.047319:0:90865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1788361666.047463:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361666.047467:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361666.047470:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361666.047475:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2705 00000100:00080000:0.0:1788361666.047478:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788361666.047483:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361666.047498:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1012adf80 x1875230429806208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361666.047525:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361666.047528:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361666.047530:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361666.047533:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2705 00000100:00080000:0.0:1788361666.047536:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788361666.047539:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361666.047562:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1012ac000 x1875230429806464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361666.047587:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361666.047591:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361666.047593:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361666.047596:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2705 00000100:00080000:0.0:1788361666.047599:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788361666.047602:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361666.047621:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1012ace00 x1875230429806720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361666.047643:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361666.047646:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361666.047648:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361666.047651:0:48377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2705 00000100:00080000:0.0:1788361666.047653:0:48377:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788361666.047657:0:48377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361666.047667:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1012ad180 x1875230429807104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361666.047696:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429806336:0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.047727:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361666.047753:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361666.047758:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429806592:0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.047777:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361666.047811:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806336 00000100:00100000:0.0:1788361666.047815:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806336 00000100:00100000:0.0:1788361666.047862:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806592 00000100:00100000:0.0:1788361666.047865:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806592 00000100:00100000:0.0:1788361666.047883:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1788361666.047890:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429806336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.047926:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429806336:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.047933:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1788361666.047946:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1788361666.047952:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429806592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.047988:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429806592:12345-0@lo:400:kworker.0 Request processed in 36us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.047994:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1788361666.048033:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429806592:0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.048042:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429806336:0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.048063:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429806208:0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.048085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361666.048103:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429806464:0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.048121:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361666.048135:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429806720:0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.048154:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.048224:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429806080:0@lo:400:kworker.0 00000100:00100000:3.0:1788361666.048266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.048295:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429806976:0@lo:400:kworker.0 00000100:00100000:3.0:1788361666.048319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.048337:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361666.048342:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429806848:0@lo:400:kworker.0 00000100:00100000:3.0:1788361666.048361:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.048387:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806976 00000100:00100000:3.0:1788361666.048390:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806976 00000100:00100000:3.0:1788361666.048424:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806848 00000100:00100000:3.0:1788361666.048427:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806848 00000100:00100000:3.0:1788361666.048447:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:3.0:1788361666.048453:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429806976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361666.048486:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429806976:12345-0@lo:400:kworker.0 Request processed in 34us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361666.048493:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:3.0:1788361666.048506:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:3.0:1788361666.048512:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429806848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361666.048537:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429806848:12345-0@lo:400:kworker.0 Request processed in 25us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361666.048543:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:3.0:1788361666.048585:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429806848:0@lo:400:kworker.0 00000100:00100000:3.0:1788361666.048596:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429806976:0@lo:400:kworker.0 00000040:00080000:3.0:1788361666.048685:0:90865:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000100:00100000:2.0:1788361666.049313:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806720 00000100:00100000:2.0:1788361666.049319:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806720 00000100:00100000:0.0:1788361666.049333:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429807104:0@lo:38:kworker.0 00000100:00100000:2.0:1788361666.049348:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00100000:2.0:1788361666.049353:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429806720:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.049362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361666.049393:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806208 00000100:00100000:0.0:1788361666.049397:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806208 00000100:00100000:2.0:1788361666.049400:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429806720:12345-0@lo:38:kworker.0 Request processed in 46us (1245us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788361666.049407:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00000100:00100000:0.0:1788361666.049412:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806464 00000100:00100000:0.0:1788361666.049413:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806464 00000100:00100000:0.0:1788361666.049423:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807104 00000100:00100000:0.0:1788361666.049425:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807104 00000100:00100000:0.0:1788361666.049438:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1788361666.049442:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429806208:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361666.049457:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1788361666.049462:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429806464:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.049475:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429806208:12345-0@lo:38:kworker.0 Request processed in 32us (1388us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361666.049481:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1788361666.049487:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429806464:12345-0@lo:38:kworker.0 Request processed in 25us (1366us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361666.049491:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1788361666.049494:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1788361666.049495:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429807104:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.049528:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429807104:12345-0@lo:38:kworker.0 Request processed in 32us (165us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361666.049534:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00080000:0.0:1788361666.049588:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361666.049593:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361666.049596:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429806208:0@lo:38:kworker.0 00000100:00080000:0.0:1788361666.049606:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361666.049610:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361666.049613:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429806464:0@lo:38:kworker.0 00000100:00080000:0.0:1788361666.049622:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361666.049625:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361666.049627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429806720:0@lo:38:kworker.0 00000100:00080000:0.0:1788361666.049635:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361666.049638:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361666.049640:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429807104:0@lo:38:kworker.0 00000100:00100000:0.0:1788361666.049683:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429806080 00000100:00100000:0.0:1788361666.049686:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429806080 00000100:00100000:0.0:1788361666.049719:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361666.049726:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ae90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3653:x1875230429806080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.049762:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ae90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3653:x1875230429806080:12345-0@lo:400:kworker.0 Request processed in 37us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.049769:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361666.049802:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429806080:0@lo:400:kworker.0 00000100:00100000:0.0:1788361666.049866:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429805952:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788361666.049884:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361666.049888:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788361666.050137:0:90865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361666.050222:0:90865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:2.0:1788361666.053741:0:90865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:1.0:1788361666.054238:0:90871:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:1.0:1788361666.054243:0:90871:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788361666.054413:0:90871:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1788361666.054432:0:90871:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788361666.054559:0:90871:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1788361666.054562:0:90871:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788361666.055320:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361666.055331:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361666.055372:0:90865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788361666.055402:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe3286 00000100:00080000:3.0:1788361666.055413:0:90865:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361666.055418:0:90865:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d141657800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361666.055451:0:90865:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b59f80 x1875230429807232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361666.055513:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429807232:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361666.055613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.055661:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807232 00000100:00100000:1.0:1788361666.055669:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807232 00000100:00080000:3.0:1788361666.055676:0:90865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788361666.055700:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902 00000100:00100000:1.0:1788361666.055707:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1875230429807232:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788361666.055732:0:8437:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2706 last 0 00000020:00000080:1.0:1788361666.055755:0:8437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe328d 00002000:00100000:1.0:1788361666.055767:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d11e633000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788361666.055771:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788361666.055774:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1788361666.055843:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361666.055847:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.055849:0:90865:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00002000:00080000:1.0:1788361666.055849:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:01000000:3.0:1788361666.055852:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361666.055855:0:90865:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788361666.055856:0:90865:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361666.055857:0:90865:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361666.055859:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361666.055862:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.055863:0:90865:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361666.055865:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361666.055868:0:90865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788361666.055871:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.055872:0:90865:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000100:00080000:1.0:1788361666.055874:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99d11e632000 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1788361666.055875:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361666.055878:0:90865:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1788361666.055896:0:90865:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788361666.055898:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361666.055908:0:90865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99d137c04d40) 00000020:00000080:3.0:1788361666.056000:0:90865:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788361666.056007:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361666.056068:0:90865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788361666.056073:0:90865:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788361666.056078:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe329b 00010000:00080000:3.0:1788361666.056103:0:90865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d137ea5000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361666.056342:0:90865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788361666.056411:0:90865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361666.056424:0:90865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788361666.056801:0:90865:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000100:00100000:1.0:1788361666.057356:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429807232:12345-0@lo:8:llog_process_th.0 Request processed in 1635us (1729us total) trans 0 rc 0/0 00000040:00080000:3.0:1788361666.057357:0:90865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361666.057366:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902 00000040:00080000:3.0:1788361666.057384:0:90865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000100:00100000:0.0:1788361666.057492:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361666.057504:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788361666.057511:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361666.057516:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000040:00080000:3.0:1788361666.057518:0:90865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000100:00080000:0.0:1788361666.057519:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788361666.057723:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361666.057730:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429807232:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788361666.057756:0:90871:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788361666.057772:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429807360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361666.057815:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.057860:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807360 00000100:00100000:2.0:1788361666.057867:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807360 00000004:00080000:0.0:1788361666.057904:0:90871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2706067080767ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788361666.057910:0:90871:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788361666.057917:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1788361666.057925:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429807360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361666.057945:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361666.057985:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429807360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.057992:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00080000:3.0:1788361666.058045:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361666.058181:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429807360:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361666.058516:0:90873:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:0.0:1788361666.058521:0:90873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788361666.058801:0:90873:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:0.0:1788361666.058837:0:90873:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788361666.058962:0:90873:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:0.0:1788361666.058965:0:90873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788361666.059722:0:90865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361666.059733:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361666.059774:0:90865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788361666.059798:0:90865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe32a2 00000100:00080000:3.0:1788361666.059805:0:90865:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361666.059811:0:90865:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d137ea5000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361666.059863:0:90865:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b59180 x1875230429807488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361666.059882:0:90865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788361666.059947:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361666.059951:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.059953:0:90865:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788361666.059956:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361666.059960:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.059961:0:90865:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361666.059965:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788361666.059966:0:90865:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361666.059968:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361666.059970:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.059971:0:90865:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361666.059974:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361666.059976:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.059977:0:90865:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361666.059989:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788361666.060016:0:90865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90865:1875230429807616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361666.060083:0:90865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.060118:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807616 00000100:00100000:3.0:1788361666.060123:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807616 00000100:00100000:3.0:1788361666.060154:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361666.060162:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90865:x1875230429807616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361666.060251:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90865:x1875230429807616:12345-0@lo:502:llog_process_th.0 Request processed in 90us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361666.060259:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361666.060304:0:90865:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361666.060322:0:90865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90865:1875230429807616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361666.060345:0:90865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361666.060349:0:90865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361666.060351:0:90865:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788361666.060354:0:90865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1788361666.060370:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429807488:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361666.060405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788361666.060437:0:90853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788361666.060455:0:90853:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361666.060470:0:90853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.060486:0:90853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361666.060494:0:90853:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d005033800 from 1 10000000:01000000:0.0:1788361666.060497:0:90853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361666.060520:0:90853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.060529:0:90853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.060538:0:90853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361666.060553:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429807744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361666.060593:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.060604:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807488 00000100:00100000:1.0:1788361666.060609:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807488 00000100:00100000:0.0:1788361666.060615:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.060635:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807744 00000100:00100000:0.0:1788361666.060639:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807744 00000100:00100000:1.0:1788361666.060640:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4903 00000100:00100000:1.0:1788361666.060648:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3649:x1875230429807488:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788361666.060683:0:26172:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2706 last 0 00000020:00000080:1.0:1788361666.060710:0:26172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe32b0 00000004:00080000:2.0:1788361666.060720:0:90855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00100000:1.0:1788361666.060782:0:26172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d11e634800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788361666.060788:0:26172:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788361666.060791:0:26172:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788361666.060875:0:26172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361666.060897:0:26172:0:(import.c:65:import_set_state_nolock()) ffff99d11e636800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361666.060948:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361666.060950:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429807488:12345-0@lo:8:llog_process_th.0 Request processed in 300us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.060959:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:90853:x1875230429807744:12345-0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361666.060964:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4903 00000100:00100000:2.0:1788361666.060968:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:0.0:1788361666.060973:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788361666.060975:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788361666.060981:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788361666.060985:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788361666.060988:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1788361666.060991:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe32a9 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361666.061002:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788361666.061008:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429807488:0@lo:8:llog_process_th.0 00010000:00010000:0.0:1788361666.061011:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 9 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.061037:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 9 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.061049:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308000, rc 0) 00000100:00100000:0.0:1788361666.061093:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:90853:x1875230429807744:12345-0@lo:101:mount.lustre.0 Request processed in 137us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.061100:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361666.061115:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429807744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361666.061131:0:90853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.061140:0:90853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361666.061143:0:90873:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788361666.061188:0:90873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2706070365202ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788361666.061196:0:90873:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788361666.061262:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429807872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361666.061293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.061326:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429807872 00000100:00100000:1.0:1788361666.061330:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429807872 00000100:00100000:1.0:1788361666.061369:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1788361666.061379:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429807872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361666.061396:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361666.061437:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429807872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.061453:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00080000:1.0:1788361666.061482:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361666.061607:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429807872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361666.061674:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808000:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788361666.061711:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.061741:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.061861:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808000 00000100:00100000:0.0:1788361666.061865:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808000 00000100:00100000:0.0:1788361666.061903:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361666.061910:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:90853:x1875230429808000:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788361666.061924:0:90862:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788361666.062085:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361666.062090:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361666.062093:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361666.062095:0:90862:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 118 00000100:00100000:0.0:1788361666.062183:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:90853:x1875230429808000:12345-0@lo:256:mount.lustre.0 Request processed in 273us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.062191:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361666.062259:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808000:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788361666.062814:0:90853:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788361666.062864:0:90853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.062874:0:90853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361666.062882:0:90853:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d005033800 from 1 10000000:01000000:2.0:1788361666.062885:0:90853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361666.062906:0:90853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.062913:0:90853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.062921:0:90853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361666.062935:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361666.062962:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.062988:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.063649:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808128 00000100:00100000:0.0:1788361666.063655:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808128 00000100:00100000:0.0:1788361666.063695:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361666.063703:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:90853:x1875230429808128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361666.063723:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361666.063736:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309200/0x1b69fa8920fe32c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe32be expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.063755:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309200/0x1b69fa8920fe32c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe32be expref: 10 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.063765:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309200/0x1b69fa8920fe32c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe32be expref: 10 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361666.063773:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309200, rc 0) 00000100:00100000:0.0:1788361666.063818:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90853:x1875230429808128:12345-0@lo:101:mount.lustre.0 Request processed in 115us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.063853:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361666.063932:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361666.063947:0:90853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.063955:0:90853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361666.064006:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361666.064031:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.064273:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a000 going to sleep for 11 seconds 00000004:00080000:3.0:1788361666.064370:0:90855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788361666.064418:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808256 00000100:00100000:0.0:1788361666.064423:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808256 00000100:00100000:0.0:1788361666.064450:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361666.064457:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90853:x1875230429808256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361666.064704:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90853:x1875230429808256:12345-0@lo:501:mount.lustre.0 Request processed in 246us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.064711:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361666.064766:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361666.064793:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361666.064927:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.064985:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00655a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.065021:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808384 00000100:00100000:0.0:1788361666.065025:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808384 00000100:00100000:0.0:1788361666.065047:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361666.065053:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90853:x1875230429808384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361666.065168:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90853:x1875230429808384:12345-0@lo:503:mount.lustre.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.065183:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361666.065243:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361666.065612:0:90875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90875:1875230429808512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361666.065646:0:90875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.065702:0:90875:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.065731:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808512 00000100:00100000:0.0:1788361666.065735:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808512 00000100:00100000:0.0:1788361666.065801:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361666.065809:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90875:x1875230429808512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361666.066239:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90875:x1875230429808512:12345-0@lo:502:llog_process_th.0 Request processed in 431us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.066247:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361666.066387:0:90875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90875:1875230429808512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361666.066409:0:90875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361666.066418:0:90875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361666.066421:0:90875:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788361666.066430:0:90875:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d005033800 00000020:00000080:1.0:1788361666.066433:0:90875:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361666.066440:0:90875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361666.066443:0:90875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361666.066444:0:90875:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788361666.066447:0:90875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361666.066449:0:90875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361666.066450:0:90875:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788361666.066453:0:90875:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d005033800 00000020:00000080:1.0:1788361666.066455:0:90875:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788361666.066590:0:90875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90875:1875230429808640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361666.066623:0:90875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.066655:0:90875:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.066709:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808640 00000100:00100000:2.0:1788361666.066714:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808640 00000100:00100000:2.0:1788361666.066738:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788361666.066744:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90875:x1875230429808640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361666.066844:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90875:x1875230429808640:12345-0@lo:502:llog_process_th.0 Request processed in 99us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.066851:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361666.066958:0:90875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90875:1875230429808640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361666.066973:0:90875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361666.066977:0:90875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361666.066979:0:90875:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788361666.066983:0:90875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788361666.067122:0:90853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788361666.067143:0:90853:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788361666.067162:0:90853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067173:0:90853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361666.067218:0:90853:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788361666.067221:0:90853:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d005033800 10000000:01000000:2.0:1788361666.067224:0:90853:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d005033800 10000000:01000000:2.0:1788361666.067227:0:90853:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361666.067232:0:90853:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d005033800 from 1 10000000:01000000:2.0:1788361666.067234:0:90853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361666.067261:0:90853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067269:0:90853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067277:0:90853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361666.067289:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361666.067312:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.067329:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.067340:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808768 00000100:00100000:2.0:1788361666.067343:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808768 00000100:00100000:2.0:1788361666.067364:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361666.067369:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:90853:x1875230429808768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361666.067376:0:90859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361666.067387:0:90859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe32d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe32cc expref: -99 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067403:0:90859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe32d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe32cc expref: 11 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067411:0:90859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe32d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe32cc expref: 11 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067419:0:90859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917a00, rc 0) 00000100:00100000:2.0:1788361666.067442:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429808768:12345-0@lo:101:mount.lustre.0 Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.067448:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361666.067484:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361666.067495:0:90853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.067503:0:90853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361666.067544:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361666.067578:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.067591:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.067602:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429808896 00000100:00100000:2.0:1788361666.067605:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429808896 00000100:00100000:2.0:1788361666.067626:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361666.067631:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429808896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361666.067722:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429808896:12345-0@lo:501:mount.lustre.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.067728:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361666.067757:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429808896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361666.067783:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429809024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361666.067815:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.067852:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.067863:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809024 00000100:00100000:2.0:1788361666.067867:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809024 00000100:00100000:2.0:1788361666.067886:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361666.067891:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429809024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361666.067956:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429809024:12345-0@lo:503:mount.lustre.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.067968:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361666.068005:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429809024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361666.068509:0:90876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90876:1875230429809152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361666.068544:0:90876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361666.068614:0:90876:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104d72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.068649:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809152 00000100:00100000:2.0:1788361666.068653:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809152 00000100:00100000:2.0:1788361666.068720:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361666.068729:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90876:x1875230429809152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361666.068816:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90876:x1875230429809152:12345-0@lo:502:llog_process_th.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.068847:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361666.068928:0:90876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90876:1875230429809152:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788361666.068986:0:90876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788361666.069002:0:90876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99d104014d40) 00000020:00000080:1.0:1788361666.069026:0:90876:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788361666.069178:0:90876:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d005033800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361666.069183:0:90876:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d005033800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361666.069185:0:90876:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d005033800 4 00010000:00080000:1.0:1788361666.069215:0:90876:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d006aa9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788361666.070850:0:90876:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788361666.070954:0:90876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788361666.070997:0:90876:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788361666.071008:0:90876:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b69fa8920fe32e1 00000100:00080000:1.0:1788361666.071017:0:90876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361666.071023:0:90876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d006aa9800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361666.071058:0:90876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d11054b480 x1875230429809280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361666.071131:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429809280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361666.071191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361666.071252:0:90876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361666.071419:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809280 00000100:00100000:2.0:1788361666.071425:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809280 00000100:00100000:2.0:1788361666.071464:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1788361666.071472:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429809280:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361666.071596:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429809280:12345-0@lo:38:llog_process_th.0 Request processed in 123us (403us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788361666.071602:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1788361666.071661:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361666.071669:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361666.071672:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361666.071675:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429809280:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361666.076234:0:90876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90876:1875230429809408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361666.077778:0:90876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.077849:0:90876:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.077863:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809408 00000100:00100000:0.0:1788361666.077872:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809408 00000100:00100000:0.0:1788361666.077917:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361666.077925:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90876:x1875230429809408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361666.078103:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90876:x1875230429809408:12345-0@lo:502:llog_process_th.0 Request processed in 179us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.078111:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788361666.078443:0:90876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90876:1875230429809408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361666.078502:0:90876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90876:1875230429809536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361666.078541:0:90876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.078577:0:90876:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361666.078591:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809536 00000100:00100000:1.0:1788361666.078594:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809536 00000100:00100000:1.0:1788361666.078629:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361666.078643:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90876:x1875230429809536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361666.078786:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90876:x1875230429809536:12345-0@lo:502:llog_process_th.0 Request processed in 144us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.078794:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361666.078855:0:90876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90876:1875230429809536:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361666.078874:0:90876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788361666.079410:0:90853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788361666.079433:0:90853:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361666.079455:0:90853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361666.079466:0:90853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788361666.079516:0:90853:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788361666.079518:0:90853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361666.079519:0:90853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361666.079523:0:90853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361666.079524:0:90853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361666.079525:0:90853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361666.079526:0:90853:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361666.079528:0:90853:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361666.079530:0:90853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361666.079531:0:90853:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361666.079534:0:90853:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788361666.079536:0:90853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361666.079537:0:90853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361666.079538:0:90853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361666.079539:0:90853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361666.079540:0:90853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361666.079541:0:90853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361666.079542:0:90853:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361666.079543:0:90853:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361666.079544:0:90853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361666.079545:0:90853:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361666.079560:0:90853:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788361666.079799:0:90853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429809664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788361666.080148:0:90853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.080181:0:90853:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361666.080257:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809664 00000100:00100000:0.0:1788361666.080262:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809664 00000100:00100000:0.0:1788361666.080305:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361666.080313:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429809664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361666.080340:0:90861:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788361666.080355:0:90861:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361666.086462:0:90861:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361666.086482:0:90861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788361666.086487:0:90863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361666.086492:0:90863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361666.086513:0:90863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086532:0:90863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 11 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086541:0:90863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086594:0:90863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 11 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086608:0:90863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 11 pid: 90861 timeout: 2806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361666.086625:0:90863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90863:1875230429809792:0@lo:104: 00000100:00100000:1.0:1788361666.086685:0:90863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.086722:0:90863:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361666.086745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809792 00000100:00100000:0.0:1788361666.086747:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:90853:x1875230429809664:12345-0@lo:253:mount.lustre.0 Request processed in 6434us (6598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.086751:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809792 00000100:00100000:0.0:1788361666.086757:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361666.086789:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788361666.086803:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:90863:x1875230429809792:12345-0@lo:104: 00010000:00010000:1.0:1788361666.086816:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086885:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361666.086890:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:90863:x1875230429809792:12345-0@lo:104: Request processed in 89us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.086897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:1.0:1788361666.086914:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361666.086919:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086927:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361666.086931:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086939:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361666.086946:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361666.086952:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361666.086979:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.086986:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361666.087014:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087030:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe32a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe32b7 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087043:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361666.087045:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361666.087047:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361666.087063:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429809920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361666.087087:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361666.087122:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429809920 00000100:00100000:1.0:1788361666.087125:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429809920 00010000:00010000:1.0:1788361666.087138:0:9529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 11 pid: 90861 timeout: 2806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361666.087157:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1788361666.087162:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3652:x1875230429809920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361666.087171:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361666.087175:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 11 pid: 90861 timeout: 2806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087185:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 11 pid: 90861 timeout: 2806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087199:0:9529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087207:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361666.087227:0:9529:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000736219s 00010000:00010000:1.0:1788361666.087231:0:9529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087238:0:9529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087244:0:9529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087250:0:9529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087256:0:9529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166b400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361666.087260:0:9529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087267:0:9529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087275:0:9529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087284:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361666.087307:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3652:x1875230429809920:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.087314:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1788361666.087344:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429809920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361666.087368:0:90863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308000/0x1b69fa8920fe32b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe32a9 expref: 10 pid: 90861 timeout: 2806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361666.087383:0:90863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90863:1875230429809792:0@lo:104: 00010000:00010000:1.0:1788361666.087395:0:90863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087403:0:90863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087410:0:90863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361666.087415:0:90863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166b400/0x1b69fa8920fe32e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361666.087485:0:90853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:90853:1875230429809664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361666.087496:0:90853:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788361666.087499:0:90853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361666.087501:0:90853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361666.087502:0:90853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361666.087503:0:90853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361666.087505:0:90853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361666.087506:0:90853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361666.087507:0:90853:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361666.087509:0:90853:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361666.087511:0:90853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361666.087512:0:90853:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788361666.087522:0:90853:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1788361666.097710:0:90853:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411366 00000040:01000000:3.0:1788361666.098071:0:90853:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788361666.098084:0:90883:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411366 00000020:00080000:0.0:1788361666.098089:0:90883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411366 00000040:01000000:0.0:1788361666.098449:0:90884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361666.098698:0:90853:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788361666.098725:0:90884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361666.099096:0:90885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90885:1875230429810048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361666.099440:0:90885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.099467:0:90885:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.099613:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810048 00000100:00100000:2.0:1788361666.099628:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810048 00000100:00100000:2.0:1788361666.099677:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00100000:2.0:1788361666.099687:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90885:x1875230429810048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361666.099763:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90885:x1875230429810048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.099770:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000100:00100000:3.0:1788361666.099785:0:90885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90885:1875230429810048:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788361666.099810:0:90853:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:01000000:3.0:1788361666.099811:0:90885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788361666.099866:0:90853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361666.099871:0:90885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90885:1875230429810176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788361666.099900:0:90885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361666.099938:0:90885:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.100626:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810176 00000100:00100000:2.0:1788361666.100633:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810176 00000100:00100000:2.0:1788361666.100675:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00100000:2.0:1788361666.100682:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90885:x1875230429810176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361666.100786:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90885:x1875230429810176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.100793:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000100:00100000:2.0:1788361666.100818:0:90885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90885:1875230429810176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361666.100890:0:90885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90885:1875230429810304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361666.100915:0:90885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361666.100934:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810304 00000100:00100000:2.0:1788361666.100937:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810304 00000100:00100000:2.0:1788361666.100957:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00100000:2.0:1788361666.100961:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90885:x1875230429810304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361666.100998:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90885:x1875230429810304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 36us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.101004:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00000004:00000080:1.0:1788361666.101015:0:90853:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1788361666.101021:0:90885:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361666.101034:0:90885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90885:1875230429810304:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788361666.101056:0:90853:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788361666.101081:0:90885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361666.101107:0:90853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361666.105395:0:90884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788361666.105481:0:90884:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788361666.106417:0:90885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788361666.106454:0:90885:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788361666.106456:0:90885:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788361666.107547:0:90853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788361666.108280:0:90853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788361666.108317:0:90853:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788361666.108446:0:90853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788361666.109144:0:90853:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:1.0:1788361666.111808:0:90853:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00010000:00080000:1.0:1788361666.112769:0:90886:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90886 00010000:02000000:1.0:1788361666.112779:0:90886:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788361666.112782:0:90886:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788361666.112784:0:90886:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788361666.112951:0:90853:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361666.112968:0:90853:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361666.112988:0:90853:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788361666.113005:0:90853:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788361666.113984:0:90853:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788361666.114241:0:90853:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788361666.649045:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361667.466480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361667.466516:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003776 00000100:00100000:3.0:1788361667.466522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361667.466527:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003776 00000100:00100000:3.0:1788361667.466566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361667.466586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361667.466621:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361667.466653:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004032 00000100:00100000:3.0:1788361667.466657:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004032 00000100:00100000:3.0:1788361667.466707:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407003904 00000100:00100000:3.0:1788361667.466710:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407003904 00000100:00100000:3.0:1788361667.466730:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 875 00000100:00100000:3.0:1788361667.466741:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407004032:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361667.466816:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407004032:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.466838:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 875 00000100:00100000:3.0:1788361667.466861:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1212 00000100:00100000:3.0:1788361667.466868:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230407003904:12345-192.168.204.35@tcp:38:kworker.0 00000100:00100000:0.0:1788361667.466874:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:0.0:1788361667.466883:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2411:x1875230407003776:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:0.0:1788361667.466893:0:90862:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00010000:00080000:3.0:1788361667.466895:0:66126:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'ec302d84-8f96-49d3-8682-aefc474f8448' at ffff99d116c04000, cookie 0x1b69fa8920fe3239 00010000:00080000:3.0:1788361667.466903:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp recovering/t111669149704 exp ffff99d116c04000 cur 2707 last 1788361666 00010000:02000400:3.0:1788361667.466912:0:66126:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788361667.466919:0:66126:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:0.0:1788361667.466928:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2411:x1875230407003776:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 43us (459us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361667.466936:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000004:00100000:3.0:1788361667.466943:0:66126:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788361667.467001:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361667.467028:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004288 00000100:00100000:1.0:1788361667.467032:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004288 00000100:00100000:1.0:1788361667.467067:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004160 00000100:00100000:1.0:1788361667.467070:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004160 00000100:00100000:1.0:1788361667.467100:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1864 00000100:00100000:1.0:1788361667.467109:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407004288:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361667.467140:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407004288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361667.467142:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d0021f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361667.467149:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1864 00000100:00100000:1.0:1788361667.467163:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1865 00000100:00100000:1.0:1788361667.467169:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407004160:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361667.467182:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230407003904:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 312us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.467189:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1212 00000100:00100000:1.0:1788361667.467200:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407004160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.467206:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1865 00000100:00080000:1.0:1788361667.467250:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361667.467253:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361667.469789:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361667.469938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361667.469988:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004416 00000100:00100000:1.0:1788361667.470000:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004416 00000100:00100000:1.0:1788361667.470048:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:1.0:1788361667.470057:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2408:x1875230407004416:12345-192.168.204.35@tcp:250:kworker.0 00010000:00080000:1.0:1788361667.470086:0:90861:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1f5c0251-1795-40ef-8392-cb147010b7b5@192.168.204.35@tcp t0 exp 0000000000000000 cur 2707 last 0 00000020:00000080:1.0:1788361667.470121:0:90861:0:(genops.c:1406:class_connect()) connect: client 1f5c0251-1795-40ef-8392-cb147010b7b5, cookie 0x1b69fa8920fe32ef 00000100:00080000:1.0:1788361667.470260:0:90861:0:(import.c:65:import_set_state_nolock()) ffff99d1171e0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361667.470344:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+5:2408:x1875230407004416:12345-192.168.204.35@tcp:250:kworker.0 Request processed in 286us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.470352:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:1.0:1788361667.470398:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406996736 00000100:00100000:1.0:1788361667.470402:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406996736 00000100:00100000:1.0:1788361667.470445:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1213 00000100:00100000:1.0:1788361667.470454:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406996736:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00080000:1.0:1788361667.470473:0:66901:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:1.0:1788361667.470489:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406996736:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 37us (552us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361667.470496:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1213 00010000:00080000:1.0:1788361667.470519:0:90886:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1788361667.674051:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361667.925933:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361667.925941:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d005033800 from 119 10000000:01000000:1.0:1788361667.925947:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361667.925999:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.926012:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.926023:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361667.926051:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.926135:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.926186:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361667.926680:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810432 00000100:00100000:3.0:1788361667.926687:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810432 00000100:00100000:3.0:1788361667.926748:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361667.926870:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:6520:x1875230429810432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.926886:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361667.926900:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1371ffe00/0x1b69fa8920fe32fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe32f6 expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.926921:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1371ffe00/0x1b69fa8920fe32fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe32f6 expref: 11 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.926932:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1371ffe00/0x1b69fa8920fe32fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe32f6 expref: 11 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.926941:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371ffe00, rc 0) 00000100:00100000:3.0:1788361667.926998:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429810432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.927005:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361667.927591:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.927609:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.927631:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361667.927690:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.927724:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.927757:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361667.927849:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810560 00000100:00100000:3.0:1788361667.927854:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810560 00000100:00100000:3.0:1788361667.927884:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361667.927891:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429810560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361667.927908:0:90861:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361667.927926:0:90861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361667.927930:0:90861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 119 00000100:00100000:3.0:1788361667.928006:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429810560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.928020:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361667.928058:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361667.928102:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361667.928109:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.928117:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.928126:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361667.928129:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 52 10000000:01000000:3.0:1788361667.928131:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361667.928150:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.928157:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.928165:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.928178:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.928203:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.928233:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.928565:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810688 00000100:00100000:1.0:1788361667.928570:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810688 00000100:00100000:1.0:1788361667.928605:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361667.928612:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429810688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.928622:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361667.928635:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166ba00/0x1b69fa8920fe330b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3304 expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.928655:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166ba00/0x1b69fa8920fe330b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3304 expref: 12 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.928664:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166ba00/0x1b69fa8920fe330b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3304 expref: 12 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.928671:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166ba00, rc 0) 00000100:00100000:1.0:1788361667.928712:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429810688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.928719:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788361667.928754:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.928779:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.928802:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.928877:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.928902:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.928932:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.928933:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810816 00000100:00100000:1.0:1788361667.928939:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810816 00000100:00100000:1.0:1788361667.928965:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361667.928975:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429810816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.929096:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429810816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.929104:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361667.929126:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.929159:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.929197:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.929219:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.929269:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429810944 00000100:00100000:1.0:1788361667.929274:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429810944 00000100:00100000:1.0:1788361667.929303:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361667.929310:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429810944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.929387:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429810944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.929395:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361667.929415:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429810944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361667.930318:0:91074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788361667.930482:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788361667.930502:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361667.930510:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.930519:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.930539:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361667.930542:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 116 10000000:01000000:3.0:1788361667.930545:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361667.930572:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.930580:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.930598:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.930614:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.930652:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.930720:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.930766:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811072 00000100:00100000:1.0:1788361667.930771:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811072 00000100:00100000:1.0:1788361667.930868:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361667.930876:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429811072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.930887:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361667.930899:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166a400/0x1b69fa8920fe3319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3312 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.930918:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166a400/0x1b69fa8920fe3319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3312 expref: 13 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.930928:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166a400/0x1b69fa8920fe3319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3312 expref: 13 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.930935:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166a400, rc 0) 00000100:00100000:1.0:1788361667.930969:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429811072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.930984:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361667.931457:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.931473:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.931482:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.931550:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.931582:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.931607:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.931615:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811200 00000100:00100000:0.0:1788361667.931621:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811200 00000100:00100000:0.0:1788361667.931657:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361667.931673:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429811200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361667.931690:0:90862:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361667.931706:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361667.931710:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788361667.931714:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788361667.931717:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788361667.931719:0:90862:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:0.0:1788361667.931807:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429811200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.931814:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361667.931944:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361667.932014:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361667.932021:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.932030:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.932038:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788361667.932041:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788361667.932049:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788361667.932065:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.932072:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.932081:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.932093:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.932117:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.932138:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361667.932961:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811328 00000100:00100000:3.0:1788361667.932970:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811328 00000100:00100000:0.0:1788361667.933221:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361667.933235:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429811328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361667.933252:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361667.933269:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3320 expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.933295:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3320 expref: 14 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.933307:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3320 expref: 14 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.933316:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309c00, rc 0) 00000100:00100000:0.0:1788361667.933364:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429811328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.933371:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788361667.933401:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.933420:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.933429:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.933489:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.933517:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.933551:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.933919:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811456 00000100:00100000:1.0:1788361667.933925:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811456 00000100:00100000:1.0:1788361667.933964:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361667.933972:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429811456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.934129:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429811456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.934137:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361667.934239:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.934271:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.934314:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.934335:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11f2df540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.934355:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811584 00000100:00100000:0.0:1788361667.934360:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811584 00000100:00100000:0.0:1788361667.934396:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361667.934403:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429811584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.935436:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429811584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1030us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.935446:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361667.935798:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361667.938525:0:91075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788361667.939169:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788361667.939193:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788361667.939204:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.939220:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.939228:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788361667.939230:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d002df9000 from 1 10000000:01000000:3.0:1788361667.939232:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788361667.939266:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.939274:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.939284:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.939310:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.939376:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.939423:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.939591:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811712 00000100:00100000:1.0:1788361667.939600:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811712 00000100:00100000:1.0:1788361667.939655:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788361667.939664:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1091efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429811712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.939679:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361667.939693:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166be00/0x1b69fa8920fe3335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe332e expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.939718:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166be00/0x1b69fa8920fe3335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe332e expref: 15 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.939729:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166be00/0x1b69fa8920fe3335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe332e expref: 15 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.939745:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166be00, rc 0) 00000100:00100000:1.0:1788361667.939794:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1091efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429811712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.939801:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361667.939918:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.939936:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.939945:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.939963:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788361667.939968:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.939985:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.939992:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361667.939995:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d002df9000 from 7 10000000:01000000:3.0:1788361667.939997:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361667.940012:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.940018:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.940025:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.940038:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.940064:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.940738:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811840 00000100:00100000:1.0:1788361667.940746:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811840 00000100:00100000:3.0:1788361667.940750:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.940784:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361667.940795:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1091edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429811840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.940806:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361667.940818:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166b600/0x1b69fa8920fe3343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe333c expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.940866:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166b600/0x1b69fa8920fe3343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe333c expref: 16 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.940876:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166b600/0x1b69fa8920fe3343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe333c expref: 16 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.940884:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166b600, rc 0) 00000100:00100000:1.0:1788361667.940930:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1091edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429811840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.940937:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361667.941584:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.941601:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.941610:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.941677:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.941708:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.941748:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361667.941797:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429811968 00000100:00100000:2.0:1788361667.941801:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429811968 00000100:00100000:2.0:1788361667.941852:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788361667.941859:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1091eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429811968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.941971:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1091eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429811968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361667.941978:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361667.942435:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429811968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.942476:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.942519:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.942572:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361667.942872:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812096 00000100:00100000:3.0:1788361667.942878:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812096 00000100:00100000:3.0:1788361667.942922:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788361667.942931:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d003376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429812096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.943035:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d003376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429812096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.943042:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361667.943141:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361667.945524:0:91077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788361667.945864:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788361667.945889:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361667.945900:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.945912:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.945922:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361667.945924:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 52 10000000:01000000:3.0:1788361667.945927:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361667.945965:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.945974:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.945986:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.946011:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.946078:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.946136:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.946204:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812224 00000100:00100000:0.0:1788361667.946212:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812224 00000100:00100000:0.0:1788361667.946260:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361667.946270:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429812224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361667.946288:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361667.946301:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe334a expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.946324:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe334a expref: 17 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.946335:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe334a expref: 17 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.946343:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308200, rc 0) 00000100:00100000:0.0:1788361667.946443:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429812224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.946451:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788361667.947767:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.947791:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.947802:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.947894:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.947942:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.947972:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812352 00000100:00100000:3.0:1788361667.947974:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.947977:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812352 00000100:00100000:1.0:1788361667.948017:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361667.948027:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429812352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.948231:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429812352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.948240:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788361667.949768:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.949842:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.949908:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361667.950001:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812480 00000100:00100000:2.0:1788361667.950007:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.950007:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812480 00000100:00100000:0.0:1788361667.950059:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788361667.950068:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429812480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.950161:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429812480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.950173:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788361667.950252:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361667.951104:0:91080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788361667.951341:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788361667.951367:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361667.951377:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.951387:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361667.951397:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788361667.951399:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788361667.951401:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361667.951431:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.951440:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.951451:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361667.951472:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.951515:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361667.951585:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c23780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.951622:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812608 00000100:00100000:1.0:1788361667.951627:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812608 00000100:00100000:1.0:1788361667.951698:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361667.951709:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429812608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.951721:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361667.951734:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166aa00/0x1b69fa8920fe335f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3358 expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.951777:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166aa00/0x1b69fa8920fe335f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3358 expref: 18 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.951788:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166aa00/0x1b69fa8920fe335f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3358 expref: 18 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.951796:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166aa00, rc 0) 00000100:00100000:1.0:1788361667.951860:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429812608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.951867:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788361667.952055:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361667.952069:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.952089:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361667.952140:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.952166:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361667.952222:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c23780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361667.952252:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812736 00000100:00100000:2.0:1788361667.952257:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812736 00000100:00100000:2.0:1788361667.952316:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361667.952324:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429812736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.952454:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429812736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361667.952461:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788361667.952546:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.952572:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.952606:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361667.952657:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c23780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361667.952688:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812864 00000100:00100000:2.0:1788361667.952692:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812864 00000100:00100000:2.0:1788361667.952747:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361667.952754:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429812864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.956997:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429812864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4232us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.957016:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361667.957030:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361667.958384:0:91083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788361667.959007:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788361667.959047:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788361667.959060:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.959074:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361667.959086:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361667.959089:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0021f9800 from 7 10000000:01000000:3.0:1788361667.959092:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361667.959131:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.959140:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.959158:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.959181:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.959247:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361667.959300:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429812992 00000100:00100000:3.0:1788361667.959302:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.959309:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429812992 00000100:00100000:0.0:1788361667.959363:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361667.959372:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429812992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361667.959385:0:90859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361667.959397:0:90859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe336d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3366 expref: -99 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.959421:0:90859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe336d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3366 expref: 19 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.959432:0:90859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe336d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3366 expref: 19 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.959441:0:90859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308c00, rc 0) 00000100:00100000:0.0:1788361667.959476:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429812992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.959489:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788361667.959603:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429812992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.959619:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.959627:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361667.959687:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.959713:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.959738:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.959866:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813120 00000100:00100000:0.0:1788361667.959871:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813120 00000100:00100000:0.0:1788361667.959900:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788361667.959908:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429813120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.960024:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429813120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.960031:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361667.960089:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.960116:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.960151:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.960208:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.960237:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813248 00000100:00100000:0.0:1788361667.960241:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813248 00000100:00100000:0.0:1788361667.960321:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361667.960329:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429813248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.960409:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429813248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.960416:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361667.960477:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361667.967095:0:91085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361667.967253:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361667.967284:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361667.967296:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.967309:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361667.967318:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361667.967320:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 52 10000000:01000000:1.0:1788361667.967323:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361667.967364:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.967372:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.967383:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361667.967411:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.967480:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.967537:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.967566:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813376 00000100:00100000:0.0:1788361667.967575:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813376 00000100:00100000:0.0:1788361667.967619:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788361667.967629:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429813376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361667.967643:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361667.967656:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe337b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3374 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.967680:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe337b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3374 expref: 20 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.967704:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe337b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3374 expref: 20 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.967712:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309a00, rc 0) 00000100:00100000:0.0:1788361667.967760:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429813376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.967767:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361667.967918:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.967934:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.967943:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361667.968383:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.968416:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.968451:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361667.968485:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813504 00000100:00100000:2.0:1788361667.968490:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813504 00000100:00100000:2.0:1788361667.968536:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788361667.968545:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d003040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429813504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.968676:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d003040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429813504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361667.968685:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788361667.968704:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.968735:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.968775:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.968796:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361667.968917:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813632 00000100:00100000:2.0:1788361667.968921:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813632 00000100:00100000:2.0:1788361667.968954:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361667.968963:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d003042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429813632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.969055:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d003042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429813632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361667.969062:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788361667.969235:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361667.970664:0:91087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788361667.970860:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788361667.970884:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361667.970903:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.970914:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361667.970926:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788361667.970928:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788361667.970932:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361667.970974:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.970982:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.970991:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361667.971014:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.971088:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361667.971121:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102ad2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361667.971601:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813760 00000100:00100000:3.0:1788361667.971609:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813760 00000100:00100000:3.0:1788361667.972726:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361667.972745:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d003043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429813760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361667.972767:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361667.972787:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1371fee00/0x1b69fa8920fe3389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3382 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.972817:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1371fee00/0x1b69fa8920fe3389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3382 expref: 21 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.972913:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1371fee00/0x1b69fa8920fe3389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3382 expref: 21 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361667.972922:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1371fee00, rc 0) 00000100:00100000:3.0:1788361667.972999:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d003043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429813760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.973007:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788361667.976017:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.976108:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.976122:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361667.976928:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.977001:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361667.977525:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429813888 00000100:00100000:3.0:1788361667.977543:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429813888 00000100:00100000:3.0:1788361667.977587:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361667.977597:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429813888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361667.977763:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429813888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361667.977771:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788361667.978279:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.978305:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429813888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.978352:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.978401:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.978437:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.978458:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814016 00000100:00100000:0.0:1788361667.978464:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814016 00000100:00100000:0.0:1788361667.978509:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361667.978516:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429814016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.987077:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429814016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8551us (8666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.987098:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361667.987173:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361667.988525:0:91093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788361667.988700:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788361667.988726:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361667.988742:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.988754:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361667.988765:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361667.988767:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d137d28000 from 7 10000000:01000000:0.0:1788361667.988770:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361667.988812:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.988844:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.988871:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361667.988897:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.988961:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361667.989001:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1417d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361667.989059:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814144 00000100:00100000:2.0:1788361667.989067:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814144 00000100:00100000:2.0:1788361667.989120:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788361667.989128:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429814144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361667.989143:0:90859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361667.989157:0:90859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe3397 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3390 expref: -99 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.989190:0:90859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe3397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3390 expref: 22 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.989200:0:90859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe3397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3390 expref: 22 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.989209:0:90859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916e00, rc 0) 00000100:00100000:2.0:1788361667.989244:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429814144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361667.989251:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788361667.989291:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361667.989304:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.989312:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361667.989359:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.989382:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361667.989398:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102ad2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.989439:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814272 00000100:00100000:0.0:1788361667.989442:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814272 00000100:00100000:0.0:1788361667.989472:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361667.989478:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429814272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.989589:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429814272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.989596:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361667.989654:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.989679:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.989716:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361667.989764:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102ad2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.989919:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814400 00000100:00100000:0.0:1788361667.989923:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814400 00000100:00100000:0.0:1788361667.989977:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361667.989983:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429814400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361667.990056:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429814400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.990063:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361667.990156:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361667.991426:0:91094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788361667.992126:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788361667.992151:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788361667.992161:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.992172:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361667.992182:0:6520:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788361667.992185:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99d1349b4d40 from 1 10000000:01000000:2.0:1788361667.992187:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788361667.992223:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.992232:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.992244:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361667.992267:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.992321:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361667.992610:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103979480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361667.992710:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814528 00000100:00100000:0.0:1788361667.992716:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814528 00000100:00100000:0.0:1788361667.992801:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788361667.992811:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429814528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361667.992852:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361667.992874:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe33a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe339e expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.992899:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe33a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe339e expref: 23 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.992911:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe33a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe339e expref: 23 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361667.992921:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308a00, rc 0) 00000100:00100000:0.0:1788361667.992958:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429814528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361667.992966:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788361667.993159:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361667.993175:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.993184:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361667.993213:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788361667.993218:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.993223:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361667.993230:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788361667.993232:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:2.0:1788361667.993234:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788361667.993249:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.993256:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361667.993263:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361667.993276:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361667.993302:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361667.993430:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103979480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.993467:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814656 00000100:00100000:1.0:1788361667.993472:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814656 00000100:00100000:1.0:1788361667.993500:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788361667.993509:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429814656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.993518:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361667.993538:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe33b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe33ac expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.993555:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe33b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe33ac expref: 24 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.993564:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe33b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe33ac expref: 24 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.993570:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166ae00, rc 0) 00000100:00100000:1.0:1788361667.993601:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429814656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361667.993608:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788361667.993640:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361667.993650:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.993659:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361667.993733:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.993758:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361667.993769:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0067cbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361667.993779:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814784 00000100:00100000:1.0:1788361667.993783:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814784 00000100:00100000:1.0:1788361667.993797:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788361667.993802:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429814784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361667.993886:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429814784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361667.993892:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788361667.993917:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429814784:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788361667.993942:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788361667.993947:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361667.993952:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1788361668.237986:0:91136:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788361668.696258:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788361668.778711:0:91188:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788361668.779203:0:91188:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788361669.260945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361669.261572:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004544 00000100:00100000:1.0:1788361669.261583:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004544 00000100:00100000:1.0:1788361669.261641:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788361669.261653:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fd1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+5:42333:x1875230407004544:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361669.261685:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361669.261702:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166b800/0x1b69fa8920fe33ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e93 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.261740:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166b800/0x1b69fa8920fe33ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e93 expref: 6 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.261752:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166b800/0x1b69fa8920fe33ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e93 expref: 6 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.261761:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166b800, rc 0) 00000100:00100000:1.0:1788361669.261896:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fd1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230407004544:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 245us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361669.261904:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788361669.264164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361669.264249:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004672 00000100:00100000:2.0:1788361669.264259:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004672 00000100:00100000:2.0:1788361669.264312:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:2.0:1788361669.264321:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230407004672:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361669.264351:0:90859:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788361669.264366:0:90859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361669.264370:0:90859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788361669.264373:0:90859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788361669.264376:0:90859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788361669.264379:0:90859:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:2.0:1788361669.267641:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230407004672:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 3308us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361669.267658:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000020:00000004:0.0:1788361669.269612:0:91238:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788361669.269885:0:91238:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788361669.274634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361669.274811:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004800 00000100:00100000:1.0:1788361669.274841:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004800 00000100:00100000:1.0:1788361669.274894:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:1.0:1788361669.274905:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+6:42333:x1875230407004800:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361669.274922:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361669.274939:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe33c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e9a expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.274969:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe33c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e9a expref: 7 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.274982:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe33c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e9a expref: 7 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.274992:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166a800, rc 0) 00000100:00100000:1.0:1788361669.276020:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230407004800:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 1114us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361669.276034:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:1.0:1788361669.281067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361669.281158:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407004928 00000100:00100000:0.0:1788361669.281167:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407004928 00000100:00100000:0.0:1788361669.281228:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788361669.281241:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+7:42333:x1875230407004928:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361669.281415:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230407004928:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 177us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361669.281425:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1788361669.283702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361669.283747:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005056 00000100:00100000:1.0:1788361669.283757:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005056 00000100:00100000:1.0:1788361669.283956:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:1.0:1788361669.283971:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230407005056:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361669.284194:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230407005056:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 227us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361669.284202:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:1.0:1788361669.293351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361669.293511:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005184 00000100:00100000:0.0:1788361669.293522:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005184 00000100:00100000:0.0:1788361669.294216:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788361669.294229:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+8:42333:x1875230407005184:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361669.294249:0:90859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361669.294279:0:90859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309400/0x1b69fa8920fe33c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ea1 expref: -99 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361669.294312:0:90859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309400/0x1b69fa8920fe33c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ea1 expref: 9 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361669.294323:0:90859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309400/0x1b69fa8920fe33c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ea1 expref: 9 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361669.294332:0:90859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:0.0:1788361669.295696:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230407005184:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 1466us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361669.295704:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788361669.297458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361669.298115:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005312 00000100:00100000:3.0:1788361669.298125:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005312 00000100:00100000:3.0:1788361669.298214:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788361669.298224:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230407005312:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361669.298379:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230407005312:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 156us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361669.298386:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788361669.302207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361669.302287:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005440 00000100:00100000:0.0:1788361669.302298:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005440 00000100:00100000:0.0:1788361669.302382:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:0.0:1788361669.302393:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d116e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230407005440:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361669.302552:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d116e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230407005440:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 160us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361669.302560:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:0.0:1788361669.307585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361669.308294:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005568 00000100:00100000:1.0:1788361669.308306:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005568 00000100:00100000:1.0:1788361669.308360:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788361669.308370:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d121185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:42333:x1875230407005568:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361669.308385:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361669.308478:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d14166b000/0x1b69fa8920fe33cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ea8 expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.308522:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d14166b000/0x1b69fa8920fe33cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ea8 expref: 10 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.308535:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d14166b000/0x1b69fa8920fe33cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ea8 expref: 10 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361669.308544:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166b000, rc 0) 00000100:00100000:1.0:1788361669.308643:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d121185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230407005568:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 274us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361669.308656:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788361669.313601:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361669.313715:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005696 00000100:00100000:0.0:1788361669.313726:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005696 00000100:00100000:0.0:1788361669.313786:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:0.0:1788361669.313796:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d121187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230407005696:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361669.314057:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d121187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:42333:x1875230407005696:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 262us (471us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361669.314079:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:3.0:1788361669.462305:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361669.462376:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361669.462582:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429815040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361669.462621:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361669.462752:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429814912 00000100:00100000:1.0:1788361669.462761:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429814912 00000100:00080000:1.0:1788361669.463094:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361669.463111:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815040 00000100:00100000:0.0:1788361669.463115:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815040 00000100:00100000:3.0:1788361669.463143:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1788361669.463213:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1788361669.463214:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429814912:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361669.463222:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429815040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788361669.463249:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788361669.463269:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1788361669.463296:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361669.463320:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429814912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361669.463328:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1788361669.463354:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429815040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361669.463362:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1788361669.463384:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361669.463662:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429815040:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788361669.718200:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361670.742151:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361671.510158:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361671.510164:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361671.510167:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361671.510179:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361671.510202:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b59880 x1875230429815296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361671.510252:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361671.510265:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361671.510267:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361671.510273:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361671.510287:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429815424:0@lo:400:kworker.0 00000100:00100000:3.0:1788361671.510288:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b59180 x1875230429815552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361671.510336:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361671.510340:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361671.510342:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361671.510347:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361671.510362:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5ad80 x1875230429815808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361671.510381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361671.510394:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361671.510398:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361671.510400:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361671.510405:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361671.510418:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b59f80 x1875230429816192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361671.510433:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361671.510443:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429816320:0@lo:400:kworker.0 00000100:00080000:3.0:1788361671.510452:0:79303:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788361671.510456:0:79303:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361671.510469:0:79303:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361671.510476:0:79303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d006aa9800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361671.510487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.510491:0:79303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136ed7800 x1875230429816704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361671.510511:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429815680:0@lo:400:kworker.0 00000100:00100000:3.0:1788361671.510533:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429815936:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.510538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.510563:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361671.510569:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429816448:0@lo:400:kworker.0 00000100:00100000:3.0:1788361671.510578:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.510601:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429816576:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.510604:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.510645:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.510649:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815424 00000100:00100000:1.0:1788361671.510658:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815424 00000100:00100000:3.0:1788361671.510680:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788361671.510702:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429815168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.510705:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815680 00000100:00100000:1.0:1788361671.510709:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815680 00000100:00100000:1.0:1788361671.510739:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1788361671.510749:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.510754:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361671.510755:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429815296:0@lo:38:kworker.0 00000100:00100000:3.0:1788361671.510791:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429816064:0@lo:400:kworker.0 00000100:00100000:2.0:1788361671.510800:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.510855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.510855:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429815424:12345-0@lo:400:kworker.0 Request processed in 105us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.510860:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429815552:0@lo:38:kworker.0 00000100:00100000:1.0:1788361671.510871:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1788361671.510894:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815296 00000100:00100000:2.0:1788361671.510897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.510903:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1788361671.510910:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815296 00000100:00100000:3.0:1788361671.510912:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429815680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361671.510925:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815936 00000100:00100000:1.0:1788361671.510930:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815552 00000100:00100000:0.0:1788361671.510932:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815936 00000100:00100000:1.0:1788361671.510936:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815552 00000100:00100000:2.0:1788361671.510937:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429815808:0@lo:38:kworker.0 00000100:00100000:3.0:1788361671.510944:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429815680:12345-0@lo:400:kworker.0 Request processed in 34us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.510950:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1788361671.510957:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1788361671.510964:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429815296:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361671.510970:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1788361671.510979:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816448 00000100:00100000:3.0:1788361671.510981:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429815552:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361671.510985:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816448 00010000:00080000:1.0:1788361671.510993:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2711 last 0 00010000:00080000:3.0:1788361671.511001:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2711 last 0 00000100:00100000:2.0:1788361671.511002:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361671.511015:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816576 00000100:00100000:0.0:1788361671.511019:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816576 00000100:00100000:2.0:1788361671.511027:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429816192:0@lo:38:kworker.0 00000100:00100000:0.0:1788361671.511045:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816064 00000100:00100000:0.0:1788361671.511049:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816064 00000020:00000080:1.0:1788361671.511051:0:66128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe33d6 00000100:00100000:2.0:1788361671.511059:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788361671.511064:0:66126:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b69fa8920fe33dd 00000004:00100000:1.0:1788361671.511070:0:66128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788361671.511076:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429816704:0@lo:38:kworker.0 00000004:00100000:3.0:1788361671.511080:0:66126:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788361671.511081:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:0.0:1788361671.511095:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429815936:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361671.511115:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d13fd15000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361671.511125:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361671.511159:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429815936:12345-0@lo:400:kworker.0 Request processed in 66us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.511165:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816320 00000100:00100000:0.0:1788361671.511171:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1788361671.511172:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816320 00000100:00100000:3.0:1788361671.511179:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875230429815552:12345-0@lo:38:kworker.0 Request processed in 199us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.511189:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1788361671.511193:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:3.0:1788361671.511208:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816192 00000100:00100000:0.0:1788361671.511208:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429816448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361671.511213:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815808 00000100:00100000:3.0:1788361671.511214:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816192 00000100:00100000:2.0:1788361671.511219:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815808 00000100:00100000:3.0:1788361671.511235:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816704 00000100:00100000:3.0:1788361671.511241:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816704 00000100:00100000:2.0:1788361671.511250:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00100000:0.0:1788361671.511255:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429816448:12345-0@lo:400:kworker.0 Request processed in 50us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.511263:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788361671.511266:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429816320:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361671.511274:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d136cc2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361671.511277:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429816192:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361671.511283:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00010000:00080000:3.0:1788361671.511298:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2711 last 0 00000100:00100000:0.0:1788361671.511304:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1788361671.511314:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429816576:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1788361671.511331:0:66126:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1b69fa8920fe33e4 00000100:00100000:2.0:1788361671.511331:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429816320:12345-0@lo:400:kworker.0 Request processed in 68us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.511331:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429815296:12345-0@lo:38:kworker.0 Request processed in 362us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.511347:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1788361671.511362:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1788361671.511367:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429816704:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788361671.511380:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2711 last 0 00000020:00000080:1.0:1788361671.511405:0:66128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b69fa8920fe33eb 00000004:00100000:3.0:1788361671.511425:0:66126:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361671.511443:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d13fd15800 : changing import state from RECOVER to FULL 00000004:00100000:1.0:1788361671.511478:0:66128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788361671.511490:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875230429816192:12345-0@lo:38:kworker.0 Request processed in 215us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.511496:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00000100:00080000:1.0:1788361671.511499:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d11787b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361671.511503:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788361671.511520:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00100000:2.0:1788361671.511527:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429815808:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361671.511540:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:1.0:1788361671.511541:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429816704:12345-0@lo:38:kworker.0 Request processed in 170us (416us total) trans 0 rc 0/0 00010000:00080000:2.0:1788361671.511544:0:23939:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d116c02000, cookie 0x1b69fa8920fe3240 00010000:00080000:2.0:1788361671.511553:0:23939:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d116c02000 cur 2711 last 1788361666 00000100:00100000:3.0:1788361671.511555:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429816064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.511556:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000004:00100000:2.0:1788361671.511570:0:23939:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788361671.511586:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429815168 00000100:00100000:1.0:1788361671.511592:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429815168 00000100:00080000:2.0:1788361671.511594:0:23939:0:(import.c:65:import_set_state_nolock()) ffff99d004103000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361671.511603:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429816064:12345-0@lo:400:kworker.0 Request processed in 52us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.511611:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:1.0:1788361671.511627:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788361671.511637:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d121186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429815168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361671.511646:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429815808:12345-0@lo:38:kworker.0 Request processed in 117us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.511655:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00100000:1.0:1788361671.511679:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d121186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429815168:12345-0@lo:400:kworker.0 Request processed in 43us (929us total) trans 0 rc 0/0 00010000:00080000:2.0:1788361671.511690:0:90886:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788361671.511696:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788361671.511697:0:90886:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:2.0:1788361671.511704:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.511708:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:2.0:1788361671.511712:0:90886:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:2.0:1788361671.511714:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.511724:0:90886:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406996736 t111669149704 from 192.168.204.35@tcp req@ffff99d136b58700 x1875230406996736/t0(111669149704) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:728/0 lens 528/0 e 0 to 0 dl 1788361678 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361671.511736:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361671.511741:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361671.511745:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361671.511777:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429816448:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.511798:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429816320:0@lo:400:kworker.0 00010000:00080000:3.0:1788361671.511799:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d136b59880 x1875230429815296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.511815:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00100000:1.0:1788361671.511818:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429815680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.511854:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429815424:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.511921:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429816832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361671.511952:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.512016:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429815168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.512026:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429816064:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.512033:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429815936:0@lo:400:kworker.0 00000100:00100000:1.0:1788361671.512039:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429816576:0@lo:400:kworker.0 00000004:00080000:2.0:1788361671.512431:0:90886:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 640us 00000100:00100000:1.0:1788361671.512656:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816832 00000100:00100000:1.0:1788361671.512662:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816832 00000100:00100000:1.0:1788361671.512698:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00080000:3.0:1788361671.512705:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d136b59880 x1875230429815296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361696 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361671.512707:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429816832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788361671.512738:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00080000:3.0:1788361671.512783:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00100000:1.0:1788361671.512788:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429816832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (834us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361671.512791:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361671.512801:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788361671.512802:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00000100:00100000:3.0:1788361671.512808:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429815296:0@lo:38:kworker.0 00010000:00080000:3.0:1788361671.512853:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d136b59180 x1875230429815552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.512864:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00100000:1.0:1788361671.512948:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429816832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361671.513416:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429816576:12345-0@lo:400:kworker.0 Request processed in 2103us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361671.513426:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00080000:3.0:1788361671.513858:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d136b59180 x1875230429815552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361696 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.513868:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788361671.513879:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361671.513883:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788361671.513887:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429815552:0@lo:38:kworker.0 00000100:00080000:3.0:1788361671.513910:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:3.0:1788361671.513919:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788361671.513923:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788361671.513926:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:3.0:1788361671.513930:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d106904000 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:3.0:1788361671.513933:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788361671.514234:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429815808:0@lo:38:kworker.0 00010000:00080000:3.0:1788361671.514252:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d136b59f80 x1875230429816192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.514262:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00080000:3.0:1788361671.515106:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d136b59f80 x1875230429816192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361696 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.515117:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788361671.515122:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361671.515125:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788361671.515130:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429816192:0@lo:38:kworker.0 00010000:00080000:3.0:1788361671.515157:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d136ed7800 x1875230429816704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.515166:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:3.0:1788361671.515171:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361671.515175:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361671.515184:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361671.515189:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429816704:0@lo:38:kworker.0 00010000:00080000:0.0:1788361671.515363:0:91251:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788361671.515369:0:91251:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788361671.515376:0:91251:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788361671.515967:0:91251:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788361671.516202:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429816960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788361671.516296:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361671.516405:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429816960 00000100:00100000:0.0:1788361671.516415:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429816960 00000100:00100000:0.0:1788361671.516515:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00100000:0.0:1788361671.516525:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429816960:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788361671.516548:0:8448:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d136ed7800 x1875230429816960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:732/0 lens 224/0 e 0 to 0 dl 1788361682 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361671.516562:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429816960:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (266us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361671.516571:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00010000:00010000:3.0:1788361671.523388:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523411:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523423:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523432:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523436:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523440:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523857:0:90886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523865:0:90886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523870:0:90886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523876:0:90886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361671.523889:0:90886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523897:0:90886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523911:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361671.523915:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361671.523918:0:90886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523925:0:90886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe33f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361671.523958:0:90886:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a0c8f57 reply state 00000000819301bf transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523970:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.523976:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d0010ec800) 00010000:00010000:3.0:1788361671.523979:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361671.523983:0:90886:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788361671.524115:0:90886:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788361671.524149:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361671.524153:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:3.0:1788361671.524158:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361671.524160:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000100:00100000:1.0:1788361671.526437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000001:00080000:2.0:1788361671.526499:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149704 is committed 00010000:00010000:0.0:1788361671.526542:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361671.526548:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406997248 00000100:00100000:3.0:1788361671.526561:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406997248 00010000:00010000:0.0:1788361671.526568:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.526578:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.526597:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fea00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361671.526602:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.526610:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.526629:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d0010ec800) 00010000:00010000:0.0:1788361671.526632:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361671.526636:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.526643:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe33f9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361671.526653:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1218 00000100:00100000:3.0:1788361671.526685:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406997248:12345-192.168.204.35@tcp:36:rm.0 00010000:00080000:3.0:1788361671.526773:0:66126:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:3.0:1788361671.526796:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230406997248:12345-192.168.204.35@tcp:36:rm.0 Request processed in 117us (374us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361671.526803:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1218 00000020:00080000:2.0:1788361671.526863:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.526866:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:2.0:1788361671.526871:0:90886:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:2.0:1788361671.526874:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.526883:0:90886:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406997248 t111669149705 from 192.168.204.35@tcp req@ffff99d110549f80 x1875230406997248/t0(111669149705) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:732/0 lens 512/0 e 0 to 0 dl 1788361682 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361671.526974:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.526987:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.526998:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527009:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527015:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527022:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527111:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527131:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527138:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527376:0:90886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527383:0:90886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527389:0:90886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527394:0:90886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361671.527397:0:90886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527403:0:90886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527411:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99d136764a00) 00010000:00010000:2.0:1788361671.527414:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361671.527417:0:90886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527423:0:90886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe340e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527441:0:90886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527453:0:90886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527472:0:90886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527477:0:90886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361671.527480:0:90886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527486:0:90886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527494:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d136764700) 00010000:00010000:2.0:1788361671.527496:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361671.527499:0:90886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527505:0:90886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3400 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361671.527517:0:90886:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2d33e2e reply state 000000002879986d transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527528:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.527534:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d136764500) 00010000:00010000:2.0:1788361671.527536:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361671.527539:0:90886:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788361671.527620:0:90886:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361671.527638:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.527641:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:2.0:1788361671.527645:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.527647:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:3.0:1788361671.532226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361671.532280:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406998656 00000100:00100000:1.0:1788361671.532292:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406998656 00000100:00100000:1.0:1788361671.532349:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1219 00000100:00100000:1.0:1788361671.532359:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406998656:12345-192.168.204.35@tcp:36:dd.0 00010000:00080000:1.0:1788361671.532385:0:66127:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:1.0:1788361671.532401:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230406998656:12345-192.168.204.35@tcp:36:dd.0 Request processed in 45us (193us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361671.532408:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1219 00000020:00080000:2.0:1788361671.532428:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.532434:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:2.0:1788361671.532439:0:90886:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149704) 00000020:00080000:2.0:1788361671.532444:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.532454:0:90886:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406998656 t111669149708 from 192.168.204.35@tcp req@ffff99d136ed7100 x1875230406998656/t0(111669149708) o36->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:732/0 lens 488/0 e 0 to 0 dl 1788361682 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361671.532874:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.532890:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.532902:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361671.532950:0:90886:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:2.0:1788361671.532972:0:90886:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b6c8f7c reply state 00000000619f4fc3 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.532985:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.532994:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:2.0:1788361671.532997:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361671.533011:0:90886:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788361671.533353:0:90886:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361671.533361:0:90886:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:2.0:1788361671.533373:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.533376:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:2.0:1788361671.533379:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.533381:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:0.0:1788361671.535139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361671.535403:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230406999040 00000100:00100000:3.0:1788361671.535416:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230406999040 00000100:00100000:3.0:1788361671.535511:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1220 00000100:00100000:3.0:1788361671.535523:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230406999040:12345-192.168.204.35@tcp:101:dd.0 00010000:00080000:3.0:1788361671.535545:0:67579:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1788361671.535563:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230406999040:12345-192.168.204.35@tcp:101:dd.0 Request processed in 45us (438us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361671.535568:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1220 00000020:00080000:2.0:1788361671.535917:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.535922:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:2.0:1788361671.535927:0:90886:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:2.0:1788361671.535930:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.535940:0:90886:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230406999040 t111669149709 from 192.168.204.35@tcp req@ffff99d1012af480 x1875230406999040/t0(111669149709) o101->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:732/0 lens 640/0 e 0 to 0 dl 1788361682 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361671.535967:0:90886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361671.535989:0:90886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe341c lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710e62 expref: -99 pid: 90886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.536050:0:90886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3423 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.536064:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3423 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.536074:0:90886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3423 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361671.536211:0:90886:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6a3:0x0], count =127 00000004:00080000:2.0:1788361671.536216:0:90886:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6a3:0x0]+127 in llog 00000004:00080000:2.0:1788361671.536253:0:90886:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00000004:00080000:2.0:1788361671.536261:0:90886:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x723:0x0], index 0: 0 00010000:00010000:2.0:1788361671.536364:0:90886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3423 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 14 pid: 90886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.536374:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:2.0:1788361671.536377:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361671.536392:0:90886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe341c lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 14 pid: 90886 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.536407:0:90886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3423 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 13 pid: 90886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.536440:0:90886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:2.0:1788361671.536443:0:90886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361671.536445:0:90886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916400, rc 0) 00010000:00080000:2.0:1788361671.536523:0:90886:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361671.536536:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.536539:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:2.0:1788361671.536544:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361671.536546:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:1.0:1788361671.540738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361671.540803:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005952 00000100:00100000:2.0:1788361671.540860:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005952 00000100:00100000:2.0:1788361671.540998:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 878 00000100:00100000:2.0:1788361671.541010:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230407005952:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788361671.541034:0:66128:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d11054b800 x1875230407005952/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:732/0 lens 224/0 e 0 to 0 dl 1788361682 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361671.541203:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230407005952:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 Request processed in 194us (475us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361671.541226:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 878 00000020:00080000:0.0:1788361671.541363:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788361671.541368:0:90886:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:0.0:1788361671.541372:0:90886:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788361671.541375:0:90886:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788361671.541384:0:90886:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788361671.541386:0:90886:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788361671.541522:0:90886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:2.0:1788361671.543621:0:90855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00100000:2.0:1788361671.543632:0:90855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788361671.543655:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00010000:00010000:1.0:1788361671.543891:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.543905:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.543914:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.543921:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361671.543926:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.543934:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361671.543957:0:90886:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1788361671.543959:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.543987:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3407 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788361671.544001:0:90886:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788361671.544019:0:90886:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d136ed7800 x1875230429816960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:732/0 lens 224/0 e 0 to 0 dl 1788361682 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788361671.544021:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.544033:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.544039:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.544053:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361671.544056:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.544062:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.544072:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:1.0:1788361671.544076:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361671.544080:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.544086:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3415 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788361671.544163:0:90886:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.35@tcp: req@ffff99d11054b800 x1875230407005952/t0(0) o400->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:732/0 lens 224/0 e 0 to 0 dl 1788361682 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788361671.544236:0:90886:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788361671.544530:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788361671.544539:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d1012ad180 x1875230429816960/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361687 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.544549:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d1012ad180 x1875230429816960/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361687 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361671.544557:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788361671.544574:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788361671.544581:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1ed344c): req@ffff99d136ef3100 x1875230429798528/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361666 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361671.544600:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429816960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788361671.544647:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361671.544659:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429817088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361671.544708:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.544753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.544789:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817088 00000100:00100000:2.0:1788361671.544790:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429798528 00000100:00100000:2.0:1788361671.544798:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429798528 00000100:00100000:1.0:1788361671.544798:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817088 00000100:00100000:2.0:1788361671.544863:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00100000:2.0:1788361671.544872:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429798528:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361671.544895:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000004:00000024:2.0:1788361671.544900:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444978688 avail 1298739200 00000100:00100000:1.0:1788361671.544907:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3653:x1875230429817088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788361671.544930:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444978688 avail 1298739200 00000100:00100000:1.0:1788361671.544980:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3653:x1875230429817088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.544988:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000100:00100000:2.0:1788361671.545008:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429798528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.545016:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00000100:00100000:3.0:1788361671.545082:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429817088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361671.545107:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429798528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361671.547247:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361671.547469:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407005824 00000100:00100000:1.0:1788361671.547478:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407005824 00000100:00100000:1.0:1788361671.547538:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1221 00000100:00100000:1.0:1788361671.547548:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:69776:x1875230407005824:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361671.547577:0:66127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444978688 avail 1298739200 00000100:00100000:1.0:1788361671.547922:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:69776:x1875230407005824:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 374us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.547931:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1221 00000100:00100000:2.0:1788361671.549376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361671.549426:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006080 00000100:00100000:1.0:1788361671.549434:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006080 00000100:00100000:1.0:1788361671.549520:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1222 00000100:00100000:1.0:1788361671.549531:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:69776:x1875230407006080:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361671.549566:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361671.549660:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:69776:x1875230407006080:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.549668:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1222 00000100:00080000:2.0:1788361671.549710:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361671.551447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361671.551521:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006208 00000100:00100000:1.0:1788361671.551530:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006208 00000100:00100000:1.0:1788361671.551720:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1518 00000100:00100000:1.0:1788361671.551748:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+7:69776:x1875230407006208:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361671.551781:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361671.551858:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+7:69776:x1875230407006208:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 113us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.551864:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1518 00000100:00080000:2.0:1788361671.551912:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361671.553399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361671.553743:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006336 00000100:00100000:2.0:1788361671.553752:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006336 00000100:00080000:1.0:1788361671.553861:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361671.553996:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1519 00000100:00100000:2.0:1788361671.554006:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:69776:x1875230407006336:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361671.554034:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361671.554147:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:69776:x1875230407006336:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 141us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.554155:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1519 00000004:00000080:0.0:1788361671.563494:0:90886:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa0881c63e10 00100000:10000000:0.0:1788361671.563510:0:90886:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788361671.564740:0:90872:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:3.0:1788361671.564793:0:90872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90872:1875230429817216:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788361671.564893:0:90872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361671.564941:0:90872:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361671.564951:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817216 00000100:00100000:2.0:1788361671.564960:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817216 00000100:00100000:2.0:1788361671.565024:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904 00000100:00100000:2.0:1788361671.565036:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:90872:x1875230429817216:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788361671.565081:0:26170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -30 00002000:02000040:2.0:1788361671.565088:0:26170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1857) 00000004:00080000:1.0:1788361671.565399:0:90874:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:1.0:1788361671.565424:0:90874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90874:1875230429817344:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361671.565455:0:90874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.565493:0:90874:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361671.565909:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817344 00000100:00100000:3.0:1788361671.565915:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817344 00000100:00100000:3.0:1788361671.565960:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905 00000100:00100000:3.0:1788361671.565967:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:90874:x1875230429817344:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361671.565990:0:15123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -31 00002000:02000040:3.0:1788361671.565993:0:15123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1857) 00002000:00010000:2.0:1788361671.571366:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.571379:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571399:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.571405:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.571412:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571429:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571439:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571447:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571485:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361671.571598:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.571603:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571633:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.571637:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.571642:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571652:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571661:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571670:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571691:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361671.571733:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.571738:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571746:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.571749:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.571753:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571762:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571781:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571788:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571799:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788361671.571904:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.571909:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571917:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.571921:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.571924:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571934:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571941:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571948:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.571971:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788361671.572007:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.572011:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572018:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.572021:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.572025:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572034:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572041:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572049:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572056:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788361671.572089:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.572093:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572100:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.572108:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.572112:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572122:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572129:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572136:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572145:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788361671.572185:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.572190:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572197:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.572200:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.572204:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572212:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572219:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572235:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572244:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788361671.572281:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.572285:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572293:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.572295:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.572299:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572307:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572315:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572322:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572329:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788361671.572358:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.572363:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572376:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.572378:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.572383:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572391:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572400:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572407:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.572415:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788361671.572449:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.572514:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788361671.572523:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572532:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572536:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572546:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572564:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572572:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230ba0f8/0x1b69fa8920fe342a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572594:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788361671.572598:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572605:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572608:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572624:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572636:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572643:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a0ac359/0x1b69fa8920fe3431 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572659:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788361671.572663:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572670:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572673:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572681:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572691:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572699:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd71dc6f/0x1b69fa8920fe3438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572725:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788361671.572729:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572735:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572738:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572745:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572754:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572761:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe343f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572773:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788361671.572776:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572783:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572786:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572807:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572819:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572847:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa45de60/0x1b69fa8920fe3446 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572862:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788361671.572865:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572873:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572876:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572884:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572895:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.572900:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361671.572904:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe344d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.572909:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.572925:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.572931:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572942:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361671.572943:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572949:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.572960:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572961:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.572967:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.572975:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335cd30c/0x1b69fa8920fe3454 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572982:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.572996:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573005:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe345b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573013:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.573018:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573021:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.573025:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.573028:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.573031:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.573036:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573044:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573056:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573063:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3462 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573076:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.573078:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.573080:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573282:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573292:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.573295:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.573300:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573311:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573330:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573337:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573352:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361671.573359:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.573363:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573370:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.573373:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573374:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573384:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573384:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573397:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573404:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1e14928/0x1b69fa8920fe3469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573416:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573423:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573424:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361671.573500:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.573505:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573513:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.573516:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.573520:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573528:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573537:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573544:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573565:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.573591:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.573598:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.573599:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.573610:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573613:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.573620:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.573625:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.573625:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573634:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573639:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573665:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573667:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573687:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573689:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573710:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573717:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.573721:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573728:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.573734:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.573739:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573747:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.573751:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573760:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573771:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.573775:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.573782:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573799:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.573804:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573806:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.573813:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.573840:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573853:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.573855:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.573858:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.573861:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.573864:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573889:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573904:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361671.573931:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.573938:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.573946:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.573954:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573966:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.573969:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:1.0:1788361671.573972:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.573974:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00000001:00100000:0.0:1788361671.573978:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788361671.573984:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.573990:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574001:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574007:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574014:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574021:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe347e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574028:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574042:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.574047:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574049:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361671.574059:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eac00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.574063:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574066:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574074:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574087:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.574097:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361671.574101:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3485 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574114:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574121:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574125:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574128:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.574134:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.574138:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.574142:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574152:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574160:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574167:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574183:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361671.574200:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.574206:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574214:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.574218:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.574221:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.574232:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574234:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574249:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574250:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.574258:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.574267:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574268:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe348c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574291:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574296:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574299:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574310:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.574318:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574325:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574347:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361671.574383:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.574387:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574392:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.574395:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.574398:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574407:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574415:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574422:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574450:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361671.574490:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.574495:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574502:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eba00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.574505:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574513:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574524:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574531:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3493 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574557:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.574561:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574567:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.574570:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574578:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574588:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574596:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe349a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574607:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.574609:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.574611:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361671.574670:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.574675:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574683:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.574686:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.574690:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574698:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574706:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574713:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574763:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361671.574802:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.574808:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574815:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.574836:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.574839:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574845:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574851:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.574855:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574902:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361671.574904:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.574907:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574911:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574914:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eae00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.574922:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574924:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.574931:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574932:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574957:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574959:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.574975:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe34a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574978:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.574995:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574997:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.574999:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575001:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575004:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575007:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.575053:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361671.575058:0:26170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe34a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.575098:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361671.575109:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.575115:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575123:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.575125:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.575129:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575138:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575152:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575159:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575206:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361671.575245:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.575251:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575258:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.575261:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.575265:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575274:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575281:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575289:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575330:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.575335:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575342:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.575346:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575355:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575366:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575378:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe34af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575391:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.575394:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575400:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.575403:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575411:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575420:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575428:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575429:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575431:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.575474:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361671.575480:0:26170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e050963a/0x1b69fa8920fe34b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.575499:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361671.575534:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.575540:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575548:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.575551:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.575555:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575564:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575572:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575579:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575624:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361671.575662:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.575668:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575681:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.575684:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.575688:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575697:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575705:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575710:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575732:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.575735:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575739:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.575745:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575750:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575757:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575762:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d740f0d/0x1b69fa8920fe34bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575771:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.575772:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575776:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.575778:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575782:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575787:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.575790:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575795:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.575797:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.575895:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361671.575900:0:26170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe34c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.575900:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361671.575952:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.575957:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575965:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.575967:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.575971:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575987:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.575995:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576003:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576019:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.576045:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.576052:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576061:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad200 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361671.576062:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.576065:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576069:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576081:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576083:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.576091:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.576096:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576114:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576117:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576131:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576133:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001197c8ee/0x1b69fa8920fe34cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576164:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576171:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576174:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.576176:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576182:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361671.576183:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.576189:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.576204:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576211:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576223:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.576225:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.576235:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576243:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.576246:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.576252:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009faa24b5/0x1b69fa8920fe34d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576253:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576270:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576280:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576284:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576287:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.576290:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576291:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.576307:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.576315:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.576321:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576328:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.576330:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576336:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.576345:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.576345:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576356:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576365:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab4d824f/0x1b69fa8920fe34d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576380:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.576385:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.576388:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.576390:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576391:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576393:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.576404:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576412:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576419:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576439:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361671.576489:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.576494:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576501:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.576504:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.576508:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576517:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576535:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576542:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576558:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361671.576576:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.576582:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576590:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.576594:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361671.576595:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.576605:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576609:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576618:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.576623:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.576626:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576628:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576648:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1de362/0x1b69fa8920fe34e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576651:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576670:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576674:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.576682:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576683:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576704:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aace00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.576710:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576715:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.576719:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576732:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576740:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b68db703/0x1b69fa8920fe34e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576756:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788361671.576757:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.576761:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576763:0:26170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576781:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.576783:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:0.0:1788361671.576786:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576787:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.576795:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576800:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576808:0:26170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576815:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576818:0:26170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576847:0:26170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576854:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005181a206/0x1b69fa8920fe34ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.576864:0:26170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.576871:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.576876:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576882:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.576887:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788361671.576893:0:26170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00010000:00010000:0.0:1788361671.576896:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576909:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576917:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4731e9/0x1b69fa8920fe34f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.576929:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576931:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576933:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576939:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.576943:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361671.576997:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:90872:x1875230429817216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11960us (12101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.577008:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904 00000100:00100000:0.0:1788361671.577022:0:90872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90872:1875230429817216:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361671.577041:0:90872:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x723:0x0] 00010000:00010000:1.0:1788361671.577084:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361671.577110:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361671.577120:0:90872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90872:1875230429817600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361671.577125:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429817472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361671.577171:0:90872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.577172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361671.577202:0:90872:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d119c27240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361671.577227:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817600 00000100:00100000:0.0:1788361671.577313:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817600 00000100:00100000:0.0:1788361671.577362:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:0.0:1788361671.577370:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:90872:x1875230429817600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788361671.577409:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00000100:00100000:2.0:1788361671.577884:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817472 00000100:00100000:2.0:1788361671.577894:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817472 00000100:00100000:2.0:1788361671.577931:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:2.0:1788361671.577938:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429817472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361671.577952:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361671.577994:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429817472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361671.578000:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:1.0:1788361671.578365:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429817472:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1788361671.578790:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.578798:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.578810:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.578815:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.578855:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.578873:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.578896:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.578905:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.578962:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.579051:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.579055:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579061:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.579064:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.579066:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579074:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579078:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579083:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579328:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361671.579339:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579349:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.579354:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579364:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579379:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579392:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eab7829/0x1b69fa8920fe34fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579406:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361671.579411:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.579414:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579421:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fe600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.579425:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579432:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579454:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.579481:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.579509:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6234fd9/0x1b69fa8920fe3503 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579527:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.579531:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.579533:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361671.579750:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:90872:x1875230429817600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2378us (2580us total) trans 4294968750 rc 0/0 00000100:00100000:0.0:1788361671.579759:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00002000:00010000:3.0:1788361671.579778:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1788361671.579779:0:90872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90872:1875230429817600:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788361671.579790:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361671.579795:0:90872:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00010000:00010000:3.0:1788361671.579806:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.579811:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.579816:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579848:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579857:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579864:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.579893:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361671.579957:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.579963:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579970:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ff200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.579975:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579984:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.579996:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.580014:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005601585e/0x1b69fa8920fe350a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.580027:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.580028:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.580030:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361671.580101:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.580107:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580114:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.580122:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580127:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580136:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580145:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580154:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580167:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.580205:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.580209:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580216:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.580219:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580222:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580230:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788361671.580236:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788361671.580237:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580249:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580262:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361671.580268:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361671.580273:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580281:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.580284:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580292:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.580299:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.580303:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580304:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580311:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dddb817b/0x1b69fa8920fe3511 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580312:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.580315:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580319:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580324:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361671.580327:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580332:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580335:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580339:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361671.580343:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580344:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580363:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361671.580366:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580376:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580382:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067984d29/0x1b69fa8920fe3518 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580394:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788361671.580395:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.580397:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580400:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580404:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.580407:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580412:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.580415:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.580415:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580419:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580428:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580433:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580436:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580441:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a923bc/0x1b69fa8920fe351f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580444:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580452:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.580468:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580469:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361671.580474:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361671.580476:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580481:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580489:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580499:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.580503:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580509:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037598e69/0x1b69fa8920fe3526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.580511:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.580516:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580521:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580522:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.580524:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.580526:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580530:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580530:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.580538:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580551:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580558:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580575:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.580612:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.580613:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361671.580618:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580618:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580626:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.580626:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361671.580629:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.580629:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580633:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580638:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580642:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580648:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580650:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580656:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001437b739/0x1b69fa8920fe352d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580658:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580668:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580670:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580671:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.580682:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.580711:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.580717:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.580718:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.580726:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.580737:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361671.580740:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:0.0:1788361671.580743:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580744:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580750:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.580764:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580767:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580785:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.580790:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580794:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.580813:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001571f58d/0x1b69fa8920fe3534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580815:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361671.580840:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.580845:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.580850:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.580854:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580855:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.580857:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580860:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.580873:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.580878:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580880:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580885:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.580891:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580892:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580896:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580898:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10ab071/0x1b69fa8920fe353b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580905:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580912:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.580913:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.580914:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.580916:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.580921:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580933:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.580974:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.580978:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580986:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.580988:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.580992:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.580999:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581006:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581018:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581032:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361671.581052:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.581058:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581066:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.581070:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.581072:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788361671.581073:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.581079:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581081:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581091:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581093:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:2.0:1788361671.581093:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.581098:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581099:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.581106:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.581117:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581120:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581122:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.581131:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581133:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581149:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581151:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.581165:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000234abb59/0x1b69fa8920fe3549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581174:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.581187:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.581190:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.581193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.581194:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.581199:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.581204:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.581213:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.581215:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.581221:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581222:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581227:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581244:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581245:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.581253:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.581256:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3550 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581259:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581268:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.581270:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.581272:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.581273:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581283:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581291:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581305:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.581344:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.581349:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581357:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.581360:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.581364:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581374:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581391:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581398:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581414:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361671.581433:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.581439:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581447:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5200 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:3.0:1788361671.581451:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.581452:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581472:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581476:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581483:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.581490:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.581498:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581506:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581510:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581521:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3557 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581525:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581540:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581546:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.581550:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581575:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.581579:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581582:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.581590:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.581623:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.581629:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581637:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.581640:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.581645:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581655:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581656:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581673:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581676:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000058c4c79/0x1b69fa8920fe355e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581688:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581699:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361671.581709:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361671.581715:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.581731:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.581731:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.581735:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581739:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581752:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581754:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.581765:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.581766:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581770:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581783:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007480f659/0x1b69fa8920fe3565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581788:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581799:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581803:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.581810:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581811:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581847:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.581850:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.581854:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581861:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581873:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.581887:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.581888:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31826ca/0x1b69fa8920fe356c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581896:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581906:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:0.0:1788361671.581907:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361671.581911:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.581913:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581916:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581929:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361671.581935:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581935:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581959:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581960:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.581979:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.581980:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582000:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.582001:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3573 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582015:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.582018:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582025:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.582034:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.582041:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.582044:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582049:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582056:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582061:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:0.0:1788361671.582069:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe357a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582071:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.582083:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582091:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.582095:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582096:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582098:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.582107:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582109:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582119:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582139:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.582168:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.582175:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582184:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4a00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:3.0:1788361671.582189:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.582189:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582203:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582206:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582225:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582228:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.582232:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.582245:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582247:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f288e61f/0x1b69fa8920fe3581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582264:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582274:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582282:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582297:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.582317:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.582321:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582329:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.582333:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582342:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.582354:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.582356:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582365:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582368:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013a882f6/0x1b69fa8920fe3588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582382:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.582386:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.582389:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582391:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582394:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.582397:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.582405:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582406:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582426:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582433:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582447:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.582454:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.582476:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582484:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361671.582488:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582496:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.582501:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.582510:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582510:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582530:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:0.0:1788361671.582532:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ca7e83/0x1b69fa8920fe358f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582536:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.582544:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582551:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582555:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582555:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582564:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582568:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582574:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582602:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361671.582625:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361671.582631:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582638:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c600 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:3.0:1788361671.582642:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361671.582643:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582653:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582667:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.582674:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361671.582675:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582679:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582694:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582696:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582712:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047f1f352/0x1b69fa8920fe3596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361671.582726:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.582728:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.582729:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.582762:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.582764:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.582792:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582799:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582904:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.582946:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.582951:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582959:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.582974:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.582977:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361671.582979:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.582982:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582989:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.582989:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207cc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.582993:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.582997:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583001:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583005:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583012:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583017:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361671.583019:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe359d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583034:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.583042:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583049:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207da00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:3.0:1788361671.583052:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.583057:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583064:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.583067:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.583071:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583080:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583088:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583099:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583101:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583108:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583114:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361671.583119:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583126:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe35a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583139:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.583142:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583149:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c800 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:3.0:1788361671.583150:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361671.583152:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583155:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583163:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.583166:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361671.583166:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583171:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583180:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583187:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583189:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583195:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583200:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064155135/0x1b69fa8920fe35ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583207:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361671.583213:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.583216:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583222:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207de00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.583225:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583233:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.583238:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.583243:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583243:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583251:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006747d77/0x1b69fa8920fe35b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583255:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.583258:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.583262:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583262:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.583265:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.583271:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.583272:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583277:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.583280:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583288:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583342:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361671.583383:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.583389:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583397:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.583401:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.583405:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583414:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583431:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.583437:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583469:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361671.583473:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583480:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.583483:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583491:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.583492:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361671.583501:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583508:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.583514:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207ce00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361671.583521:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583522:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026fb14f6/0x1b69fa8920fe35b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.583547:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.583552:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.583555:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.583557:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.583566:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361671.583590:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.583592:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361671.583594:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361671.583856:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.583934:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361671.583939:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2c600d6/0x1b69fa8920fe35c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.583988:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.583993:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584000:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.584003:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.584007:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584015:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584022:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584040:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584070:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.584074:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584081:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207dc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.584085:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584101:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584113:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584122:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.584124:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.584125:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.584254:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361671.584261:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014cc7134/0x1b69fa8920fe35c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361671.584313:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361671.584318:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584325:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=2711s v=(0 0) 00010000:00010000:3.0:1788361671.584329:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361671.584333:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584341:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584348:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361671.584356:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584395:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361671.584400:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584406:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361671.584410:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584417:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584428:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361671.584435:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.584437:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361671.584446:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361671.584485:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361671.584490:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079ed0e54/0x1b69fa8920fe35ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788361671.584529:0:15123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:3.0:1788361671.584639:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:90874:x1875230429817344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18667us (19178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.584648:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905 00010000:00010000:1.0:1788361671.584717:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361671.584815:0:90874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90874:1875230429817344:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788361671.584844:0:90874:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:1.0:1788361671.584895:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361671.584898:0:90874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90874:1875230429817856:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361671.584916:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429817728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361671.584929:0:90874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361671.584954:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361671.584956:0:90874:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d119c27240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361671.584993:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817728 00000100:00100000:1.0:1788361671.584998:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817728 00000100:00100000:2.0:1788361671.585049:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817856 00000100:00100000:2.0:1788361671.585053:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817856 00000100:00100000:2.0:1788361671.585080:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907 00000100:00100000:2.0:1788361671.585088:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:90874:x1875230429817856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788361671.585119:0:26165:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00000100:00100000:2.0:1788361671.586538:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:90874:x1875230429817856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1447us (1604us total) trans 4294968752 rc 0/0 00000100:00100000:2.0:1788361671.586546:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907 00000100:00100000:1.0:1788361671.586683:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1788361671.586695:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429817728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361671.586712:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361671.586763:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429817728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.586771:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1788361671.586884:0:90874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90874:1875230429817856:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361671.586897:0:90874:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00000100:00100000:2.0:1788361671.586984:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429817728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788361671.768587:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361672.023816:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788361672.583615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361672.583665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361672.583803:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006464 00000100:00100000:0.0:1788361672.583814:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006464 00000100:00100000:0.0:1788361672.583896:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:0.0:1788361672.583908:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10ae90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230407006464:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361672.583915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361672.583943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361672.583985:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10ae90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230407006464:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361672.584010:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:0.0:1788361672.584060:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006976 00000100:00100000:0.0:1788361672.584064:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006976 00000100:00100000:0.0:1788361672.584090:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1870 00000100:00100000:0.0:1788361672.584097:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230407006976:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361672.584125:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230407006976:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361672.584132:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1870 00000100:00100000:3.0:1788361672.584205:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361672.584250:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006848 00000100:00100000:0.0:1788361672.584255:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006848 00000100:00100000:1.0:1788361672.584268:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006720 00000100:00100000:1.0:1788361672.584278:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006720 00000100:00100000:0.0:1788361672.584282:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1871 00000100:00100000:0.0:1788361672.584291:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230407006848:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361672.584324:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230407006848:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361672.584330:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1871 00000100:00100000:2.0:1788361672.584477:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407006592 00000100:00100000:2.0:1788361672.584482:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407006592 00000100:00100000:2.0:1788361672.584518:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 879 00000100:00100000:2.0:1788361672.584526:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230407006720:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361672.584572:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+6:2409:x1875230407006720:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 47us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361672.584579:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 879 00000100:00100000:2.0:1788361672.584598:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 880 00000100:00100000:2.0:1788361672.584605:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230407006592:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361672.584634:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230407006592:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361672.584642:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 880 00010000:00010000:3.0:1788361672.791103:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361673.815281:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361674.126705:0:91435:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:3.0:1788361674.582858:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429817984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361674.582875:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429818112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361674.582938:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361674.582971:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361674.582992:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429817984 00000100:00100000:1.0:1788361674.583000:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429817984 00000100:00100000:0.0:1788361674.583020:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818112 00000100:00100000:0.0:1788361674.583027:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818112 00000100:00080000:2.0:1788361674.583034:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361674.583052:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361674.583074:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1788361674.583084:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1788361674.583089:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429817984:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361674.583097:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429818112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361674.583127:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788361674.583128:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361674.583195:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429817984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361674.583200:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429818112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361674.583207:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:3.0:1788361674.583360:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429817984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361674.583361:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429818112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361674.583416:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00010000:00010000:2.0:1788361674.838060:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361674.843606:0:91483:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1788361675.863064:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361676.228672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361676.228800:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407007104 00000100:00100000:1.0:1788361676.228809:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407007104 00000100:00100000:1.0:1788361676.228902:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1223 00000100:00100000:1.0:1788361676.228909:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+7:70245:x1875230407007104:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361676.228925:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361676.228945:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b200/0x1b69fa8920fe35d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710eaf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.229011:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.229022:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.229031:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361676.229074:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361676.229076:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361676.229093:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.229110:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b200/0x1b69fa8920fe35d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 9 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.229123:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.229130:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:1.0:1788361676.229133:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361676.229136:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166b400, rc 0) 00000100:00080000:2.0:1788361676.229430:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361676.229449:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:70245:x1875230407007104:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 538us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361676.229457:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1223 00000100:00100000:0.0:1788361676.234932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361676.235543:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407007232 00000100:00100000:2.0:1788361676.235554:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407007232 00000100:00100000:2.0:1788361676.235621:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1224 00000100:00100000:2.0:1788361676.235631:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:70245:x1875230407007232:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361676.235668:0:66128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444978688 avail 1298739200 00000100:00100000:2.0:1788361676.235746:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:70245:x1875230407007232:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 116us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.235754:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1224 00000100:00100000:3.0:1788361676.238071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361676.238140:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407007360 00000100:00100000:1.0:1788361676.238149:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407007360 00000100:00100000:1.0:1788361676.238241:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1225 00000100:00100000:1.0:1788361676.238253:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:70245:x1875230407007360:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361676.238287:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000100:00100000:1.0:1788361676.238350:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+6:70245:x1875230407007360:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361676.238357:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1225 00000100:00080000:2.0:1788361676.238445:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361676.240447:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361676.241048:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407007488 00000100:00100000:2.0:1788361676.241058:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407007488 00000100:00080000:1.0:1788361676.241127:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361676.241173:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1524 00000100:00100000:2.0:1788361676.241186:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+7:70245:x1875230407007488:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361676.241217:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361676.241295:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+7:70245:x1875230407007488:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 112us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.241302:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1524 00000100:00100000:0.0:1788361676.243079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361676.243168:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407007616 00000100:00100000:2.0:1788361676.243177:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407007616 00000100:00100000:2.0:1788361676.243294:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1525 00000100:00100000:2.0:1788361676.243303:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:70245:x1875230407007616:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361676.243330:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361676.243391:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec302d84-8f96-49d3-8682-aefc474f8448+6:70245:x1875230407007616:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.243412:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1525 00000100:00080000:1.0:1788361676.244018:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361676.262690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361676.262797:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407007872 00000100:00100000:1.0:1788361676.262808:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407007872 00000100:00100000:1.0:1788361676.262937:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1226 00000100:00100000:1.0:1788361676.262946:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:70261:x1875230407007872:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361676.262965:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361676.262987:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b200/0x1b69fa8920fe35e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710eb6 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263063:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263077:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263088:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263102:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263109:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263132:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263214:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263222:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263228:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263234:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263240:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371ffc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361676.263244:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263252:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263263:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:1.0:1788361676.263266:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361676.263270:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263276:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371ffc00/0x1b69fa8920fe35ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263290:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263302:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263308:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263313:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1371fea00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361676.263316:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263322:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263329:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d103a4c900) 00010000:00010000:1.0:1788361676.263332:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361676.263335:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263341:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1371fea00/0x1b69fa8920fe35f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263382:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b200/0x1b69fa8920fe35e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eb6 expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263392:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:1.0:1788361676.263394:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361676.263398:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b200/0x1b69fa8920fe35e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eb6 expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361676.263418:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d14166b200, rc 0) 00000100:00100000:1.0:1788361676.263482:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:70261:x1875230407007872:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 536us (805us total) trans 0 rc 301/301 00000100:00100000:1.0:1788361676.263489:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1226 00000100:00100000:0.0:1788361676.265166:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361676.265232:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407008000 00000100:00100000:2.0:1788361676.265241:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407008000 00000100:00100000:2.0:1788361676.265307:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1227 00000100:00100000:2.0:1788361676.265318:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:70261:x1875230407008000:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:2.0:1788361676.265407:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265422:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265432:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265447:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265454:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265461:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265528:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265537:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265544:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361676.265599:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:2.0:1788361676.265604:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361676.265615:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265629:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265636:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265642:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265648:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265654:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361676.265658:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265663:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265671:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:2.0:1788361676.265673:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361676.265676:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265680:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe35f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265709:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265713:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265716:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265719:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361676.265721:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265724:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265728:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d1214c3300) 00010000:00010000:2.0:1788361676.265729:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361676.265731:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265734:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe35ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265743:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265746:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265751:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265761:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361676.265764:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265770:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265778:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:2.0:1788361676.265780:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361676.265783:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361676.265789:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3606 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361676.265878:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:70261:x1875230407008000:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 561us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.265887:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1227 00000100:00100000:0.0:1788361676.277067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361676.277131:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407008256 00000100:00100000:3.0:1788361676.277157:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407008256 00000100:00100000:3.0:1788361676.277280:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1228 00000100:00100000:3.0:1788361676.277293:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:70264:x1875230407008256:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361676.277315:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361676.277337:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe360d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ebd expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277423:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277437:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277448:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277463:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277471:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277478:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277560:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277567:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277574:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277585:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.277589:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277609:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277621:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:3.0:1788361676.277624:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.277629:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277635:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ce00/0x1b69fa8920fe3614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277650:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277656:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277662:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277668:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.277670:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277677:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277694:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d13a135200) 00010000:00010000:3.0:1788361676.277697:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.277704:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277710:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe361b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277744:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe360d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ebd expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277755:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:3.0:1788361676.277757:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361676.277760:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe360d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ebd expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.277770:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207c400, rc 0) 00000100:00100000:3.0:1788361676.277881:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+8:70264:x1875230407008256:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 590us (822us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361676.277887:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1228 00000100:00100000:0.0:1788361676.280406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361676.280473:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407008384 00000100:00100000:3.0:1788361676.280482:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407008384 00000100:00100000:3.0:1788361676.280575:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1229 00000100:00100000:3.0:1788361676.280586:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:70264:x1875230407008384:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:3.0:1788361676.280655:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280670:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280694:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280709:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280717:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280724:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280787:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280795:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280801:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361676.280872:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1788361676.280876:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361676.280891:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280905:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280912:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280928:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280947:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280954:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.280958:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280965:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280976:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:3.0:1788361676.280979:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.280983:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.280990:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281000:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281004:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281009:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281013:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.281022:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281029:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281036:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d13a135300) 00010000:00010000:3.0:1788361676.281039:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.281042:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281046:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe3629 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281059:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281065:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281071:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281076:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207ca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.281079:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281085:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281093:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:3.0:1788361676.281096:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.281104:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.281110:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3630 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361676.281160:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:70264:x1875230407008384:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 577us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.281165:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1229 00000100:00100000:0.0:1788361676.294756:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361676.294949:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407008640 00000100:00100000:3.0:1788361676.294960:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407008640 00000100:00100000:3.0:1788361676.295016:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1230 00000100:00100000:3.0:1788361676.295027:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+8:70271:x1875230407008640:12345-192.168.204.35@tcp:101:md5sum.0 00010000:00010000:3.0:1788361676.295058:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361676.295078:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ec4 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295147:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295161:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295172:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295186:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295192:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295219:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295329:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe364c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295337:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe364c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295345:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe364c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361676.295354:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:3.0:1788361676.295453:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295461:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295467:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295474:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295479:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.295484:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295497:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295519:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:3.0:1788361676.295522:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.295526:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295532:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c200/0x1b69fa8920fe363e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295545:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295551:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295557:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295562:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361676.295565:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295570:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295576:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99d13a135300) 00010000:00010000:3.0:1788361676.295578:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361676.295581:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295586:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207d000/0x1b69fa8920fe3645 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295644:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ec4 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295656:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe364c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ec4 expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361676.295663:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:3.0:1788361676.295665:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361676.295668:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207c400, rc 0) 00000100:00100000:3.0:1788361676.295770:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:70271:x1875230407008640:12345-192.168.204.35@tcp:101:md5sum.0 Request processed in 744us (1021us total) trans 115964116993 rc 0/0 00000100:00100000:3.0:1788361676.295777:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1230 00000100:00100000:0.0:1788361676.304719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361676.304848:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407008768 00000100:00100000:3.0:1788361676.304858:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407008768 00002000:00100000:3.0:1788361676.304903:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff99d10695c700 x1875230407008768/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:737/0 lens 488/0 e 0 to 0 dl 1788361687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361676.304914:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d10695c700 with x1875230407008768 ext(0->32767) 00002000:00010000:3.0:1788361676.304920:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d10695c700 00000100:00100000:3.0:1788361676.304987:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 598 00000100:00100000:3.0:1788361676.304996:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407008768:12345-192.168.204.35@tcp:3:md5sum.0 00000100:00100000:3.0:1788361676.307044:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec302d84-8f96-49d3-8682-aefc474f8448+7:2411:x1875230407008768:12345-192.168.204.35@tcp:3:md5sum.0 Request processed in 2033us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.307054:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 598 00002000:00100000:3.0:1788361676.307065:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff99d10695c700 x1875230407008768/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:737/0 lens 488/440 e 0 to 0 dl 1788361687 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361676.307089:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d10695c700 with x1875230407008768 ext(0->32767) 00002000:00010000:3.0:1788361676.307094:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d10695c700 00000100:00100000:1.0:1788361676.316700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361676.317150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361676.317314:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407008896 00000100:00100000:2.0:1788361676.317325:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407008896 00002000:00100000:2.0:1788361676.317389:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff99d136b59880 x1875230407008896/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:737/0 lens 488/0 e 0 to 0 dl 1788361687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361676.317400:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b59880 with x1875230407008896 ext(32768->1048575) 00002000:00010000:2.0:1788361676.317406:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b59880 00000100:00100000:2.0:1788361676.317433:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009024 00000100:00100000:2.0:1788361676.317436:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009024 00002000:00100000:2.0:1788361676.317452:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff99d1172c2680 x1875230407009024/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:737/0 lens 488/0 e 0 to 0 dl 1788361687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361676.317480:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1172c2680 with x1875230407009024 ext(1048576->2097151) 00002000:00010000:2.0:1788361676.317484:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d1172c2680 00000100:00100000:2.0:1788361676.317513:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 599 00000100:00100000:2.0:1788361676.317521:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ec302d84-8f96-49d3-8682-aefc474f8448+7:2412:x1875230407008896:12345-192.168.204.35@tcp:3:md5sum.0 00000100:00100000:3.0:1788361676.317809:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 600 00000100:00100000:3.0:1788361676.317816:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407009024:12345-192.168.204.35@tcp:3:md5sum.0 00000100:00100000:2.0:1788361676.319909:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ec302d84-8f96-49d3-8682-aefc474f8448+7:2412:x1875230407008896:12345-192.168.204.35@tcp:3:md5sum.0 Request processed in 2382us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.319921:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 599 00002000:00100000:2.0:1788361676.319931:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff99d136b59880 x1875230407008896/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:737/0 lens 488/440 e 0 to 0 dl 1788361687 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361676.319941:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b59880 with x1875230407008896 ext(32768->1048575) 00002000:00010000:2.0:1788361676.319946:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b59880 00000100:00100000:1.0:1788361676.327781:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ec302d84-8f96-49d3-8682-aefc474f8448+6:2412:x1875230407009024:12345-192.168.204.35@tcp:3:md5sum.0 Request processed in 9942us (10608us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361676.327796:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 600 00002000:00100000:1.0:1788361676.327810:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff99d1172c2680 x1875230407009024/t0(0) o3->ec302d84-8f96-49d3-8682-aefc474f8448@192.168.204.35@tcp:737/0 lens 488/440 e 0 to 0 dl 1788361687 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361676.327841:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1172c2680 with x1875230407009024 ext(1048576->2097151) 00002000:00010000:1.0:1788361676.327848:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d1172c2680 00000100:00100000:3.0:1788361676.333775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361676.333869:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009280 00000100:00100000:1.0:1788361676.333877:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009280 00000100:00100000:1.0:1788361676.333928:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 229 00000100:00100000:1.0:1788361676.333948:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:70271:x1875230407009280:12345-192.168.204.35@tcp:35:md5sum.0 00000100:00100000:1.0:1788361676.334378:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ec302d84-8f96-49d3-8682-aefc474f8448+11:70271:x1875230407009280:12345-192.168.204.35@tcp:35:md5sum.0 Request processed in 431us (608us total) trans 115964116994 rc 0/0 00000100:00100000:1.0:1788361676.334386:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 229 00000100:00100000:1.0:1788361676.630788:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361676.630847:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429818496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361676.630921:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361676.630967:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429818368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361676.630985:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818496 00000100:00100000:3.0:1788361676.631000:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818496 00000100:00100000:1.0:1788361676.631013:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361676.631089:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818368 00000100:00100000:3.0:1788361676.631094:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818368 00000100:00100000:1.0:1788361676.631105:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00100000:1.0:1788361676.631130:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429818496:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361676.631138:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00100000:3.0:1788361676.631155:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429818368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788361676.631191:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445347328 avail 1299107840 00000004:00000024:3.0:1788361676.631199:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444978688 avail 1298739200 00000100:00100000:1.0:1788361676.631259:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429818496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361676.631272:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00000100:00100000:3.0:1788361676.631283:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429818368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.631293:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000100:00100000:3.0:1788361676.631370:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361676.631375:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429818496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361676.631393:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429818240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361676.631404:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429818368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361676.631441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361676.631550:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818240 00000100:00100000:2.0:1788361676.631559:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818240 00000100:00100000:2.0:1788361676.631612:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1788361676.631620:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429818240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361676.631639:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361676.631645:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361676.631659:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429818624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361676.631699:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429818240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.631711:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361676.631723:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1788361676.631753:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818624 00000100:00100000:2.0:1788361676.631758:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818624 00000100:00100000:2.0:1788361676.631800:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1788361676.631814:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429818240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361676.631815:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429818624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361676.631865:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1788361676.631889:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361676.631898:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361676.631932:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429818624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.631940:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1788361676.631967:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429818624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361676.633796:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429818752:0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.633868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361676.633902:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818752 00000100:00100000:3.0:1788361676.633908:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429819264:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.633910:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818752 00000100:00100000:3.0:1788361676.633937:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361676.633957:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429819776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.633973:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788361676.633978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361676.633987:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429818752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.634000:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788361676.634007:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429819136:0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.634043:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361676.634054:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429818752:12345-0@lo:400:kworker.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.634062:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429819648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.634065:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788361676.634086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361676.634115:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429818752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.634118:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819264 00000100:00100000:2.0:1788361676.634123:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819264 00000100:00100000:3.0:1788361676.634144:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819776 00000100:00100000:3.0:1788361676.634149:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819776 00000100:00100000:2.0:1788361676.634165:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819136 00000100:00100000:2.0:1788361676.634170:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819136 00000100:00100000:3.0:1788361676.634181:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819648 00000100:00100000:3.0:1788361676.634185:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819648 00000100:00100000:2.0:1788361676.634195:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1788361676.634205:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429819264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.634210:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1788361676.634220:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429819776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.634256:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429819264:12345-0@lo:400:kworker.0 Request processed in 53us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.634265:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1788361676.634270:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429819776:12345-0@lo:400:kworker.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.634278:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1788361676.634285:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1788361676.634295:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429819136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.634298:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1788361676.634310:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429819648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.634368:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429819136:12345-0@lo:400:kworker.0 Request processed in 64us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.634376:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00080000:2.0:1788361676.634397:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361676.634402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361676.634411:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429819008:0@lo:400:kworker.0 00000100:00100000:0.0:1788361676.634536:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875230429818880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.636229:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429819648:12345-0@lo:400:kworker.0 Request processed in 1917us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.636255:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1788361676.636417:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429819136:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.636443:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429819648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.636456:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429819264:0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.636470:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429819776:0@lo:400:kworker.0 00000100:00100000:0.0:1788361676.638280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361676.638448:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429819392:0@lo:400:kworker.0 00000100:00100000:0.0:1788361676.638481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361676.638541:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361676.639082:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819392 00000100:00100000:3.0:1788361676.639091:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819392 00000100:00100000:3.0:1788361676.639319:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1788361676.639327:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429819392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.640166:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429819392:12345-0@lo:400:kworker.0 Request processed in 836us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.640175:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1788361676.640526:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429819392:0@lo:400:kworker.0 00000100:00080000:0.0:1788361676.640597:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361676.641444:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429818880 00000100:00100000:2.0:1788361676.641452:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429818880 00000100:00100000:2.0:1788361676.641508:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819008 00000100:00100000:2.0:1788361676.641511:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819008 00000100:00100000:2.0:1788361676.641533:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1788361676.641541:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875230429818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.641593:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875230429818880:12345-0@lo:400:kworker.0 Request processed in 53us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.641599:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1788361676.641611:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1788361676.641617:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361676.641642:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429819008:12345-0@lo:400:kworker.0 Request processed in 25us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.641647:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1788361676.641674:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875230429818880:0@lo:400:kworker.0 00000100:00080000:0.0:1788361676.641881:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361676.641885:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361676.644470:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429819008:0@lo:400:kworker.0 00000100:00100000:1.0:1788361676.644486:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429819520:0@lo:400:kworker.0 00000100:00100000:1.0:1788361676.644539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361676.644845:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819520 00000100:00100000:3.0:1788361676.644852:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819520 00000100:00100000:3.0:1788361676.644914:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1788361676.644922:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429819520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361676.644971:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429819520:12345-0@lo:400:kworker.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361676.644978:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00080000:0.0:1788361676.645039:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361676.645415:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429819520:0@lo:400:kworker.0 00010000:00010000:3.0:1788361676.885941:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361677.149586:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968750 is committed 00000001:00080000:2.0:1788361677.149702:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968752 is committed 00000100:00100000:0.0:1788361677.704936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361677.704998:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009536 00000100:00100000:0.0:1788361677.705001:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361677.705009:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009536 00000100:00100000:2.0:1788361677.705056:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009792 00000100:00100000:2.0:1788361677.705062:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009792 00000100:00100000:3.0:1788361677.705088:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 887 00000100:00100000:3.0:1788361677.705099:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+11:2409:x1875230407009536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361677.705178:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1874 00000100:00100000:3.0:1788361677.705184:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+11:2409:x1875230407009536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361677.705193:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230407009792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361677.705211:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 887 00000100:00100000:2.0:1788361677.705230:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ec302d84-8f96-49d3-8682-aefc474f8448+7:2409:x1875230407009792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361677.705246:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1874 00000100:00100000:0.0:1788361677.706091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361677.706128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361677.706207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361677.706231:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009920 00000100:00100000:0.0:1788361677.706235:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009920 00000100:00100000:0.0:1788361677.706268:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1875 00000100:00100000:0.0:1788361677.706277:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230407009920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361677.706329:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230407009920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361677.706350:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1875 00000100:00100000:2.0:1788361677.706485:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009408 00000100:00100000:2.0:1788361677.706489:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009408 00000100:00100000:2.0:1788361677.706542:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:2.0:1788361677.706549:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230407009408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361677.706583:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2410:x1875230407009408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361677.706601:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:3.0:1788361677.707332:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407009664 00000100:00100000:3.0:1788361677.707355:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407009664 00000100:00100000:3.0:1788361677.707432:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 888 00000100:00100000:3.0:1788361677.707441:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230407009664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361677.707549:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+6:2410:x1875230407009664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 108us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361677.707558:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 888 00010000:00010000:0.0:1788361677.910174:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788361678.169108:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00010000:00010000:2.0:1788361678.934389:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361679.352672:0:91677:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 11:07:58 (1788361678) 00000100:00100000:0.0:1788361679.397155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361679.397717:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010176 00000100:00100000:2.0:1788361679.397727:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010176 00000100:00080000:0.0:1788361679.397784:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361679.397849:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1231 00000100:00100000:2.0:1788361679.397861:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+6:70848:x1875230407010176:12345-192.168.204.35@tcp:36:mkdir.0 00000100:00100000:2.0:1788361679.397985:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:67579:1875230429819904:0@lo:900:mdt00_004.0 00000100:00100000:2.0:1788361679.398031:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.398061:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.398070:0:66137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429819904 00000100:00100000:0.0:1788361679.398075:0:66137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429819904 00000100:00100000:0.0:1788361679.398190:0:66137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361679.398198:0:66137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:67579:x1875230429819904:12345-0@lo:900:mdt00_004.0 00000100:00100000:0.0:1788361679.398788:0:66137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:67579:x1875230429819904:12345-0@lo:900:mdt00_004.0 Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.398798:0:66137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361679.399543:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:67579:1875230429819904:0@lo:900:mdt00_004.0 00000100:00100000:2.0:1788361679.399616:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820032:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.399660:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.399696:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.399854:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820032 00000100:00100000:0.0:1788361679.399860:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820032 00000100:00100000:0.0:1788361679.400012:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00100000:0.0:1788361679.400021:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820032:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.400189:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820032:12345-0@lo:1000:mdt00_004.0 Request processed in 168us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.400198:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000100:00100000:2.0:1788361679.400354:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820032:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.400439:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820160:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.400464:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.400491:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.400561:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820160 00000100:00100000:0.0:1788361679.400566:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820160 00000100:00100000:0.0:1788361679.400603:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00100000:0.0:1788361679.400609:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.400686:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820160:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.400704:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000100:00100000:2.0:1788361679.400714:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820160:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.400760:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820288:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.400786:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.400809:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.400878:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820288 00000100:00100000:0.0:1788361679.400883:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820288 00000100:00100000:0.0:1788361679.401171:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:0.0:1788361679.401178:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.401249:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820288:12345-0@lo:1000:mdt00_004.0 Request processed in 72us (462us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361679.401256:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:2.0:1788361679.401524:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820288:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788361679.401871:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.401882:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.401893:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361679.402085:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820416:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788361679.402118:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361679.402182:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10af8e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361679.402220:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820416 00000100:00100000:2.0:1788361679.402225:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820416 00000100:00100000:2.0:1788361679.402261:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:2.0:1788361679.402268:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:67579:x1875230429820416:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788361679.402279:0:23938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361679.402294:0:23938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe365a expref: -99 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.402333:0:23938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.402344:0:23938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 7 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.402370:0:23938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.402382:0:23938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 8 pid: 67579 timeout: 2819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361679.402401:0:23938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23938:1875230429820544:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361679.402553:0:23938:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004787900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.405730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361679.406214:0:23938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23938:1875230429820544:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361679.406249:0:23938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 7 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.406262:0:23938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:2.0:1788361679.406266:0:23938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361679.406270:0:23938:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 7 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.406282:0:23938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aada00, rc 0) 00000100:00100000:2.0:1788361679.406360:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:67579:x1875230429820416:12345-0@lo:101:mdt00_004.0 Request processed in 4091us (4240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.406371:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000100:00100000:1.0:1788361679.406729:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010304 00000100:00100000:1.0:1788361679.406737:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010304 00010000:00010000:1.0:1788361679.406778:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 9 pid: 67579 timeout: 2819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361679.406779:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820416:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1788361679.406811:0:67579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361679.406819:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2589 00010000:00010000:0.0:1788361679.406847:0:67579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361679.406854:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec302d84-8f96-49d3-8682-aefc474f8448+9:2409:x1875230407010304:12345-192.168.204.35@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1788361679.406886:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361679.406940:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361679.406954:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 9 pid: 67579 timeout: 2819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.406967:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 9 pid: 67579 timeout: 2819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.406989:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d14166b400/0x1b69fa8920fe35dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eaf expref: 9 pid: 67579 timeout: 2819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407001:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:1.0:1788361679.407006:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 6 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407015:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 6 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407024:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 6 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407055:0:8456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 6 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361679.407068:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8456:1875230429820672:0@lo:105: 00000100:00100000:1.0:1788361679.407109:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361679.407164:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361679.407243:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820672 00000100:00100000:2.0:1788361679.407249:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820672 00000100:00100000:2.0:1788361679.407275:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788361679.407348:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8456:x1875230429820672:12345-0@lo:105: 00010000:00010000:2.0:1788361679.407359:0:10345:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.407369:0:10345:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.407389:0:10345:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.407397:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.407404:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.407430:0:10345:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.407457:0:10345:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d00207d000) 00000100:00100000:2.0:1788361679.407493:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8456:x1875230429820672:12345-0@lo:105: Request processed in 147us (383us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361679.407514:0:67579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407525:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361679.407642:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788361679.407688:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407697:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.407708:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361679.407725:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820800:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1788361679.407773:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361679.407797:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361679.408036:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820800 00000100:00100000:1.0:1788361679.408042:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820800 00000100:00100000:1.0:1788361679.408090:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:2.0:1788361679.408103:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788361679.408104:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:67579:x1875230429820800:12345-0@lo:101:mdt00_004.0 00000100:00100000:2.0:1788361679.408144:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8456:1875230429820672:0@lo:105: 00010000:00010000:2.0:1788361679.408157:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361679.408192:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361679.408209:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3668 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.408230:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3668 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.408243:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3668 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.408250:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d103a4cb00) 00000100:00100000:2.0:1788361679.408254:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec302d84-8f96-49d3-8682-aefc474f8448+8:2409:x1875230407010304:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 1403us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.408268:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2589 00010000:00010000:1.0:1788361679.408375:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361679.408381:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e800, rc 0) 00000100:00100000:1.0:1788361679.408430:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429820800:12345-0@lo:101:mdt00_004.0 Request processed in 333us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361679.408437:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00000100:00100000:2.0:1788361679.408545:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820800:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788361679.408558:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.408580:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361679.408595:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1788361679.408636:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820928:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.408666:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.408691:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0047876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.408729:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429820928 00000100:00100000:0.0:1788361679.408734:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429820928 00000100:00100000:0.0:1788361679.408802:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00100000:0.0:1788361679.408811:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429820928:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.408907:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429820928:12345-0@lo:1000:mdt00_004.0 Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.408915:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00000100:00100000:2.0:1788361679.408992:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429820928:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.409035:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821056:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.409062:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.409082:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0047876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361679.409098:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821056 00000100:00100000:2.0:1788361679.409102:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821056 00000100:00100000:2.0:1788361679.409129:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129 00000100:00100000:2.0:1788361679.409136:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821056:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.409207:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821056:12345-0@lo:1000:mdt00_004.0 Request processed in 71us (146us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361679.409215:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129 00000100:00100000:2.0:1788361679.409241:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821056:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.409323:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821184:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.409346:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.409373:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0047876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361679.409386:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821184 00000100:00100000:2.0:1788361679.409389:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821184 00000100:00100000:0.0:1788361679.409665:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130 00000100:00100000:0.0:1788361679.409673:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821184:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.409749:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821184:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (401us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361679.409756:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130 00000100:00100000:2.0:1788361679.410408:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821184:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.410533:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821312:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.410562:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.410625:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0047876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.410658:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821312 00000100:00100000:0.0:1788361679.410663:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821312 00000100:00100000:0.0:1788361679.410704:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131 00000100:00100000:0.0:1788361679.410712:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.410818:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821312:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.410838:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1788361679.411093:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821312:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.411138:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821440:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361679.411161:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.411220:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0047876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.411253:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821440 00000100:00100000:0.0:1788361679.411258:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821440 00000100:00100000:0.0:1788361679.411326:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132 00000100:00100000:0.0:1788361679.411333:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821440:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.411396:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821440:12345-0@lo:1000:mdt00_004.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.411403:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132 00000100:00100000:1.0:1788361679.411427:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821440:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361679.411475:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821568:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361679.411506:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361679.411528:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821568 00000100:00100000:0.0:1788361679.411534:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821568 00000100:00100000:1.0:1788361679.411535:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.411559:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133 00000100:00100000:0.0:1788361679.411566:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821568:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361679.411611:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821568:12345-0@lo:1000:mdt00_004.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.411618:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133 00000100:00100000:1.0:1788361679.411961:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821568:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361679.412071:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821696:0@lo:700:mdt00_004.0 00000100:00100000:1.0:1788361679.412105:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361679.412138:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.412151:0:66136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821696 00000100:00100000:0.0:1788361679.412157:0:66136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821696 00000100:00100000:0.0:1788361679.412230:0:66136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361679.412237:0:66136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821696:12345-0@lo:700:mdt00_004.0 00000100:00100000:0.0:1788361679.412287:0:66136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429821696:12345-0@lo:700:mdt00_004.0 Request processed in 49us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.412294:0:66136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361679.412656:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429821696:0@lo:700:mdt00_004.0 00000040:00080000:1.0:1788361679.412757:0:67579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361679.412778:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].29, 64 off34624 00000004:00080000:1.0:1788361679.412787:0:67579:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d004adbb40 with version 5 00000040:00080000:1.0:1788361679.412874:0:67579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361679.412889:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].30, 64 off34688 00000004:00080000:0.0:1788361679.412890:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 5 rpc_version 5 00000004:00080000:1.0:1788361679.412898:0:67579:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d004adb300 with version 6 00000020:00100000:0.0:1788361679.412914:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788361679.412923:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d107789c00 x1875230429821952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361679.412939:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429821952:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788361679.412973:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361679.413024:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7af9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361679.413239:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429821952 00000100:00100000:2.0:1788361679.413245:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429821952 00000100:00100000:2.0:1788361679.413332:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134 00000100:00100000:2.0:1788361679.413341:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429821952:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1788361679.414971:0:67579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361679.415020:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400013a0:0x3:0x0].15, 64 off33728 00000040:00080000:1.0:1788361679.415674:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].1, 1000 off33768 00000040:00080000:1.0:1788361679.415790:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].1, 1152 off33920 00000004:00080000:1.0:1788361679.415799:0:67579:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d004adb180 with version 7 00000001:00080000:2.0:1788361679.419726:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00000100:00100000:0.0:1788361679.420032:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429821952:12345-0@lo:1000:osp_up0-1.0 Request processed in 6688us (7052us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1788361679.420045:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134 00000004:00080000:2.0:1788361679.420123:0:75530:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:2.0:1788361679.420129:0:75530:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000100:00100000:2.0:1788361679.420150:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429821952:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788361679.420178:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 6 rpc_version 6 00000020:00100000:2.0:1788361679.420206:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788361679.420213:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d1172a7800 x1875230429822208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361679.420234:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429822208:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788361679.420341:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.420407:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004787000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.420539:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429822208 00000100:00100000:0.0:1788361679.420547:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429822208 00000100:00100000:0.0:1788361679.420689:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135 00000100:00100000:0.0:1788361679.420699:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429822208:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1788361679.425414:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00000100:00100000:0.0:1788361679.425631:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429822208:12345-0@lo:1000:osp_up0-1.0 Request processed in 4927us (5283us total) trans 115964116996 rc 0/0 00000100:00100000:0.0:1788361679.425647:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135 00000004:00080000:2.0:1788361679.425663:0:75530:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116996 committed transno 115964116996 00000100:00100000:2.0:1788361679.425676:0:75530:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000100:00100000:2.0:1788361679.425701:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429822208:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788361679.425743:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 7 rpc_version 7 00000020:00100000:2.0:1788361679.425774:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788361679.425782:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d1172a7800 x1875230429822464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361679.425804:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429822464:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788361679.425863:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.425893:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004787480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.425931:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429822464 00000100:00100000:0.0:1788361679.425938:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429822464 00000100:00100000:0.0:1788361679.425983:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136 00000100:00100000:0.0:1788361679.425992:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429822464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788361679.428642:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75530:x1875230429822464:12345-0@lo:1000:osp_up0-1.0 Request processed in 2645us (2773us total) trans 115964116997 rc 0/0 00000100:00100000:0.0:1788361679.428664:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136 00000100:00100000:2.0:1788361679.428771:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429822464:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788361679.429027:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429071:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429087:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361679.429111:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f54188a reply state 000000006f42e78a transno 77309411440 ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429123:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429130:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:1.0:1788361679.429134:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361679.429138:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361679.429145:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00080000:1.0:1788361679.429153:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788361679.429166:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429175:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429182:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429214:0:67579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788361679.429220:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788361679.429226:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.429246:0:67579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361679.429369:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+8:70848:x1875230407010176:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 31509us (32284us total) trans 77309411440 rc 0/0 00000100:00100000:1.0:1788361679.429377:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1231 00010000:00010000:2.0:1788361679.430485:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361679.430492:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.430501:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d000 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:2.0:1788361679.430506:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361679.430512:0:8455:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.430583:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.430590:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361679.430636:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.430662:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d00207d000/0x1b69fa8920fe365a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3661 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.430683:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361679.430685:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361679.430687:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361679.430865:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361679.430886:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429822592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361679.430951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.431042:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429822592 00000100:00100000:2.0:1788361679.431049:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429822592 00000100:00100000:2.0:1788361679.431099:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1788361679.431106:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3651:x1875230429822592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361679.431118:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361679.431136:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe3661 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe365a expref: 9 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.431159:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c300) 00010000:00010000:2.0:1788361679.431166:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361679.431209:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3651:x1875230429822592:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.431214:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1788361679.431322:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429822592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361679.441287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361679.441349:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010432 00000100:00100000:3.0:1788361679.441360:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010432 00000100:00100000:3.0:1788361679.441425:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1232 00000100:00100000:3.0:1788361679.441436:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+8:70853:x1875230407010432:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361679.441456:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361679.441479:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe367d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ecb expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.441541:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3684 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.441561:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.441572:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361679.441621:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361679.441625:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361679.441644:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.441666:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207dc00/0x1b69fa8920fe367d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ecb expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.441681:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ecb expref: 9 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.441689:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d13a135200) 00010000:00010000:3.0:1788361679.441691:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361679.441695:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207ca00, rc 0) 00000100:00100000:3.0:1788361679.441757:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010432:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 323us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361679.441763:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1232 00000100:00100000:3.0:1788361679.444060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361679.444189:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010560 00000100:00100000:2.0:1788361679.444200:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010560 00000100:00100000:2.0:1788361679.444345:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1233 00000100:00100000:2.0:1788361679.444357:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010560:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361679.444376:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361679.444396:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe368b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ed2 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444472:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444485:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444496:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444506:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444514:0:66127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3668 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444522:0:66127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.444557:0:66127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3668 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361679.444574:0:66127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66127:1875230429822720:0@lo:104: 00000100:00100000:2.0:1788361679.444619:0:66127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.445194:0:66127:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004787480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361679.445645:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429822720 00000100:00100000:0.0:1788361679.445653:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429822720 00000100:00100000:0.0:1788361679.445704:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788361679.445713:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66127:x1875230429822720:12345-0@lo:104: 00010000:00010000:0.0:1788361679.445728:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.445931:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361679.445938:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66127:x1875230429822720:12345-0@lo:104: Request processed in 227us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.445945:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788361679.446244:0:66127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66127:1875230429822720:0@lo:104: 00010000:00010000:2.0:1788361679.446276:0:66127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.446280:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361679.446288:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.446297:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e400 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:1.0:1788361679.446313:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361679.446323:0:6511:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.446359:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.446366:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361679.446397:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.446417:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d11785e400/0x1b69fa8920fe3668 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe366f expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361679.446419:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361679.446437:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429822848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361679.446440:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361679.446444:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361679.446445:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361679.446475:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361679.446876:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429822848 00000100:00100000:1.0:1788361679.446881:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429822848 00010000:00010000:1.0:1788361679.446902:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b69fa8920fe3668 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361679.446930:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1788361679.446937:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3650:x1875230429822848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361679.446948:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1788361679.449667:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00010000:00010000:3.0:1788361679.450005:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d11785e800/0x1b69fa8920fe366f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3668 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.450024:0:19648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d103a4cb00) 00010000:00010000:3.0:1788361679.450036:0:19648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.450046:0:19648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.450051:0:19648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.450085:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361679.450124:0:66127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.450136:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361679.450239:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429822848:12345-0@lo:103:ldlm_bl.0 Request processed in 3300us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361679.450250:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1788361679.450274:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429822848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361679.450302:0:66127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66127:1875230429822976:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361679.450365:0:66127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.450398:0:66127:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004787cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361679.450413:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429822976 00000100:00100000:3.0:1788361679.450420:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429822976 00000100:00100000:3.0:1788361679.450463:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137 00000100:00100000:3.0:1788361679.450473:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66127:x1875230429822976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788361679.450562:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66127:x1875230429822976:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361679.450570:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137 00000100:00100000:2.0:1788361679.450601:0:66127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66127:1875230429822976:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788361679.450651:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe36a0 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.450664:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe36a0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.450674:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe36a0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361679.450964:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe36a0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.450981:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.450987:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.450995:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451001:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451013:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aaca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361679.451018:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451026:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451038:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d13a135200) 00010000:00010000:2.0:1788361679.451047:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361679.451052:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451059:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe3692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451075:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451081:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451086:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451091:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361679.451095:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451103:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451126:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d103a4cb00) 00010000:00010000:2.0:1788361679.451128:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361679.451132:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451137:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe3699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451202:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe368b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ed2 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451226:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe36a0 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ed2 expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.451235:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d140d28400) 00010000:00010000:2.0:1788361679.451237:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361679.451240:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad400, rc 0) 00000100:00100000:2.0:1788361679.451321:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec302d84-8f96-49d3-8682-aefc474f8448+10:70853:x1875230407010560:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 6966us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.451329:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1233 00000100:00100000:0.0:1788361679.457032:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361679.457103:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010688 00000100:00100000:2.0:1788361679.457179:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010688 00000100:00100000:2.0:1788361679.457327:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1234 00000100:00100000:2.0:1788361679.457342:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:70853:x1875230407010688:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361679.457370:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361679.457393:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aadc00/0x1b69fa8920fe36a7 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ed9 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.457561:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac000/0x1b69fa8920fe36ae lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.457576:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac000/0x1b69fa8920fe36ae lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.457588:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac000/0x1b69fa8920fe36ae lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361679.457642:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788361679.457646:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788361679.457689:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aadc00/0x1b69fa8920fe36a7 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ed9 expref: 10 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.457725:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac000/0x1b69fa8920fe36ae lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ed9 expref: 9 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.457734:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:2.0:1788361679.457737:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788361679.457740:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac000, rc 0) 00000100:00100000:2.0:1788361679.457819:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010688:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 481us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.457898:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1234 00000100:00100000:1.0:1788361679.464258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361679.464402:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010816 00000100:00100000:3.0:1788361679.464417:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010816 00000100:00100000:3.0:1788361679.464501:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1235 00000100:00100000:3.0:1788361679.464514:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010816:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361679.464543:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361679.464574:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe36b5 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ee0 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.464773:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.464807:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465036:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465061:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465070:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465076:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465150:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465158:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465163:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465170:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465177:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361679.465182:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465190:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465211:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:3.0:1788361679.465214:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361679.465219:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465227:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36bc lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465243:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465249:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465254:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465259:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361679.465262:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465268:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465276:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d13a135100) 00010000:00010000:3.0:1788361679.465278:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361679.465280:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465286:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36c3 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465350:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe36b5 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ee0 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465361:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:3.0:1788361679.465364:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361679.465368:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe36b5 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ee0 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.465377:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207dc00, rc 0) 00000100:00100000:3.0:1788361679.465465:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010816:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 954us (1219us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361679.465472:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1235 00000100:00100000:2.0:1788361679.471710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361679.472238:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407010944 00000100:00100000:3.0:1788361679.472249:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407010944 00000100:00100000:3.0:1788361679.472321:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1236 00000100:00100000:3.0:1788361679.472332:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010944:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361679.472353:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361679.472375:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe36ca lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ee7 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472453:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472469:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472481:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472506:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472513:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472519:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472675:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472684:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 2/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472692:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472698:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361679.472703:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472712:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472727:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:3.0:1788361679.472730:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361679.472735:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472744:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe36d1 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472864:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472872:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472878:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472884:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361679.472887:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472894:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472903:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d13a135100) 00010000:00010000:3.0:1788361679.472980:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361679.472985:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.472991:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe36d8 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.473033:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe36ca lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ee7 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.473047:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:3.0:1788361679.473050:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361679.473062:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe36ca lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ee7 expref: 10 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.473072:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207dc00, rc 0) 00000100:00100000:3.0:1788361679.473143:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407010944:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 812us (1440us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361679.473155:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1236 00000100:00100000:1.0:1788361679.478392:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361679.478433:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407011072 00000100:00100000:1.0:1788361679.478443:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407011072 00000100:00100000:1.0:1788361679.478496:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1237 00000100:00100000:1.0:1788361679.478506:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+9:70853:x1875230407011072:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361679.478525:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361679.478549:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e400/0x1b69fa8920fe36df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710eee expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.481805:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f600/0x1b69fa8920fe36e6 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.481870:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f600/0x1b69fa8920fe36e6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.481884:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f600/0x1b69fa8920fe36e6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361679.481956:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788361679.481960:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361679.481981:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f600/0x1b69fa8920fe36e6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.482026:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e400/0x1b69fa8920fe36df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eee expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.482050:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f600/0x1b69fa8920fe36e6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eee expref: 10 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.482060:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:1.0:1788361679.482063:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361679.482066:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f600, rc 0) 00000100:00100000:1.0:1788361679.482138:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec302d84-8f96-49d3-8682-aefc474f8448+10:70853:x1875230407011072:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 3632us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361679.482148:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1237 00000100:00100000:3.0:1788361679.486638:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361679.486765:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407011328 00000100:00100000:1.0:1788361679.486779:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407011328 00000100:00100000:1.0:1788361679.487416:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1238 00000100:00100000:1.0:1788361679.487430:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+10:70853:x1875230407011328:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361679.487453:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361679.487488:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e400/0x1b69fa8920fe36ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ef5 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361679.487592:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788361679.487709:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e400/0x1b69fa8920fe36ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ef5 expref: 12 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.487725:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:1.0:1788361679.487729:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361679.487735:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e400/0x1b69fa8920fe36ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ef5 expref: 12 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.487767:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e400, rc 0) 00000100:00100000:1.0:1788361679.487892:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec302d84-8f96-49d3-8682-aefc474f8448+11:70853:x1875230407011328:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 461us (1341us total) trans 77309411441 rc 301/301 00000100:00100000:1.0:1788361679.487900:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1238 00000100:00100000:2.0:1788361679.490289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361679.490415:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407011584 00000100:00100000:0.0:1788361679.490428:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407011584 00000100:00100000:0.0:1788361679.490498:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1239 00000100:00100000:0.0:1788361679.490512:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+11:70853:x1875230407011584:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:0.0:1788361679.490583:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361679.490611:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f600/0x1b69fa8920fe36e6 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710eee expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.490630:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:0.0:1788361679.490642:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361679.490716:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.490732:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.490743:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.490759:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.490766:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.490773:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491596:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491607:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491616:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361679.491632:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001217e847 reply state 00000000d60c17c2 transno 77309411442 ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491644:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491662:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:0.0:1788361679.491664:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361679.491668:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788361679.491673:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1788361679.491681:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491688:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491696:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491702:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361679.491707:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491716:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491724:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:0.0:1788361679.491727:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361679.491731:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491737:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe36fb lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361679.491748:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001217e847 reply state 00000000d60c17c2 transno 77309411442 ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491769:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.491776:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d0010ec500) 00010000:00010000:0.0:1788361679.491779:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361679.491781:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788361679.492072:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ec302d84-8f96-49d3-8682-aefc474f8448+12:70853:x1875230407011584:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 1560us (1783us total) trans 77309411442 rc 0/0 00000100:00100000:0.0:1788361679.492094:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1239 00000100:00100000:2.0:1788361679.497319:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361679.497519:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407011840 00000100:00100000:1.0:1788361679.497530:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407011840 00000100:00100000:1.0:1788361679.497582:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 230 00000100:00100000:1.0:1788361679.497593:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+12:70853:x1875230407011840:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788361679.497842:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec302d84-8f96-49d3-8682-aefc474f8448+13:70853:x1875230407011840:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 250us (546us total) trans 77309411443 rc 0/0 00000100:00100000:1.0:1788361679.497850:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 230 00000100:00100000:3.0:1788361679.527767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361679.528435:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407012480 00000100:00100000:0.0:1788361679.528448:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407012480 00000100:00080000:1.0:1788361679.528513:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361679.528592:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4908 00000100:00100000:0.0:1788361679.528605:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+6:2408:x1875230407012480:12345-192.168.204.35@tcp:9:umount.0 00000020:00000080:0.0:1788361679.528647:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2fb5 00000020:00010000:0.0:1788361679.528656:0:26167:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d137ea0800: total 0 00000100:00100000:2.0:1788361679.528657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00080000:0.0:1788361679.528662:0:26167:0:(import.c:65:import_set_state_nolock()) ffff99d137ea6000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788361679.528704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000001:00000004:0.0:1788361679.528726:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968752 00000100:00100000:2.0:1788361679.528752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361679.528777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407012096 00000100:00100000:2.0:1788361679.528781:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407012096 00000100:00100000:2.0:1788361679.528814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407011968 00000100:00100000:2.0:1788361679.528817:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407011968 00000100:00100000:2.0:1788361679.528929:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407012224 00000100:00100000:2.0:1788361679.528933:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407012224 00000100:00100000:2.0:1788361679.528950:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 674 00000100:00100000:2.0:1788361679.528957:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f5c0251-1795-40ef-8392-cb147010b7b5+12:2409:x1875230407012096:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361679.528969:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361679.528989:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166b800/0x1b69fa8920fe33ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e93 expref: 12 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.529005:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361679.529060:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f5c0251-1795-40ef-8392-cb147010b7b5+11:2409:x1875230407012096:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.529071:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 674 00000100:00100000:0.0:1788361679.529072:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:ec302d84-8f96-49d3-8682-aefc474f8448+4:2408:x1875230407012480:12345-192.168.204.35@tcp:9:umount.0 Request processed in 467us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361679.529083:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4908 00000100:00100000:2.0:1788361679.529089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 675 00000100:00100000:2.0:1788361679.529097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f5c0251-1795-40ef-8392-cb147010b7b5+10:2409:x1875230407011968:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361679.529104:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00010000:0.0:1788361679.529109:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d137ea0800: total 0 00010000:00010000:2.0:1788361679.529115:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166a800/0x1b69fa8920fe33c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e9a expref: 10 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.529125:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361679.529136:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d137ea0800, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1788361679.529144:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f5c0251-1795-40ef-8392-cb147010b7b5+9:2409:x1875230407011968:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 47us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.529150:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 675 00000100:00100000:2.0:1788361679.529163:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 676 00002000:00010000:0.0:1788361679.529168:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1788361679.529174:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb atime from disk: 0 -> 1788361647 00000100:00100000:2.0:1788361679.529178:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f5c0251-1795-40ef-8392-cb147010b7b5+8:2409:x1875230407012224:12345-192.168.204.35@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1788361679.529179:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1788361679.529190:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361679.529202:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309400/0x1b69fa8920fe33c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ea1 expref: 8 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.529209:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361679.529227:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f5c0251-1795-40ef-8392-cb147010b7b5+7:2409:x1875230407012224:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 52us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.529233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 676 00010000:00010000:0.0:1788361679.529496:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeddfe49/0x1b69fa8920fe3136 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e70 expref: 3 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.529533:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d137ea0800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788361679.529548:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361679.529550:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361679.529552:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361679.534396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361679.534484:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407012864 00000100:00100000:1.0:1788361679.534495:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407012864 00000100:00100000:1.0:1788361679.534569:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4909 00000100:00100000:1.0:1788361679.534581:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:ec302d84-8f96-49d3-8682-aefc474f8448+7:2408:x1875230407012864:12345-192.168.204.35@tcp:9:umount.0 00000100:00080000:0.0:1788361679.534599:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788361679.534624:0:26172:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe2e26 00000020:00010000:1.0:1788361679.534632:0:26172:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d00541e000: total 0 00000100:00080000:1.0:1788361679.534636:0:26172:0:(import.c:65:import_set_state_nolock()) ffff99d005418800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361679.534701:0:26172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968750 00000020:00010000:3.0:1788361679.534843:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d00541e000: total 0 00010000:00010000:3.0:1788361679.534884:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d00541e000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788361679.534950:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8eeaae/0x1b69fa8920fe312f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e69 expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.534984:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a8332f/0x1b69fa8920fe313d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e77 expref: 6 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361679.535001:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d00541e000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788361679.535016:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361679.535019:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361679.535020:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361679.535063:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:ec302d84-8f96-49d3-8682-aefc474f8448+2:2408:x1875230407012864:12345-192.168.204.35@tcp:9:umount.0 Request processed in 483us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361679.535072:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4909 00000100:00100000:2.0:1788361679.541010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361679.541103:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407013376 00000100:00100000:3.0:1788361679.541115:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407013376 00000100:00100000:3.0:1788361679.541181:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1240 00000100:00100000:3.0:1788361679.541192:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+10:2408:x1875230407013376:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:3.0:1788361679.541236:0:66126:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3239 00000020:00010000:3.0:1788361679.541252:0:66126:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d116c04000: total 0 00000100:00080000:3.0:1788361679.541256:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d0021f8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361679.541347:0:66126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116997 00000100:00100000:3.0:1788361679.541526:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec302d84-8f96-49d3-8682-aefc474f8448+8:2408:x1875230407013376:12345-192.168.204.35@tcp:39:umount.0 Request processed in 335us (526us total) trans 115964116998 rc 0/0 00000100:00100000:3.0:1788361679.541534:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1240 00000020:00010000:2.0:1788361679.542169:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d116c04000: total 0 00010000:00010000:2.0:1788361679.542228:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d116c04000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788361679.542437:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d140d28400) 00010000:00010000:2.0:1788361679.542443:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361679.542510:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe36a0 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ed2 expref: 7 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.542548:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:2.0:1788361679.542551:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361679.542556:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3423 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710e62 expref: 6 pid: 90886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.542569:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d13a135200) 00010000:00010000:2.0:1788361679.542572:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361679.542576:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207ca00/0x1b69fa8920fe3684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ecb expref: 5 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.542608:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99d136764d00) 00010000:00010000:2.0:1788361679.542611:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361679.542615:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00207c400/0x1b69fa8920fe364c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ec4 expref: 4 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.542628:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d116c04000, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1788361679.542643:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361679.542646:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361679.542648:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361679.548927:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361679.549032:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407013632 00000100:00100000:3.0:1788361679.549084:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407013632 00000100:00100000:3.0:1788361679.549147:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1241 00000100:00100000:3.0:1788361679.549159:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+13:2408:x1875230407013632:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:3.0:1788361679.549200:0:66901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fdda6c 00000020:00010000:3.0:1788361679.549215:0:66901:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d0057c6800: total 0 00000100:00080000:3.0:1788361679.549219:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d11e632800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361679.549264:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788361679.549267:0:66901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411443 00010000:00010000:1.0:1788361679.549275:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.549281:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549324:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549331:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549336:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549341:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361679.549345:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549352:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549367:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d0010ec500) 00010000:00010000:2.0:1788361679.549370:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361679.549390:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549396:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916800/0x1b69fa8920fe3702 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549419:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549425:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549431:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361679.549435:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec302d84-8f96-49d3-8682-aefc474f8448+11:2408:x1875230407013632:12345-192.168.204.35@tcp:39:umount.0 Request processed in 278us (519us total) trans 77309411444 rc 0/0 00010000:00010000:2.0:1788361679.549436:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361679.549439:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361679.549443:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1241 00010000:00010000:2.0:1788361679.549445:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549452:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:2.0:1788361679.549454:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361679.549456:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361679.549462:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917800/0x1b69fa8920fe3709 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.549540:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785fc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361679.549544:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.549551:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.549560:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:1.0:1788361679.549563:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361679.549566:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.549572:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785fc00/0x1b69fa8920fe3676 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1788361679.549639:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d0057c6800: total 0 00010000:00010000:0.0:1788361679.549644:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361679.549702:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d0057c6800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361679.549727:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c800) 00010000:00010000:0.0:1788361679.549730:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788361679.549735:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac000/0x1b69fa8920fe36ae lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ed9 expref: 8 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361679.549753:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d0057c6800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788361679.549764:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361679.549766:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361679.549769:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361679.579243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361679.579402:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407013888 00000100:00100000:2.0:1788361679.579414:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407013888 00000100:00100000:2.0:1788361679.579514:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:2.0:1788361679.579545:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+7:2408:x1875230407013888:12345-192.168.204.35@tcp:251:umount.0 00000020:00000080:2.0:1788361679.579598:0:90862:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe32ef 00000020:00010000:2.0:1788361679.579607:0:90862:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d1171e7800: total 0 00000100:00080000:2.0:1788361679.579612:0:90862:0:(import.c:65:import_set_state_nolock()) ffff99d1171e0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788361679.579700:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f5c0251-1795-40ef-8392-cb147010b7b5+3:2408:x1875230407013888:12345-192.168.204.35@tcp:251:umount.0 Request processed in 156us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361679.579708:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000020:00010000:1.0:1788361679.579783:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d1171e7800: total 0 00010000:00010000:1.0:1788361679.579871:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d1171e7800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788361679.579906:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166b000/0x1b69fa8920fe33cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ea8 expref: 2 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361679.579922:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d1171e7800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788361679.579937:0:8454:0:(genops.c:906:class_export_put()) final put ffff99d1171e7800/1f5c0251-1795-40ef-8392-cb147010b7b5 00010000:00010000:1.0:1788361679.579951:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361679.579954:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361679.579956:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361679.579971:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e7800/1f5c0251-1795-40ef-8392-cb147010b7b5 for MGS 00000020:00000080:3.0:1788361679.580013:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1171e0000 for MGS 00000100:00100000:2.0:1788361679.702063:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361679.702089:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429823232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361679.702161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.702198:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429823104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361679.702219:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361679.702258:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823232 00000100:00100000:2.0:1788361679.702266:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823232 00000100:00100000:2.0:1788361679.702332:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823104 00000100:00100000:2.0:1788361679.702336:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823104 00000100:00100000:2.0:1788361679.702360:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1788361679.702369:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429823232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361679.702398:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361679.702435:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1788361679.702443:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429823232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361679.702445:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429823104:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361679.702451:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00002000:00000024:1.0:1788361679.702462:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788361679.702473:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361679.702477:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361679.702493:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429823104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361679.702499:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1788361679.702517:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429823232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361679.702533:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429823104:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788361679.963096:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361680.131003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.131174:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014016 00000100:00100000:0.0:1788361680.131187:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014016 00000100:00100000:0.0:1788361680.131238:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:0.0:1788361680.131249:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2408:x1875230407014016:12345-192.168.204.35@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788361680.131281:0:90861:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp t0 exp 0000000000000000 cur 2720 last 0 00000020:00000080:0.0:1788361680.131325:0:90861:0:(genops.c:1406:class_connect()) connect: client 3956ab41-635b-456b-967f-6c1073c5d2df, cookie 0x1b69fa8920fe3710 00000100:00080000:0.0:1788361680.131367:0:90861:0:(import.c:65:import_set_state_nolock()) ffff99d104f38000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361680.131433:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+5:2408:x1875230407014016:12345-192.168.204.35@tcp:250:mount.lustre.0 Request processed in 184us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.131448:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:3.0:1788361680.138494:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.138569:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014144 00000100:00100000:0.0:1788361680.138579:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014144 00000100:00100000:0.0:1788361680.138637:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:0.0:1788361680.138648:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+5:70876:x1875230407014144:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361680.138665:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361680.138682:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f0a expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.138709:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f0a expref: 6 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.138720:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f0a expref: 6 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.138729:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916a00, rc 0) 00000100:00100000:1.0:1788361680.140158:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+6:70876:x1875230407014144:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 1505us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.140173:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:0.0:1788361680.142382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.142461:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014272 00000100:00100000:1.0:1788361680.142471:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014272 00000100:00100000:1.0:1788361680.142564:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:1.0:1788361680.142577:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+6:70876:x1875230407014272:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361680.142709:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+6:70876:x1875230407014272:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 135us (333us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361680.142720:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:0.0:1788361680.149156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.149241:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014400 00000100:00100000:1.0:1788361680.149252:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014400 00000100:00100000:1.0:1788361680.149321:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:1.0:1788361680.149332:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+6:70876:x1875230407014400:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361680.149351:0:90862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361680.149371:0:90862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe371e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f11 expref: -99 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361680.149401:0:90862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f11 expref: 7 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361680.149413:0:90862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f11 expref: 7 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361680.149422:0:90862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f200, rc 0) 00000100:00100000:1.0:1788361680.149482:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+7:70876:x1875230407014400:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 152us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.149489:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:2.0:1788361680.151398:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.151573:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014528 00000100:00100000:1.0:1788361680.151584:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014528 00000100:00100000:1.0:1788361680.151637:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:1.0:1788361680.151647:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+7:70876:x1875230407014528:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361680.151815:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70876:x1875230407014528:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 169us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.151852:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:0.0:1788361680.153644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.153747:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014656 00000100:00100000:1.0:1788361680.153755:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014656 00000100:00100000:1.0:1788361680.153808:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:1.0:1788361680.153865:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70876:x1875230407014656:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361680.154000:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70876:x1875230407014656:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.154008:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:0.0:1788361680.156577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.156695:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014784 00000100:00100000:1.0:1788361680.156706:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014784 00000100:00100000:1.0:1788361680.156764:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 84 00000100:00100000:1.0:1788361680.156774:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70895:x1875230407014784:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361680.156979:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70895:x1875230407014784:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 205us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.156988:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 84 00000100:00100000:2.0:1788361680.174443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.174526:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407014912 00000100:00100000:1.0:1788361680.174539:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407014912 00000100:00100000:1.0:1788361680.174604:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 85 00000100:00100000:1.0:1788361680.174616:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70895:x1875230407014912:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361680.174875:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70895:x1875230407014912:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 207us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.174886:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 85 00000100:00100000:3.0:1788361680.177632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.177895:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015040 00000100:00100000:0.0:1788361680.177906:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015040 00000100:00100000:0.0:1788361680.177976:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:0.0:1788361680.177988:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+8:70895:x1875230407015040:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361680.178191:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+8:70895:x1875230407015040:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 206us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.178207:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:3.0:1788361680.181170:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.181403:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015168 00000100:00100000:0.0:1788361680.181412:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015168 00000100:00100000:0.0:1788361680.181471:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:0.0:1788361680.181481:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70876:x1875230407015168:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361680.181498:0:90859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361680.181521:0:90859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917800/0x1b69fa8920fe3725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f42 expref: -99 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.181619:0:90859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917800/0x1b69fa8920fe3725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f42 expref: 9 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.181632:0:90859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917800/0x1b69fa8920fe3725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f42 expref: 9 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.181641:0:90859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917800, rc 0) 00000100:00100000:0.0:1788361680.181724:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70876:x1875230407015168:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 244us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.181731:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:2.0:1788361680.184901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.185051:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015296 00000100:00100000:1.0:1788361680.185059:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015296 00000100:00100000:1.0:1788361680.185437:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 88 00000100:00100000:1.0:1788361680.185449:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70876:x1875230407015296:12345-192.168.204.35@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788361680.185479:0:90862:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788361680.185507:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788361680.185511:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788361680.185520:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788361680.185523:0:90862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788361680.185525:0:90862:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:1.0:1788361680.188445:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70876:x1875230407015296:12345-192.168.204.35@tcp:256:mount.lustre.0 Request processed in 2990us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.188460:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 88 00000100:00100000:3.0:1788361680.191218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.191300:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015424 00000100:00100000:0.0:1788361680.191310:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015424 00000100:00100000:0.0:1788361680.191424:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 89 00000100:00100000:0.0:1788361680.191435:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70876:x1875230407015424:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361680.191454:0:90859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361680.191474:0:90859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916800/0x1b69fa8920fe372c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f49 expref: -99 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.191524:0:90859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916800/0x1b69fa8920fe372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f49 expref: 10 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.191536:0:90859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916800/0x1b69fa8920fe372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f49 expref: 10 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361680.191556:0:90859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916800, rc 0) 00000100:00100000:0.0:1788361680.191619:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70876:x1875230407015424:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 186us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.191627:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 89 00000100:00100000:2.0:1788361680.192993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.193060:0:90862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015552 00000100:00100000:1.0:1788361680.193071:0:90862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015552 00000100:00100000:1.0:1788361680.193123:0:90862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:1.0:1788361680.193136:0:90862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70876:x1875230407015552:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361680.193269:0:90862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70876:x1875230407015552:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.193275:0:90862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:2.0:1788361680.194375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.194467:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015680 00000100:00100000:0.0:1788361680.194474:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015680 00000100:00100000:0.0:1788361680.194552:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:0.0:1788361680.194561:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70876:x1875230407015680:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361680.194672:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70876:x1875230407015680:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 105us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.194680:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:3.0:1788361680.196775:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.196959:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015808 00000100:00100000:0.0:1788361680.196968:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015808 00000100:00100000:0.0:1788361680.197059:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00100000:0.0:1788361680.197070:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70900:x1875230407015808:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361680.197258:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70900:x1875230407015808:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 190us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.197266:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00100000:2.0:1788361680.198521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.198635:0:90859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407015936 00000100:00100000:0.0:1788361680.198650:0:90859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407015936 00000100:00100000:0.0:1788361680.198736:0:90859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 93 00000100:00100000:0.0:1788361680.198745:0:90859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70900:x1875230407015936:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361680.198875:0:90859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70900:x1875230407015936:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.198884:0:90859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 93 00000100:00100000:2.0:1788361680.201480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361680.201512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.201572:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016064 00000100:00100000:0.0:1788361680.201582:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016064 00000100:00100000:0.0:1788361680.201689:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016320 00000100:00100000:0.0:1788361680.201694:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016320 00000100:00100000:3.0:1788361680.202084:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1242 00000100:00100000:3.0:1788361680.202094:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230407016064:12345-192.168.204.35@tcp:38:mount.lustre.0 00000100:00100000:2.0:1788361680.202098:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1243 00000100:00100000:2.0:1788361680.202108:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230407016320:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788361680.202130:0:66127:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2720 last 0 00000020:00000080:3.0:1788361680.202200:0:66127:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe3733 00000004:00100000:3.0:1788361680.202226:0:66127:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788361680.202346:0:66127:0:(import.c:65:import_set_state_nolock()) ffff99d0057f1800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1788361680.202400:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2720 last 0 00000100:00100000:3.0:1788361680.202410:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407016064:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 314us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361680.202420:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1242 00000020:00000080:2.0:1788361680.202439:0:66126:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe373a 00000004:00100000:2.0:1788361680.202453:0:66126:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788361680.202517:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d1054f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361680.202548:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407016320:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 439us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361680.202556:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1243 00000100:00100000:3.0:1788361680.205056:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361680.205096:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361680.205182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.205373:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016448 00000100:00100000:1.0:1788361680.205386:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016448 00000100:00100000:1.0:1788361680.205456:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016192 00000100:00100000:1.0:1788361680.205460:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016192 00000100:00080000:3.0:1788361680.205471:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361680.205476:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361680.205520:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016576 00000100:00100000:0.0:1788361680.205525:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016576 00000100:00100000:1.0:1788361680.205530:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1244 00000100:00100000:1.0:1788361680.205539:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:0:x1875230407016448:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361680.205582:0:66128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361680.205592:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1245 00000100:00100000:2.0:1788361680.205601:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:0:x1875230407016192:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788361680.205622:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1788361680.205663:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:0:x1875230407016448:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 125us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.205670:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1244 00000100:00100000:1.0:1788361680.205689:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1246 00000100:00100000:1.0:1788361680.205695:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70876:x1875230407016576:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361680.205706:0:66128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1788361680.205748:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70876:x1875230407016576:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 53us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.205755:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1246 00000100:00100000:2.0:1788361680.206040:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:0:x1875230407016192:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 439us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361680.206047:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1245 00000100:00100000:3.0:1788361680.207055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.207134:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016704 00000100:00100000:0.0:1788361680.207140:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016704 00000100:00100000:0.0:1788361680.207219:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1247 00000100:00100000:0.0:1788361680.207229:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70876:x1875230407016704:12345-192.168.204.35@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361680.207313:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70876:x1875230407016704:12345-192.168.204.35@tcp:40:mount.lustre.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.207321:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1247 00000100:00100000:3.0:1788361680.212202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361680.212242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361680.212275:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016832 00000100:00100000:3.0:1788361680.212311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361680.212313:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407016960 00000100:00100000:2.0:1788361680.212315:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016832 00000100:00100000:1.0:1788361680.212319:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407016960 00000100:00100000:1.0:1788361680.212361:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4910 00000100:00100000:1.0:1788361680.212369:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2408:x1875230407016960:12345-192.168.204.35@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788361680.212390:0:66137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017088 00000100:00100000:0.0:1788361680.212394:0:66137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017088 00010000:00080000:1.0:1788361680.212407:0:26165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2720 last 0 00000100:00100000:0.0:1788361680.212431:0:66137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:0.0:1788361680.212438:0:66137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70876:x1875230407017088:12345-192.168.204.35@tcp:900:mount.lustre.0 00000020:00000080:1.0:1788361680.212440:0:26165:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe3741 00002000:00100000:1.0:1788361680.212452:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f1e400d1-472b-42d1-b5e7-e80dc701272a/ffff99d136445000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361680.212463:0:26165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788361680.212514:0:66137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70876:x1875230407017088:12345-192.168.204.35@tcp:900:mount.lustre.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.212522:0:66137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00002000:00080000:1.0:1788361680.212535:0:26165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361680.212567:0:26165:0:(import.c:65:import_set_state_nolock()) ffff99d136447800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361680.212598:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407016960:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 230us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.212604:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4910 00000100:00100000:1.0:1788361680.212619:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4911 00000100:00100000:1.0:1788361680.212623:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2408:x1875230407016832:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788361680.212639:0:26165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2720 last 0 00000020:00000080:1.0:1788361680.212658:0:26165:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe3748 00002000:00100000:1.0:1788361680.212663:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1e400d1-472b-42d1-b5e7-e80dc701272a/ffff99d136ec1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361680.212669:0:26165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788361680.212702:0:26165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361680.212716:0:26165:0:(import.c:65:import_set_state_nolock()) ffff99d136ec7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361680.212752:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407016832:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 126us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361680.212759:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4911 00000100:00100000:3.0:1788361680.215242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361680.215376:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017216 00000100:00100000:0.0:1788361680.215389:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017216 00000100:00100000:0.0:1788361680.215473:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:0.0:1788361680.215484:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70876:x1875230407017216:12345-192.168.204.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788361680.215581:0:81013:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788361680.215662:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70876:x1875230407017216:12345-192.168.204.35@tcp:33:mount.lustre.0 Request processed in 181us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361680.215670:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 231 00010000:00010000:2.0:1788361680.982350:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361681.713796:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361681.713909:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017344 00000100:00100000:0.0:1788361681.713924:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017344 00000100:00100000:0.0:1788361681.714059:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1248 00000100:00100000:0.0:1788361681.714070:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017344:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788361681.714096:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361681.714122:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe374f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f7a expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361681.714191:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916600/0x1b69fa8920fe3756 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361681.714206:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916600/0x1b69fa8920fe3756 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361681.714219:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916600/0x1b69fa8920fe3756 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361681.714272:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788361681.714277:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361681.714302:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916600/0x1b69fa8920fe3756 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361681.714326:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe374f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 8 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361681.714365:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916600/0x1b69fa8920fe3756 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361681.714374:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec200) 00010000:00010000:0.0:1788361681.714377:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361681.714381:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916600, rc 0) 00000100:00100000:0.0:1788361681.714516:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70943:x1875230407017344:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 447us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361681.714523:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1248 00000100:00100000:1.0:1788361681.717917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361681.718021:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017472 00000100:00100000:2.0:1788361681.718032:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017472 00000100:00100000:2.0:1788361681.718096:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1249 00000100:00100000:2.0:1788361681.718106:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70943:x1875230407017472:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361681.718147:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1788361681.718249:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70943:x1875230407017472:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 143us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.718257:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1249 00000100:00100000:2.0:1788361681.719793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361681.719957:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017600 00000100:00100000:3.0:1788361681.719965:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017600 00000100:00100000:3.0:1788361681.720049:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1250 00000100:00100000:3.0:1788361681.720059:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017600:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361681.720090:0:66127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:3.0:1788361681.720142:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017600:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361681.720150:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1250 00000100:00100000:1.0:1788361681.723497:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361681.723567:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017728 00000100:00100000:2.0:1788361681.723578:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017728 00000100:00080000:3.0:1788361681.723641:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361681.723671:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1530 00000100:00100000:2.0:1788361681.723684:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017728:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361681.723720:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361681.723916:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017728:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 234us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.723924:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1530 00000100:00100000:1.0:1788361681.727063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361681.727170:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017856 00000100:00100000:2.0:1788361681.727181:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017856 00000100:00100000:2.0:1788361681.727367:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1531 00000100:00100000:2.0:1788361681.727380:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017856:12345-192.168.204.35@tcp:13:lfs.0 00000100:00080000:3.0:1788361681.727381:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788361681.727420:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361681.727489:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70943:x1875230407017856:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 113us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.727497:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1531 00000100:00100000:2.0:1788361681.750166:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429823488:0@lo:400:kworker.0 00000100:00100000:0.0:1788361681.750207:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429823744:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750297:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429823360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361681.750429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361681.750438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361681.750500:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429823616:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750641:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.750679:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429823872:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750704:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.750724:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429824384:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.750773:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429824896:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750794:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.750845:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788361681.750853:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429824512:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750875:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.750893:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429825024:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.750917:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.750994:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823360 00000100:00100000:1.0:1788361681.751005:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823360 00000100:00100000:1.0:1788361681.751071:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1788361681.751080:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429823360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361681.751277:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361681.751332:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429823360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 250us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361681.751339:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1788361681.751452:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429824000:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.751484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.751510:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361681.751516:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429825408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361681.751540:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.751576:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825408 00000100:00100000:2.0:1788361681.751580:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825408 00000100:00100000:3.0:1788361681.751612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.751615:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138 00000100:00100000:2.0:1788361681.751627:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429825408:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361681.751643:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429824128:0@lo:400:kworker.0 00000004:00000024:2.0:1788361681.751653:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:3.0:1788361681.751671:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361681.751694:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429824640:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.751714:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429825408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.751723:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138 00000100:00100000:3.0:1788361681.751724:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.751742:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824128 00000100:00100000:2.0:1788361681.751746:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824128 00000100:00100000:3.0:1788361681.751751:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429825152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361681.751760:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824640 00000100:00100000:2.0:1788361681.751764:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824640 00000100:00100000:3.0:1788361681.751783:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.751784:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139 00000100:00100000:2.0:1788361681.751793:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429824128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.751806:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140 00000100:00100000:1.0:1788361681.751818:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.751853:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875230429824128:12345-0@lo:400:kworker.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.751860:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139 00000100:00100000:1.0:1788361681.751882:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429824640:12345-0@lo:400:kworker.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361681.751890:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140 00000100:00100000:2.0:1788361681.751895:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825152 00000100:00100000:2.0:1788361681.751899:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825152 00000100:00100000:2.0:1788361681.751924:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:2.0:1788361681.751938:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429825152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361681.751948:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361681.751979:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429825152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361681.751985:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429824256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.751987:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:2.0:1788361681.752016:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823744 00000100:00100000:2.0:1788361681.752021:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823744 00000100:00100000:0.0:1788361681.752026:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.752050:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1788361681.752056:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429824768:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.752061:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.752071:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968752 gen 2 00000100:00100000:0.0:1788361681.752086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361681.752107:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429823744:12345-0@lo:400:kworker.0 Request processed in 49us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.752113:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1788361681.752117:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429825280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361681.752139:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823872 00000100:00100000:2.0:1788361681.752144:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823872 00000100:00100000:0.0:1788361681.752144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361681.752153:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429823360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361681.752170:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824512 00000100:00100000:2.0:1788361681.752174:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824512 00000100:00100000:0.0:1788361681.752176:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429823744:0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.752189:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825024 00000100:00100000:2.0:1788361681.752193:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824000 00000100:00100000:1.0:1788361681.752194:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825024 00000100:00100000:2.0:1788361681.752198:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824000 00000100:00100000:0.0:1788361681.752216:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824384 00000100:00100000:0.0:1788361681.752221:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824384 00000100:00100000:1.0:1788361681.752224:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823616 00000100:00100000:0.0:1788361681.752253:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824896 00000100:00100000:0.0:1788361681.752257:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824896 00000100:00100000:0.0:1788361681.752287:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824256 00000100:00100000:0.0:1788361681.752289:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824256 00000100:00100000:1.0:1788361681.752302:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823616 00000100:00100000:0.0:1788361681.752308:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429824768 00000100:00100000:0.0:1788361681.752319:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429824768 00000100:00100000:1.0:1788361681.752332:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1788361681.752342:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429823872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361681.752350:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:0.0:1788361681.752358:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429824384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.752374:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1788361681.752381:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429824512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361681.752413:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429824384:12345-0@lo:400:kworker.0 Request processed in 54us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.752414:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875230429824512:12345-0@lo:400:kworker.0 Request processed in 35us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.752426:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1788361681.752430:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1788361681.752437:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1788361681.752443:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429825024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361681.752453:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1788361681.752464:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429824896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.752465:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429825024:12345-0@lo:400:kworker.0 Request processed in 22us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.752483:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1788361681.752496:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1788361681.752501:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429824000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361681.752529:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429823872:12345-0@lo:400:kworker.0 Request processed in 187us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361681.752533:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429824000:12345-0@lo:400:kworker.0 Request processed in 31us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361681.752543:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:3.0:1788361681.752599:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 2 00000100:00100000:3.0:1788361681.752615:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429825152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361681.752634:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116997 gen 3 00000004:00080000:3.0:1788361681.752639:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116997 committed transno 115964116997 00000100:00100000:3.0:1788361681.752696:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429824128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.752710:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429824640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.752736:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825280 00000100:00100000:3.0:1788361681.752740:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825280 00000100:00100000:2.0:1788361681.752744:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1788361681.752763:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1788361681.752771:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429823616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.752778:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141 00000100:00100000:3.0:1788361681.752788:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429825280:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361681.752816:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429823616:12345-0@lo:400:kworker.0 Request processed in 46us (1206us total) trans 0 rc 0/0 00000004:00000024:3.0:1788361681.752817:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1788361681.752855:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1788361681.752881:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875230429825280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361681.752888:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141 00000100:00100000:2.0:1788361681.752894:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429825408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361681.752921:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:3.0:1788361681.752930:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429824256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.752961:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429824256:12345-0@lo:400:kworker.0 Request processed in 32us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361681.752974:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:3.0:1788361681.752988:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:3.0:1788361681.752994:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429824768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753020:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429824768:12345-0@lo:400:kworker.0 Request processed in 27us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361681.753026:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00080000:3.0:1788361681.753061:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361681.753066:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361681.753069:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361681.753071:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361681.753094:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429823616:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753158:0:90861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429823488 00000100:00100000:3.0:1788361681.753162:0:90861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429823488 00000100:00100000:3.0:1788361681.753190:0:90861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788361681.753197:0:90861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d118571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429823488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753232:0:90861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d118571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429823488:12345-0@lo:400:kworker.0 Request processed in 36us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361681.753239:0:90861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788361681.753271:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429824000:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.753299:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429823488:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753313:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875230429824512:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753327:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429825024:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753341:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429823872:0@lo:400:kworker.0 00000100:00100000:3.0:1788361681.753356:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429824384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.753370:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429825280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361681.753389:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429824256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361681.753407:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429824768:0@lo:400:kworker.0 00000100:00100000:0.0:1788361681.753636:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429824896:12345-0@lo:400:kworker.0 Request processed in 1175us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361681.753643:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:3.0:1788361681.753767:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429824896:0@lo:400:kworker.0 00010000:00010000:0.0:1788361682.006998:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361682.225468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361682.226898:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407017984 00000100:00100000:2.0:1788361682.226909:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407017984 00000100:00100000:2.0:1788361682.226987:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1251 00000100:00080000:3.0:1788361682.226993:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361682.227000:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70977:x1875230407017984:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:2.0:1788361682.227023:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361682.227049:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe375d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f81 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227110:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227125:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227138:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227152:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227159:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227182:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227237:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe3772 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227246:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe3772 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227264:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe3772 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361682.227306:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe3772 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227321:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227335:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227342:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227348:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361682.227353:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227362:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227374:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ec200) 00010000:00010000:2.0:1788361682.227377:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361682.227381:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227387:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe3764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227410:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227415:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227421:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227426:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361682.227433:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227439:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227447:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d140d28400) 00010000:00010000:2.0:1788361682.227449:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361682.227452:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227458:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe376b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227488:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe375d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f81 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227501:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe3772 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f81 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361682.227509:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d140d28500) 00010000:00010000:2.0:1788361682.227511:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361682.227514:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad200, rc 0) 00000100:00100000:2.0:1788361682.227584:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407017984:12345-192.168.204.35@tcp:101:cp.0 Request processed in 586us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361682.227591:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1251 00000100:00100000:3.0:1788361682.229726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361682.231694:0:66137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018112 00000100:00100000:2.0:1788361682.231707:0:66137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018112 00000100:00100000:2.0:1788361682.232390:0:66137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1788361682.232401:0:66137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70977:x1875230407018112:12345-192.168.204.35@tcp:900:cp.0 00000100:00080000:3.0:1788361682.232465:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361682.232510:0:66137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70977:x1875230407018112:12345-192.168.204.35@tcp:900:cp.0 Request processed in 109us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361682.232519:0:66137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:3.0:1788361682.235030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361682.235129:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018240 00000100:00100000:1.0:1788361682.235141:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018240 00000100:00100000:1.0:1788361682.235207:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1252 00000100:00100000:1.0:1788361682.235217:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70977:x1875230407018240:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:1.0:1788361682.235237:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361682.235274:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ec00/0x1b69fa8920fe3779 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f88 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.235362:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ee00/0x1b69fa8920fe3780 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.235378:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ee00/0x1b69fa8920fe3780 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.235391:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ee00/0x1b69fa8920fe3780 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361682.235435:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788361682.235439:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788361682.235701:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ec00/0x1b69fa8920fe3779 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f88 expref: 8 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.235717:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ee00/0x1b69fa8920fe3780 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f88 expref: 7 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.235726:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:1.0:1788361682.235729:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788361682.235732:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785ee00, rc 0) 00000100:00100000:1.0:1788361682.235781:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70977:x1875230407018240:12345-192.168.204.35@tcp:101:cp.0 Request processed in 565us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361682.235789:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1252 00000100:00100000:3.0:1788361682.237896:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361682.237986:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018368 00000100:00100000:0.0:1788361682.237995:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018368 00000100:00100000:0.0:1788361682.238240:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1253 00000100:00100000:0.0:1788361682.238262:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70977:x1875230407018368:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:0.0:1788361682.238281:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361682.238298:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917000/0x1b69fa8920fe3787 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f8f expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238350:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238363:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238372:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238397:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238405:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238412:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238485:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d100031e00/0x1b69fa8920fe379c lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238493:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d100031e00/0x1b69fa8920fe379c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238500:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d100031e00/0x1b69fa8920fe379c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361682.238529:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1788361682.238533:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361682.238553:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d100031e00/0x1b69fa8920fe379c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238565:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238569:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238573:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238584:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238589:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361682.238594:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238602:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238613:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:0.0:1788361682.238616:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361682.238620:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238627:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916400/0x1b69fa8920fe378e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238638:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238645:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238651:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238662:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361682.238665:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238681:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238690:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d0010ecb00) 00010000:00010000:0.0:1788361682.238692:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361682.238695:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238700:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d100030600/0x1b69fa8920fe3795 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238729:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d139917000/0x1b69fa8920fe3787 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f8f expref: 9 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238741:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d100031e00/0x1b69fa8920fe379c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f8f expref: 8 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361682.238747:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:0.0:1788361682.238748:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361682.238750:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100031e00, rc 0) 00000100:00100000:0.0:1788361682.238847:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018368:12345-192.168.204.35@tcp:101:cp.0 Request processed in 598us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361682.238855:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1253 00000100:00100000:3.0:1788361682.241932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361682.241972:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018496 00000100:00100000:3.0:1788361682.241981:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018496 00000100:00100000:3.0:1788361682.242047:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1254 00000100:00100000:3.0:1788361682.242168:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018496:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:3.0:1788361682.242195:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361682.242218:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe37a3 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f96 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242350:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242363:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242374:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242388:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242396:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242414:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242457:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242465:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242473:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242479:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242486:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361682.242490:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242498:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242510:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:3.0:1788361682.242513:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361682.242517:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242523:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207dc00/0x1b69fa8920fe37aa lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242535:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242549:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242556:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242562:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361682.242565:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242572:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242581:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff99d13a135b00) 00010000:00010000:3.0:1788361682.242584:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361682.242587:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242593:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207ce00/0x1b69fa8920fe37b1 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242626:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe37a3 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f96 expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242636:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:3.0:1788361682.242639:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361682.242642:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00207c200/0x1b69fa8920fe37a3 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f96 expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361682.242664:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207c200, rc 0) 00000100:00100000:3.0:1788361682.242730:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018496:12345-192.168.204.35@tcp:101:cp.0 Request processed in 674us (804us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361682.242737:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1254 00000100:00100000:3.0:1788361682.245133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361682.245292:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018624 00000100:00100000:1.0:1788361682.245303:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018624 00000100:00100000:1.0:1788361682.245543:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1255 00000100:00100000:1.0:1788361682.245555:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018624:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:1.0:1788361682.245583:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361682.245605:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ec00/0x1b69fa8920fe37b8 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f9d expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245673:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245689:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245700:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245715:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245721:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245728:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245769:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245776:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245782:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245789:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245800:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785f000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361682.245804:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245812:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245853:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:1.0:1788361682.245857:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361682.245862:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245868:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785f000/0x1b69fa8920fe37bf lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245883:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245889:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245895:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245901:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361682.245904:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245910:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245927:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff99d103a4cc00) 00010000:00010000:1.0:1788361682.245929:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361682.245932:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245938:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785e600/0x1b69fa8920fe37c6 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245967:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ec00/0x1b69fa8920fe37b8 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f9d expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245976:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:1.0:1788361682.245978:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361682.245982:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ec00/0x1b69fa8920fe37b8 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f9d expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361682.245990:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785ec00, rc 0) 00000100:00100000:1.0:1788361682.246058:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018624:12345-192.168.204.35@tcp:101:cp.0 Request processed in 505us (932us total) trans 0 rc 301/301 00000100:00100000:1.0:1788361682.246064:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1255 00000100:00100000:3.0:1788361682.250020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361682.250128:0:66135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018752 00000100:00100000:0.0:1788361682.250139:0:66135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018752 00000100:00100000:0.0:1788361682.250186:0:66135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1788361682.250196:0:66135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018752:12345-192.168.204.35@tcp:700:cp.0 00000020:02000000:0.0:1788361682.250220:0:66135:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:0.0:1788361682.256407:0:66135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407018752:12345-192.168.204.35@tcp:700:cp.0 Request processed in 6204us (6389us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361682.256422:0:66135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00010000:00010000:1.0:1788361683.031172:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361684.055145:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361684.177146:0:91871:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788361684.177331:0:91871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.177346:0:91871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.177354:0:91871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.177361:0:91871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.177385:0:91871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361684.177392:0:91871:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788361684.177427:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361684.177432:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788361684.177437:0:91871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788361684.177517:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1788361684.177521:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788361684.177526:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.177541:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916000 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361684.177551:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.177564:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361684.177573:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361684.177579:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429825536:0@lo:39:umount.0 10000000:01000000:2.0:1788361684.177581:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361684.177588:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788361684.177594:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788361684.177623:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.177631:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361684.177655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361684.177665:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.177674:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916000/0x1b69fa8920fe32cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32d3 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.177704:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361684.177706:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361684.177708:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361684.177720:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429825664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361684.177752:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361684.177849:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825664 00000100:00100000:2.0:1788361684.177857:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825664 00000100:00100000:2.0:1788361684.177915:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1788361684.177925:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429825664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361684.177939:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361684.177953:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe32d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe32cc expref: 24 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.177965:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361684.178005:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3651:x1875230429825664:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361684.178012:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1788361684.178024:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825536 00000100:00100000:3.0:1788361684.178029:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825536 00000100:00100000:3.0:1788361684.178079:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788361684.178086:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429825536:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788361684.178091:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429825664:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788361684.178109:0:66126:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe33eb 00000100:00080000:3.0:1788361684.178117:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d11787b000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361684.178168:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361684.178192:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875230429825536:12345-0@lo:39:umount.0 Request processed in 106us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361684.178199:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000020:00000080:3.0:1788361684.178207:0:66126:0:(genops.c:906:class_export_put()) final put ffff99d117878000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788361684.178262:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788361684.178272:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429825536:0@lo:39:umount.0 00000020:00000080:1.0:1788361684.178349:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d117878000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361684.178411:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11787b000 for lustre-MDT0000 00000100:00080000:0.0:1788361684.178440:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361684.178443:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361684.178447:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788361684.179775:0:91871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179795:0:91871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179803:0:91871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179809:0:91871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.179871:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361684.179880:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.179887:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361684.179890:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.179898:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361684.179904:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361684.179909:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361684.179911:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788361684.179933:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179934:0:91871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361684.179943:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361684.179945:0:91871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179955:0:91871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179961:0:91871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179968:0:91871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.179977:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179981:0:91871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361684.179989:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe31f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3201 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.179990:0:91871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.180006:0:91871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180007:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361684.180015:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.180029:0:91871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180040:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d14166a600 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:0.0:1788361684.180044:0:91871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361684.180045:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180066:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.180069:0:91871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:1.0:1788361684.180077:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.180079:0:91871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361684.180088:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361684.180094:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788361684.180097:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788361684.180097:0:91871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.180106:0:91871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361684.180112:0:91871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180116:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180124:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361684.180127:0:91871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361684.180132:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361684.180132:0:91871:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788361684.180136:0:91871:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788361684.180143:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d14166a600/0x1b69fa8920fe32f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180154:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361684.180157:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180163:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361684.180167:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361684.180168:0:91871:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788361684.180173:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000100:00100000:2.0:1788361684.180174:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429825920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361684.180187:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361684.180193:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361684.180198:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361684.180201:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788361684.180203:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361684.180227:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180233:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788361684.180244:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361684.180249:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180257:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe32be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe32c5 expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180269:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361684.180273:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361684.180274:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429825792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361684.180286:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916c00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361684.180290:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.180297:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.180298:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361684.180311:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825920 00000100:00100000:3.0:1788361684.180312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361684.180318:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825920 10000000:00010000:1.0:1788361684.180323:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361684.180331:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361684.180334:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788361684.180336:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788361684.180353:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429825792 00010000:00010000:1.0:1788361684.180355:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361684.180358:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429825792 00000100:00100000:3.0:1788361684.180364:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00010000:00010000:1.0:1788361684.180367:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361684.180377:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361684.180379:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429825920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361684.180386:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00010000:00010000:1.0:1788361684.180388:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe31e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe31ec expref: -99 pid: 90853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361684.180399:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429825792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361684.180403:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361684.180403:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361684.180406:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361684.180411:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361684.180411:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361684.180419:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1371ffe00/0x1b69fa8920fe32fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe32f6 expref: 24 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.180425:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1371ffa00/0x1b69fa8920fe3201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe31f3 expref: 24 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.180426:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429826048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361684.180436:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361684.180464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361684.180466:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361684.180494:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361684.180502:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429826176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361684.180511:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3652:x1875230429825792:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361684.180519:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1788361684.180528:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361684.180580:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3653:x1875230429825920:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361684.180587:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000020:00000080:0.0:1788361684.180612:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788361684.180619:0:91871:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1788361684.180659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826048 00000100:00100000:2.0:1788361684.180664:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826048 00000100:00100000:2.0:1788361684.180689:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826176 00000100:00100000:2.0:1788361684.180692:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826176 00000100:00100000:2.0:1788361684.180709:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1788361684.180714:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429826048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361684.180722:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361684.180731:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309200/0x1b69fa8920fe32c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe32be expref: 22 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.180739:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361684.180764:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3650:x1875230429826048:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361684.180770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1788361684.181166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1788361684.181179:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:3650:x1875230429826176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361684.181188:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361684.181190:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361684.181200:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166a000/0x1b69fa8920fe31ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe31e5 expref: 20 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361684.181219:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361684.181224:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429826048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361684.181250:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429826176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361684.181253:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429826176:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361684.181271:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00010000:00010000:2.0:1788361684.181299:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1788361684.182659:0:91871:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:3.0:1788361684.183063:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429825792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361684.183095:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429825920:0@lo:103:ldlm_bl.0 00000001:00100000:1.0:1788361684.185020:0:90855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:1.0:1788361684.185030:0:90855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00080000:1.0:1788361684.185040:0:90855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000020:00000080:1.0:1788361684.185046:0:90855:0:(genops.c:906:class_export_put()) final put ffff99d116c04000/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:2.0:1788361684.185135:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c04000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-MDT0000 00000020:00000080:0.0:1788361684.185161:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/13 00000020:00080000:0.0:1788361684.185169:0:91871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d0057f6800 f1e400d1-472b-42d1-b5e7-e80dc701272a 192.168.204.35@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361684.185184:0:91871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d13fd10800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361684.185189:0:91871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d13fd10000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361684.185193:0:91871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d136cc6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361684.185196:0:91871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d116c02000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116997 stale:0 00000020:00080000:0.0:1788361684.185202:0:91871:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99d003a099c0) has exports, disconnecting them 00000020:00080000:0.0:1788361684.185206:0:91871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.35@tcp (ffff99d0057f6800), last request at 1788361682 00000020:00000080:0.0:1788361684.185224:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3733 00000020:00010000:0.0:1788361684.185233:0:91871:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d0057f6800: total 1 00000100:00080000:0.0:1788361684.185238:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d0057f1800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788361684.185280:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d0057f6800: total 0 00010000:00010000:1.0:1788361684.185318:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d0057f6800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788361684.185351:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe3772 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f81 expref: 6 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.185389:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916600/0x1b69fa8920fe3756 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 5 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361684.185404:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d0057f6800, canceled 2 locks, left on hash table 0. 00000020:00000080:2.0:1788361684.185438:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d0021f8000 for lustre-MDT0000 00000020:00080000:0.0:1788361684.188167:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d0057f6800): rc 0 00000020:00080000:0.0:1788361684.188175:0:91871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d13fd10800), last request at 1788361671 00000020:00000080:0.0:1788361684.188181:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe33e4 00000100:00080000:0.0:1788361684.188190:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d13fd15800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361684.188222:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d13fd10800): rc 0 00000020:00000080:0.0:1788361684.188224:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d13fd10800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788361684.188235:0:91871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d13fd10000), last request at 1788361681 00000020:00000080:0.0:1788361684.188239:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe33dd 00000100:00080000:0.0:1788361684.188243:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d13fd15000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788361684.188246:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788361684.188257:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d13fd10000): rc 0 00000020:00000080:0.0:1788361684.188259:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d13fd10000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788361684.188264:0:91871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d136cc6800), last request at 1788361681 00000020:00000080:0.0:1788361684.188267:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe33d6 00000100:00080000:0.0:1788361684.188286:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d136cc2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361684.188333:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d136cc6800): rc 0 00000020:00000080:0.0:1788361684.188335:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d136cc6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788361684.188339:0:91871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d116c02000), last request at 1788361666 00000020:00000080:0.0:1788361684.188361:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3240 00000100:00080000:0.0:1788361684.188369:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d004103000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361684.188377:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d116c02000): rc 0 00000020:00000080:0.0:1788361684.188379:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c02000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1788361684.188386:0:91871:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa088870bae0 00010000:00010000:3.0:1788361684.188399:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361684.188407:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361684.188407:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788361684.188413:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:2.0:1788361684.188796:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd10800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788361684.189058:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd10000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788361684.189087:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136cc6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788361684.189111:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c02000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788361684.189135:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd15800 for lustre-MDT0000 00000020:00000080:2.0:1788361684.189139:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd15000 for lustre-MDT0000 00000020:00000080:2.0:1788361684.189142:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136cc2000 for lustre-MDT0000 00000020:00000080:2.0:1788361684.189145:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d004103000 for lustre-MDT0000 00000100:00080000:0.0:1788361684.189193:0:91871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788361684.189226:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d116c01800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788361684.189274:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361684.189330:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429826304:0@lo:39:umount.0 00000100:00100000:3.0:1788361684.189403:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361684.189496:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826304 00000100:00100000:0.0:1788361684.189504:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826304 00000100:00100000:0.0:1788361684.189557:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142 00000100:00100000:0.0:1788361684.189566:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429826304:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788361684.189589:0:23939:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe327f 00000100:00080000:0.0:1788361684.189594:0:23939:0:(import.c:65:import_set_state_nolock()) ffff99d11e630800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361684.189613:0:23939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411444 00000100:00100000:0.0:1788361684.189739:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3649:x1875230429826304:12345-0@lo:39:umount.0 Request processed in 174us (335us total) trans 77309411445 rc 0/0 00000100:00100000:0.0:1788361684.189747:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142 00010000:00010000:2.0:1788361684.189893:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361684.190038:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788361684.190042:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 3 00000004:00080000:0.0:1788361684.190058:0:91871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788361684.190122:0:91871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788361684.190134:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788361684.190142:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788361684.190144:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968752 gen 3 00000004:00080000:0.0:1788361684.190159:0:91871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788361684.190239:0:91871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788361684.190249:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788361684.190289:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d003a099c0) has no exports 00000100:00100000:3.0:1788361684.190357:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429826432:0@lo:9:umount.0 00000100:00100000:3.0:1788361684.190388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361684.190417:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429826560:0@lo:9:umount.0 00000100:00100000:3.0:1788361684.190437:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361684.190468:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c01800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788361684.190473:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429826304:0@lo:39:umount.0 00000100:00100000:3.0:1788361684.190491:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826432 00000100:00100000:3.0:1788361684.190494:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826432 00000100:00100000:3.0:1788361684.190527:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826560 00000100:00100000:3.0:1788361684.190529:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826560 00000100:00100000:3.0:1788361684.190549:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000100:00100000:3.0:1788361684.190561:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429826432:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361684.190577:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe328d 00000100:00080000:3.0:1788361684.190582:0:26160:0:(import.c:65:import_set_state_nolock()) ffff99d11e632000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361684.190637:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968750 00000100:00100000:3.0:1788361684.190722:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429826432:12345-0@lo:9:umount.0 Request processed in 161us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361684.190729:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00000100:00100000:3.0:1788361684.190741:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:3.0:1788361684.190746:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429826560:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361684.190756:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe32b0 00000100:00080000:3.0:1788361684.190760:0:26160:0:(import.c:65:import_set_state_nolock()) ffff99d11e636800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361684.190798:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968752 00000100:00100000:3.0:1788361684.190894:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429826560:12345-0@lo:9:umount.0 Request processed in 148us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361684.190900:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00080000:3.0:1788361684.190915:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361684.190919:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788361684.190930:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361684.190943:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361684.190959:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361684.190961:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361684.190964:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429826432:0@lo:9:umount.0 00000100:00080000:3.0:1788361684.190973:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137ea5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361684.190978:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361684.190979:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361684.190981:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429826560:0@lo:9:umount.0 00010000:00010000:3.0:1788361684.190999:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788361684.191343:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d003a099c0) has no exports 00000020:00000080:1.0:1788361684.215252:0:6512:0:(genops.c:906:class_export_put()) final put ffff99d0057f6800/f1e400d1-472b-42d1-b5e7-e80dc701272a 00010000:00010000:1.0:1788361684.215371:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361684.215374:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361684.215377:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361684.215479:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0057f6800/f1e400d1-472b-42d1-b5e7-e80dc701272a for lustre-MDT0000 00000020:00000080:2.0:1788361684.215535:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d0057f1800 for lustre-MDT0000 00000020:00000080:0.0:1788361684.228939:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3255 00000020:00000080:0.0:1788361684.228958:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d141655000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788361684.229013:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788361684.229025:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361684.229037:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361684.229042:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d0042e4d40) has no exports 00000020:00000080:3.0:1788361684.229200:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141655000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788361684.229417:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe324e 00000020:00000080:0.0:1788361684.229424:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d137f15000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361684.229491:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.229499:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788361684.229501:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f15000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361684.229502:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d006c8d000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788361684.229506:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788361684.229512:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788361684.229627:0:91871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d0055fe720 - data ffff99d117406360/ffff99d106952800 00000020:01000000:1.0:1788361684.229772:0:91871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d00697ef00 - data ffff99d117524510/ffff99d006515800 00000100:00080000:1.0:1788361684.266740:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788361684.266748:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361684.266762:0:91871:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d10eaa5c00 x1875230429826304/t77309411445(77309411445) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361694 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361684.266803:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788361684.267954:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361684.267957:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 4 00000004:00080000:1.0:1788361684.267967:0:91871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361684.267969:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361684.268238:0:90871:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361684.268243:0:90871:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:2.0:1788361684.268253:0:90871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:1.0:1788361684.268861:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361684.268864:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968752 gen 4 00000004:00080000:1.0:1788361684.268882:0:91871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361684.268884:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361684.269441:0:90873:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361684.269444:0:90873:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:2.0:1788361684.269452:0:90873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:1.0:1788361684.270199:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe320f 00000020:00000080:1.0:1788361684.270218:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c03000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361684.270403:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361684.271204:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3224 00000020:00000080:1.0:1788361684.271223:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c04800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361684.271277:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788361684.271284:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.271295:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361684.271300:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99d003a0b380) has no exports 00000004:01000000:1.0:1788361684.271502:0:91871:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788361684.271512:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe32a2 00000020:00000080:1.0:1788361684.271520:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d13fd9e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361684.271575:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c04800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788361684.271644:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361684.271650:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.271659:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361684.271662:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d137c04d40) has no exports 00000020:00000080:1.0:1788361684.271668:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe329b 00000020:00000080:1.0:1788361684.271673:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d141656000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361684.271696:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361684.271802:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141656000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361684.272291:0:91871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361684.272298:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361684.272303:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968752 gen 5 00000004:00080000:1.0:1788361684.272309:0:91871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361684.272312:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361684.272390:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361684.272401:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137ea5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361684.272401:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361684.272411:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3286 00000020:00000080:3.0:1788361684.272413:0:79303:0:(genops.c:906:class_export_put()) final put ffff99d13fd9a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361684.272417:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361684.272421:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d13fd9c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788361684.272424:0:79303:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361684.272429:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788361684.272434:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.272439:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361684.272441:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99d001c60000) has no exports 00000020:00000080:1.0:1788361684.272445:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3278 00000020:00000080:1.0:1788361684.272448:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d141650800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361684.272521:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788361684.272530:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141650800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361684.272936:0:91871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788361684.272939:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361684.272941:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 5 00000004:00080000:1.0:1788361684.272945:0:91871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361684.272946:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361684.272990:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141657800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361684.272990:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.272998:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361684.273004:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d005418000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361684.273007:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005418000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788361684.273013:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788361684.273083:0:91871:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788361684.273090:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe326a 00000020:00000080:1.0:1788361684.273096:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d00541d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788361684.273111:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788361684.273116:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.273121:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361684.273124:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99d10531b380) has no exports 00000020:00000080:1.0:1788361684.273129:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3263 00000020:00000080:1.0:1788361684.273133:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c07000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361684.273236:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788361684.273247:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c07000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788361684.277740:0:91871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788361684.277753:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788361684.277771:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788361684.277781:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361684.278278:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d116c01800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788361684.278318:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.278336:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361684.278344:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d141652000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361684.278349:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141652000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788361684.278358:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361684.278525:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.278531:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361684.278534:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c03800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361684.278536:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c03800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788361684.278541:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361684.278695:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe322b 00000020:00000080:1.0:1788361684.278705:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c05000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788361684.278712:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788361684.278716:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.278721:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361684.278725:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99d003a08000) has no exports 00000020:00000080:1.0:1788361684.278747:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.278751:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788361684.278755:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c05000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788361684.278757:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3232 00000020:00000080:1.0:1788361684.278763:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c06000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361684.278764:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d116c02800/lustre-MDD0000_UUID 00000020:01000004:1.0:1788361684.278775:0:91871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d005033800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788361684.278776:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c02800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:1.0:1788361684.278781:0:91871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d005033800 3 00000020:01000000:2.0:1788361684.278784:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788361684.278786:0:91871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d005033800 from lustre-MDT0000 00000020:00000080:2.0:1788361684.278874:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c06000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361684.278884:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.278891:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788361684.278895:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d116c07800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788361684.278898:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c07800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788361684.278906:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788361684.278940:0:91871:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788361684.278951:0:91871:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788361684.278955:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788361684.278958:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.278962:0:91871:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788361684.278973:0:91871:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d104f3d000 3956ab41-635b-456b-967f-6c1073c5d2df 192.168.204.35@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361684.278982:0:91871:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d0055d6800 c8a6f36d-efb9-41cf-af98-5917323f2b0d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361684.278988:0:91871:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff99d001c619c0) has exports, disconnecting them 00000020:00080000:1.0:1788361684.278993:0:91871:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.35@tcp (ffff99d104f3d000), last request at 1788361680 00000020:00000080:1.0:1788361684.279012:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3710 00000020:00010000:1.0:1788361684.279017:0:91871:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d104f3d000: total 0 00000100:00080000:1.0:1788361684.279022:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d104f38000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788361684.279041:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d104f3d000): rc 0 00000020:00080000:1.0:1788361684.279045:0:91871:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d0055d6800), last request at 1788361665 00000020:00000080:1.0:1788361684.279054:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe31d0 00000020:00010000:1.0:1788361684.279057:0:91871:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d0055d6800: total 0 00000100:00080000:1.0:1788361684.279061:0:91871:0:(import.c:65:import_set_state_nolock()) ffff99d00541c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788361684.279075:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d0055d6800): rc 0 00000020:00080000:1.0:1788361684.279078:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99d001c619c0) has no exports 00000100:00100000:0.0:1788361684.279141:0:90859:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d137d07800:90859] 0 exiting: rc = 1 00000100:00100000:3.0:1788361684.279261:0:90861:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d002084e00:90861] 1 exiting: rc = 0 00000100:00100000:2.0:1788361684.279451:0:90862:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d002084000:90862] 2 exiting: rc = 0 00000100:00100000:1.0:1788361684.279492:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279500:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279506:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279512:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279518:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279524:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279531:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1788361684.279532:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d104f3d000: total 0 00000100:00100000:1.0:1788361684.279538:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279542:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279546:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279550:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279555:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279559:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279573:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279578:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d104f3d000, canceled 0 locks, left on hash table 4. 00000100:00100000:1.0:1788361684.279579:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279586:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279592:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279596:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279601:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279606:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279613:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279616:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917800/0x1b69fa8920fe3725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f42 expref: 5 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279622:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279632:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279638:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279647:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279648:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe371e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f11 expref: 4 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279655:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279663:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279673:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279674:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f0a expref: 3 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279681:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279689:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279698:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916800/0x1b69fa8920fe372c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f49 expref: 2 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279708:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279715:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279717:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d104f3d000, canceled 4 locks, left on hash table 0. 00000100:00100000:1.0:1788361684.279722:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279728:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279735:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279743:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279750:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788361684.279753:0:6511:0:(genops.c:906:class_export_put()) final put ffff99d104f3d000/3956ab41-635b-456b-967f-6c1073c5d2df 00000100:00100000:1.0:1788361684.279756:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279759:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279764:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279769:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1788361684.279774:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d0055d6800: total 1 00000100:00100000:1.0:1788361684.279774:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279780:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361684.279781:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279787:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279796:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279806:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279808:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d0055d6800, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788361684.279814:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279849:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe334a expref: 14 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279850:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279860:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279870:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279871:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166b600/0x1b69fa8920fe3343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe333c expref: 13 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279880:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279887:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279895:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166aa00/0x1b69fa8920fe335f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3358 expref: 12 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279896:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279904:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279910:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279917:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe336d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3366 expref: 11 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279918:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279927:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279936:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279937:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe3397 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3390 expref: 10 pid: 90859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279947:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279955:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279963:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279964:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe337b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3374 expref: 9 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361684.279970:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361684.279979:0:91871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788361684.279988:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166ba00/0x1b69fa8920fe330b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3304 expref: 8 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280004:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1371fee00/0x1b69fa8920fe3389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3382 expref: 7 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280019:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166a400/0x1b69fa8920fe3319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3312 expref: 6 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280037:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3320 expref: 5 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280060:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe33a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe339e expref: 4 pid: 90862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280080:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166be00/0x1b69fa8920fe3335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe332e expref: 3 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280100:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d14166ae00/0x1b69fa8920fe33b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe33ac expref: 2 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361684.280115:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d0055d6800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788361684.280145:0:6511:0:(genops.c:906:class_export_put()) final put ffff99d0055d6800/c8a6f36d-efb9-41cf-af98-5917323f2b0d 00010000:00010000:3.0:1788361684.280151:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361684.280155:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361684.280158:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361684.280167:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d104f3d000/3956ab41-635b-456b-967f-6c1073c5d2df for MGS 00000020:00000080:3.0:1788361684.280201:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0055d6800/c8a6f36d-efb9-41cf-af98-5917323f2b0d for MGS 00000020:00000080:3.0:1788361684.280233:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d104f38000 for MGS 00000020:00000080:3.0:1788361684.280240:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d00541c800 for MGS 00010000:00010000:3.0:1788361684.280268:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788361684.280666:0:91871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d0055feb40 - data ffff99d117518288/ffff99d106951c00 00000020:01000000:1.0:1788361684.280777:0:91871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d1046e2060 - data ffff99d117424e58/ffff99d140c7c800 00000020:00000080:1.0:1788361684.281454:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe31c9 00000020:00000080:1.0:1788361684.281462:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d0055d4800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788361684.281481:0:91871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d005033800 from MGS, refs=2 00000020:01000004:1.0:1788361684.281487:0:91871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d005033800 2 00000020:01000004:1.0:1788361684.281490:0:91871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d005033800 from MGS 00000020:00000080:1.0:1788361684.281515:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361684.281521:0:91871:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788361684.281524:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d0055d7800/MGS 00000020:00000080:1.0:1788361684.281527:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0055d7800/MGS for MGS 00000020:01000000:1.0:1788361684.281535:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1788361684.281595:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0055d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788361684.281614:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788361684.281619:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361684.281628:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788361684.281634:0:91871:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d005419800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361684.281640:0:91871:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99d104014d40) has exports, disconnecting them 00000020:00080000:1.0:1788361684.281652:0:91871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d005419800), last request at 1788361666 00000020:00000080:1.0:1788361684.281657:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe32e1 00000020:00080000:1.0:1788361684.281669:0:91871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d005419800): rc 0 00000020:00000080:1.0:1788361684.281673:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d005419800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361684.281887:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005419800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788361684.284906:0:91871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788361684.284914:0:91871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361684.284919:0:91871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361684.284926:0:91871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361684.285058:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361684.285071:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788361684.285078:0:91871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d005033800 1 00000020:00000080:3.0:1788361684.285099:0:91871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe31bb 00000020:00000080:3.0:1788361684.285106:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d0055d2800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788361684.285112:0:91871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788361684.285116:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361684.285120:0:91871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361684.285122:0:91871:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d003a0cd40) has no exports 00000020:00000080:2.0:1788361684.285991:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006aa9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788361684.286002:0:48377:0:(genops.c:906:class_export_put()) final put ffff99d00541d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788361684.286006:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788361684.286019:0:48377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788361684.286127:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0055d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361684.314461:0:91871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361684.314474:0:91871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788361684.314479:0:91871:0:(genops.c:906:class_export_put()) final put ffff99d11729a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361684.314484:0:91871:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11729a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788361684.314493:0:91871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788361684.314738:0:91871:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d005035800 00000020:02000400:2.0:1788361684.315038:0:91871:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788361684.822046:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429826688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361684.822136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361684.822188:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361684.822195:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429826816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361684.822242:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361684.822293:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826688 00000100:00100000:3.0:1788361684.822304:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826688 00000100:00100000:3.0:1788361684.822380:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826816 00000100:00100000:3.0:1788361684.822384:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826816 00000100:00100000:3.0:1788361684.822420:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1788361684.822433:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429826688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361684.822471:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361684.822528:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429826688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361684.822536:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1788361684.822568:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:2.0:1788361684.822580:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429826816:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788361684.822586:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361684.822591:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788361684.822598:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361684.822638:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429826688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361684.822642:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429826816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361684.822651:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:3.0:1788361684.822671:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429826816:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788361684.825294:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361684.825306:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d11e633000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788361684.825339:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:1.0:1788361684.825345:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361684.825348:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d00541e000/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:3.0:1788361684.825692:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e633000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788361684.825750:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541e000/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0000 00000020:00000080:3.0:1788361684.825767:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e632000 for lustre-OST0000 00000020:00000080:3.0:1788361684.825778:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d005418800 for lustre-OST0000 00000001:00100000:3.0:1788361684.826286:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361684.826291:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d11e634800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788361684.826311:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:3.0:1788361684.826315:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:3.0:1788361684.826317:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d137ea0800/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00000080:1.0:1788361684.826438:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e634800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788361684.826476:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137ea0800/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-OST0001 00000020:00000080:1.0:1788361684.826496:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e636800 for lustre-OST0001 00000020:00000080:1.0:1788361684.826500:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137ea6000 for lustre-OST0001 00000001:00100000:2.0:1788361684.827901:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788361684.827916:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411445 is committed 00000020:00000080:2.0:1788361684.827922:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d11e634000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788361684.827946:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:2.0:1788361684.827955:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec302d84-8f96-49d3-8682-aefc474f8448 00000001:00080000:2.0:1788361684.827960:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411444 is committed 00000020:00000080:3.0:1788361684.827980:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e634000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788361684.827980:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d0057c6800/ec302d84-8f96-49d3-8682-aefc474f8448 00000020:00080000:2.0:1788361684.828000:0:75524:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d004adb6c0 refcount 2 committed 0 result 0 batchid 73014444089 00000020:00080000:2.0:1788361684.828006:0:75524:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d0045da600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d004adb180 00000020:00080000:2.0:1788361684.828010:0:75524:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].1 00000020:00080000:2.0:1788361684.828014:0:75524:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d0045dad00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d139468c00 00000020:00080000:2.0:1788361684.828016:0:75524:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].1 00000020:00000080:3.0:1788361684.828956:0:79303:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0057c6800/ec302d84-8f96-49d3-8682-aefc474f8448 for lustre-MDT0001 00000020:00080000:2.0:1788361684.829118:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444089 committed batchid 68719476742 00000020:00000080:3.0:1788361684.829138:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e630800 for lustre-MDT0001 00000020:00000080:3.0:1788361684.829144:0:79303:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e632800 for lustre-MDT0001 00000020:00080000:2.0:1788361684.829246:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 68719476742 00010000:00010000:3.0:1788361685.079221:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788361685.384048:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407018880 offset 0 length 224: 4 00000100:00100000:3.0:1788361685.384462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361685.384503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361685.384542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361685.384577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361685.384669:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019136 00000100:00100000:0.0:1788361685.384794:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019136 00000100:00100000:0.0:1788361685.384936:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019008 00000100:00100000:0.0:1788361685.384940:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019008 00000100:00080000:3.0:1788361685.384963:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361685.385009:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019392 00000100:00100000:3.0:1788361685.385020:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019392 00000100:00100000:3.0:1788361685.385086:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019264 00000100:00100000:3.0:1788361685.385089:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019264 00000100:00100000:3.0:1788361685.385114:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1880 00000100:00100000:3.0:1788361685.385128:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407019392:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361685.385137:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 895 00000100:00100000:1.0:1788361685.385157:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2412:x1875230407019136:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361685.385168:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1257 00000100:00100000:0.0:1788361685.385179:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2412:x1875230407019008:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:0.0:1788361685.385200:0:66127:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:1.0:1788361685.385272:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2412:x1875230407019136:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 122us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361685.385280:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 895 00000100:00100000:1.0:1788361685.385306:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1881 00000100:00100000:1.0:1788361685.385311:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407019264:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:2.0:1788361685.385378:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361685.385383:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361685.385447:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407019264:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361685.385452:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1881 00000100:00100000:0.0:1788361685.385526:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2412:x1875230407019008:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 345us (981us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361685.385536:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1257 00000100:00100000:3.0:1788361685.386132:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407019392:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1005us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361685.386141:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1880 00000100:00100000:3.0:1788361685.389735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361685.389860:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019520 00000100:00100000:2.0:1788361685.389874:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019520 00000100:00100000:2.0:1788361685.389934:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1258 00000100:00100000:2.0:1788361685.389946:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230407019520:12345-192.168.204.35@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1788361685.389989:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361685.390074:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875230407019520:12345-192.168.204.35@tcp:38:ptlrpcd_01_01.0 Request processed in 130us (359us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361685.390082:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1258 00010000:00010000:1.0:1788361686.101972:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361686.870281:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429826944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361686.870425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361686.871318:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826944 00000100:00100000:0.0:1788361686.871330:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826944 00000100:00100000:0.0:1788361686.871386:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143 00000100:00100000:0.0:1788361686.871393:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1875230429826944:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788361686.871401:0:23938:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361686.871457:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1875230429826944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (1031us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361686.871485:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143 00000100:02020000:2.0:1788361686.871493:0:3650:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788361686.871499:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788361686.871504:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788361686.871508:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788361686.871514:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361686.871526:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2711 00000100:00080000:2.0:1788361686.871533:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361686.871564:0:3650:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d0053d1180 x1875230429827072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361686.871638:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429827072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788361686.871670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361686.871736:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827072 00000100:00100000:3.0:1788361686.871742:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827072 00000100:00100000:3.0:1788361686.871770:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144 00000100:00100000:3.0:1788361686.871777:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429827072:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788361686.871797:0:23939:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361686.871945:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429827200:0@lo:400:kworker.0 00000400:00000100:2.0:1788361686.871976:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429827200 offset 0 length 224: 4 00000100:00100000:1.0:1788361686.872009:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429827456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.872010:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429827712:0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.872041:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361686.872066:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429827328:0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.872079:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788361686.872087:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429827584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361686.872096:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361686.872119:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361686.872128:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429827840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.872169:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429828096:0@lo:400:kworker.0 00000100:00100000:1.0:1788361686.872175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361686.872205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361686.872223:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827712 00000100:00100000:1.0:1788361686.872228:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827712 00000100:00100000:2.0:1788361686.872240:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827328 00000100:00100000:2.0:1788361686.872245:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827328 00000100:00100000:2.0:1788361686.872281:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827584 00000100:00100000:2.0:1788361686.872284:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827584 00000100:00100000:2.0:1788361686.873121:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828096 00000100:00100000:2.0:1788361686.873187:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828096 00000100:00100000:1.0:1788361686.873195:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1788361686.873207:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429827712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.873214:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1788361686.873222:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875230429827328:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361686.873229:0:66901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361686.873283:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429827712:12345-0@lo:400:kworker.0 Request processed in 79us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361686.873285:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875230429827328:12345-0@lo:400:kworker.0 Request processed in 61us (1188us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361686.873297:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1788361686.873308:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1788361686.873323:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1788361686.873327:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875230429827584:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361686.873403:0:66901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361686.873433:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1788361686.873435:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875230429827584:12345-0@lo:400:kworker.0 Request processed in 104us (1314us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361686.873444:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429828096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.873445:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000020:00080000:0.0:1788361686.873456:0:66127:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1788361686.873473:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361686.873510:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875230429828096:12345-0@lo:400:kworker.0 Request processed in 54us (1292us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361686.873515:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827840 00000100:00100000:0.0:1788361686.873520:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1788361686.873521:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827840 00000100:00100000:2.0:1788361686.873566:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1788361686.873574:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429827840:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361686.873578:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788361686.873585:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788361686.873590:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788361686.873595:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361686.873599:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2711 00000100:00080000:0.0:1788361686.873605:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361686.873612:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429827840:12345-0@lo:400:kworker.0 Request processed in 38us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361686.873631:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa5c00 x1875230429828224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361686.873650:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429827328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361686.873668:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429827840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.873685:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00080000:2.0:1788361686.873707:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361686.873708:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788361686.873712:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788361686.873716:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788361686.873719:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361686.873729:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2711 00000100:00080000:0.0:1788361686.873733:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361686.873749:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa6680 x1875230429828352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361686.873760:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429827584:0@lo:400:kworker.0 00000100:00080000:0.0:1788361686.873772:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788361686.873775:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788361686.873778:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788361686.873781:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361686.873785:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2711 00000100:00080000:0.0:1788361686.873788:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361686.873799:0:3651:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10eaa7480 x1875230429828480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361686.873810:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429828096:0@lo:400:kworker.0 00000100:00100000:0.0:1788361686.873850:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429827712:0@lo:400:kworker.0 00000100:00100000:0.0:1788361686.873883:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361686.873906:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429827968:0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.873910:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827456 00000100:00100000:2.0:1788361686.873916:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827456 00000100:00100000:0.0:1788361686.873940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361686.873949:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1788361686.873958:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429827456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361686.874000:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429827456:12345-0@lo:400:kworker.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361686.874008:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1788361686.874024:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429827456:0@lo:400:kworker.0 00000100:00080000:2.0:1788361686.874029:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361686.874051:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429827968 00000100:00100000:2.0:1788361686.874055:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429827968 00000100:00100000:3.0:1788361686.874083:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429827072:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2304us (2410us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361686.874091:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:3.0:1788361686.874096:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144 00000100:00100000:2.0:1788361686.874101:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429827968:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361686.874132:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361686.874229:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361686.874235:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361686.874240:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429827072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788361686.874264:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429828224:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788361686.874271:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429827968:12345-0@lo:400:kworker.0 Request processed in 170us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361686.874280:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:1.0:1788361686.874301:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361686.874325:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828224 00000100:00100000:1.0:1788361686.874325:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429828352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788361686.874331:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828224 00000100:00100000:1.0:1788361686.874351:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361686.874367:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429828480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788361686.874389:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361686.874416:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828352 00000100:00100000:1.0:1788361686.874420:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828352 00000100:00100000:1.0:1788361686.874438:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828480 00000100:00100000:1.0:1788361686.874442:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828480 00000100:00100000:0.0:1788361686.874446:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429827968:0@lo:400:kworker.0 00000100:00100000:1.0:1788361686.874461:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1788361686.874475:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429828352:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788361686.874482:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1788361686.874488:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429828480:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788361686.874494:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1788361686.874509:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361686.874543:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429828480:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (153us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361686.874550:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00080000:0.0:1788361686.874591:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788361686.874592:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429828352:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 116us (240us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788361686.874600:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361686.874603:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1788361686.874607:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429828352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788361686.874711:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788361686.874717:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429828224:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788361686.874728:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361686.874753:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429828224:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 36us (453us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361686.874759:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00080000:0.0:1788361686.874801:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361686.874805:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361686.874808:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429828480:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788361686.874846:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361686.874849:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361686.874853:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429828224:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788361687.126033:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361688.152662:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361689.174681:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361689.942065:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429828608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361689.942186:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429828736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361689.944690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361689.944739:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828736 00000100:00100000:2.0:1788361689.944752:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828736 00000100:00080000:3.0:1788361689.944813:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361689.944861:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1788361689.944875:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429828736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361689.944918:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361689.945142:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429828736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 270us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361689.945150:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1788361689.945172:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429828736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361689.945275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361689.945353:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828608 00000100:00100000:3.0:1788361689.945358:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828608 00000100:00100000:3.0:1788361689.945405:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:3.0:1788361689.945414:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429828608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361689.945432:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361689.945504:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429828608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361689.945509:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00080000:0.0:1788361689.945547:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361689.946235:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429828608:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788361690.198222:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788361690.505137:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407019648 offset 0 length 224: 4 00000100:00100000:0.0:1788361690.505190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361690.505219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361690.505263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361690.505353:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019904 00000100:00100000:2.0:1788361690.505364:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019904 00000100:00100000:2.0:1788361690.505453:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 898 00000100:00100000:2.0:1788361690.505467:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407019904:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361690.505565:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407019904:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 101us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361690.505573:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 898 00000100:00100000:2.0:1788361690.505615:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407020032 00000100:00100000:2.0:1788361690.505619:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407020032 00000100:00100000:2.0:1788361690.505672:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407020160 00000100:00100000:2.0:1788361690.505675:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407020160 00000100:00100000:3.0:1788361690.505702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361690.505706:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1884 00000100:00100000:2.0:1788361690.505717:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407020032:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361690.505751:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407020032:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 37us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361690.505758:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1884 00000100:00100000:2.0:1788361690.505772:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1885 00000100:00100000:2.0:1788361690.505778:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407020160:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361690.505803:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407020160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361690.505810:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1885 00000100:00100000:2.0:1788361690.505877:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407019776 00000100:00100000:2.0:1788361690.505882:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407019776 00000100:00100000:2.0:1788361690.505908:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1265 00000100:00100000:2.0:1788361690.505914:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875230407019776:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:2.0:1788361690.505938:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361690.505973:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875230407019776:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 58us (274us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361690.505979:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1265 00000100:00080000:0.0:1788361690.505991:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361690.505997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361690.505999:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:2.0:1788361690.968346:0:75524:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444089 batchid updated 00000020:00080000:3.0:1788361690.968399:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000100:00080000:3.0:1788361690.968516:0:75544:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99d108c6c000 x1875230429828864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361690.968528:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:3.0:1788361691.222186:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361691.990218:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00000100:00080000:1.0:1788361691.990462:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361691.990469:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361691.990473:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361691.990482:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2726 00000100:00100000:2.0:1788361691.990485:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788361691.990487:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788361691.990494:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361691.990499:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429828992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361691.990520:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002d55180 x1875230429829120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361691.990554:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361691.990560:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1788361691.990560:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429829120:0@lo:38:kworker.0 00000400:00000100:2.0:1788361691.990561:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429828992 offset 0 length 224: 4 00000100:00080000:1.0:1788361691.990563:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361691.990570:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2726 00000100:00080000:1.0:1788361691.990573:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788361691.990577:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361691.990590:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002d55c00 x1875230429829376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361691.990608:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361691.990617:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361691.990619:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361691.990623:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2726 00000100:00080000:1.0:1788361691.990626:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788361691.990630:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361691.990645:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002d54380 x1875230429829632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361691.990648:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429829504:0@lo:400:kworker.0 00000100:00080000:1.0:1788361691.990673:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361691.990676:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361691.990678:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361691.990681:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2726 00000100:00080000:1.0:1788361691.990684:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788361691.990687:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361691.990699:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1076a5c00 x1875230429830016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361691.990720:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429829248:0@lo:400:kworker.0 00000100:00100000:2.0:1788361691.990909:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429829760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361691.990941:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361691.990962:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361691.990967:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429829888:0@lo:400:kworker.0 00000100:00100000:2.0:1788361691.990987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361691.991042:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829760 00000100:00100000:2.0:1788361691.991053:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829760 00000100:00100000:0.0:1788361691.991097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361691.991134:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429829376:0@lo:38:kworker.0 00000100:00100000:2.0:1788361691.991158:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829888 00000100:00100000:2.0:1788361691.991163:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829888 00000100:00100000:0.0:1788361691.991168:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361691.991191:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429829632:0@lo:38:kworker.0 00000100:00100000:2.0:1788361691.991200:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1788361691.991211:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429829760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361691.991222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361691.991245:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429830016:0@lo:38:kworker.0 00000100:00100000:0.0:1788361691.991280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361691.991289:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429829760:12345-0@lo:400:kworker.0 Request processed in 78us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361691.991298:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1788361691.991319:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:2.0:1788361691.991325:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429829888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361691.991337:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829632 00000100:00100000:0.0:1788361691.991343:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829632 00000100:00100000:2.0:1788361691.991370:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429829888:12345-0@lo:400:kworker.0 Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361691.991377:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1788361691.991385:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145 00000100:00100000:0.0:1788361691.991391:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429829632:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788361691.991397:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361691.991402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361691.991413:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829120 00010000:00020000:0.0:1788361691.991414:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361691.991418:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829120 00000100:00100000:2.0:1788361691.991449:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829376 00000100:00100000:2.0:1788361691.991452:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829376 00000100:00100000:0.0:1788361691.991461:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429829632:12345-0@lo:38:kworker.0 Request processed in 68us (238us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361691.991470:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145 00000100:00100000:2.0:1788361691.991474:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830016 00000100:00100000:2.0:1788361691.991480:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830016 00000100:00100000:2.0:1788361691.991505:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1788361691.991511:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429829120:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1788361691.991515:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361691.991522:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361691.991528:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429829632:0@lo:38:kworker.0 00010000:00020000:2.0:1788361691.991539:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361691.991569:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1788361691.991576:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429829376:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361691.991586:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429829120:12345-0@lo:38:kworker.0 Request processed in 73us (804us total) trans 0 rc -19/-19 00010000:00020000:0.0:1788361691.991588:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361691.991600:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1788361691.991621:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1788361691.991627:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429829376:12345-0@lo:38:kworker.0 Request processed in 47us (458us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361691.991632:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429830016:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361691.991639:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00010000:00020000:2.0:1788361691.991648:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788361691.991685:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361691.991690:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361691.991696:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429830016:12345-0@lo:38:kworker.0 Request processed in 62us (412us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361691.991697:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429829376:0@lo:38:kworker.0 00000100:00100000:2.0:1788361691.991712:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00080000:0.0:1788361691.991715:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361691.991720:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361691.991723:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429830016:0@lo:38:kworker.0 00000100:00080000:0.0:1788361691.991733:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361691.991737:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361691.991741:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429829120:0@lo:38:kworker.0 00000100:00100000:2.0:1788361691.991777:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429829888:0@lo:400:kworker.0 00000100:00100000:2.0:1788361691.991791:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429829760:0@lo:400:kworker.0 00000100:00100000:3.0:1788361691.991853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361691.992366:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361691.992583:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829504 00000100:00100000:2.0:1788361691.992584:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429829248 00000100:00100000:0.0:1788361691.992590:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829504 00000100:00100000:2.0:1788361691.992591:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429829248 00000100:00100000:2.0:1788361691.992798:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1788361691.992809:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429829248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361691.992907:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429829248:12345-0@lo:400:kworker.0 Request processed in 101us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361691.992915:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1788361691.993005:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429829248:0@lo:400:kworker.0 00000100:00080000:1.0:1788361691.993979:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361691.995196:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1788361691.995220:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429829504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361691.995328:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429829504:12345-0@lo:400:kworker.0 Request processed in 120us (3475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361691.995336:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1788361691.995401:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429829504:0@lo:400:kworker.0 00010000:00010000:3.0:1788361692.247539:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361693.013969:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:3.0:1788361693.270004:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361694.037959:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:1.0:1788361694.294134:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361695.062011:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00000100:00100000:0.0:1788361695.062353:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361695.062368:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429830144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361695.062423:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361695.062434:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429830272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361695.062443:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361695.062561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361695.063382:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830144 00000100:00100000:2.0:1788361695.063383:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830272 00000100:00100000:2.0:1788361695.063392:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830272 00000100:00100000:1.0:1788361695.063393:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830144 00000100:00100000:1.0:1788361695.063518:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1788361695.063529:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429830272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361695.063559:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361695.063623:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429830272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361695.063631:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1788361695.063659:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788361695.063665:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429830144:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788361695.063712:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361695.063717:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788361695.063740:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361695.063786:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429830144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361695.063793:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:2.0:1788361695.063862:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429830144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361695.064160:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429830272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788361695.318014:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361695.628452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000400:00000100:0.0:1788361695.628490:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407020288 offset 0 length 224: 4 00000100:00100000:0.0:1788361695.628518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361695.628548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361695.628580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361695.628612:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407020416 00000100:00100000:0.0:1788361695.628635:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407020416 00000100:00100000:0.0:1788361695.628669:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407020544 00000100:00100000:0.0:1788361695.628672:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407020544 00000100:00100000:0.0:1788361695.628718:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 901 00000100:00100000:0.0:1788361695.628729:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407020544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361695.628799:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407020544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361695.628806:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 901 00000100:00100000:0.0:1788361695.628846:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1269 00000100:00100000:0.0:1788361695.628852:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230407020416:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:0.0:1788361695.628876:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361695.628906:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230407020416:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 52us (462us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361695.628914:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1269 00000100:00080000:0.0:1788361695.628949:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361695.629105:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407020672 00000100:00100000:3.0:1788361695.629110:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407020672 00000100:00100000:3.0:1788361695.629161:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407020800 00000100:00100000:3.0:1788361695.629165:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407020800 00000100:00100000:3.0:1788361695.629195:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1888 00000100:00100000:3.0:1788361695.629205:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407020672:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361695.629241:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407020672:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.629249:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1888 00000100:00100000:3.0:1788361695.629269:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1889 00000100:00100000:3.0:1788361695.629277:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407020800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361695.629304:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407020800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.629311:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1889 00000100:00080000:0.0:1788361695.629478:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361695.629484:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361696.086011:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:0.0:1788361696.343729:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361697.109978:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00000100:00100000:0.0:1788361697.110194:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788361697.110215:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361697.110220:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361697.110223:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361697.110231:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2731 00000100:00080000:2.0:1788361697.110236:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361697.110244:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361697.110267:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd45c00 x1875230429830528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361697.110348:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429830528:0@lo:38:kworker.0 00000100:00100000:1.0:1788361697.110415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361697.110539:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429830656:0@lo:400:kworker.0 00000100:00100000:0.0:1788361697.110569:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361697.110602:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429830400:0@lo:400:kworker.0 00000400:00000100:0.0:1788361697.110627:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429830400 offset 0 length 224: 4 00000100:00100000:0.0:1788361697.110669:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830656 00000100:00100000:0.0:1788361697.110676:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830656 00000100:00100000:1.0:1788361697.110731:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830528 00000100:00100000:1.0:1788361697.110736:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830528 00000100:00100000:0.0:1788361697.110756:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1788361697.110768:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429830656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361697.110770:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1788361697.110779:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429830528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361697.110800:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361697.110876:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429830528:12345-0@lo:38:kworker.0 Request processed in 96us (458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361697.110885:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1788361697.110885:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429830656:12345-0@lo:400:kworker.0 Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361697.110897:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00080000:0.0:1788361697.110924:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361697.110930:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361697.110935:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361697.110940:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429830528:0@lo:38:kworker.0 00000100:00100000:0.0:1788361697.110977:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429830656:0@lo:400:kworker.0 00000100:00080000:2.0:1788361697.111346:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361697.111351:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361697.111353:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361697.111358:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2731 00000100:00080000:2.0:1788361697.111361:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361697.111366:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361697.111388:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44a80 x1875230429830784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361697.111458:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429830912:0@lo:400:kworker.0 00000100:00100000:1.0:1788361697.111474:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429830784:0@lo:38:kworker.0 00000100:00100000:0.0:1788361697.111493:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361697.111532:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361697.111536:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361697.111539:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361697.111543:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2731 00000100:00080000:2.0:1788361697.111546:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361697.111551:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361697.111573:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd47800 x1875230429831040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361697.111638:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830912 00000100:00100000:0.0:1788361697.111643:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830912 00000100:00100000:0.0:1788361697.111697:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1788361697.111707:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429830912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361697.111755:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429830912:12345-0@lo:400:kworker.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361697.111762:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00080000:0.0:1788361697.111785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361697.111808:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429830912:0@lo:400:kworker.0 00000100:00100000:0.0:1788361697.111853:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361697.111995:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361697.111999:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361697.112001:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361697.112005:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2731 00000100:00080000:2.0:1788361697.112008:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788361697.112012:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361697.112025:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44e00 x1875230429831424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361697.112049:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429831296:0@lo:400:kworker.0 00000100:00100000:2.0:1788361697.112084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361697.112087:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429830784 00000100:00100000:1.0:1788361697.112092:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429830784 00000100:00100000:1.0:1788361697.112124:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1788361697.112126:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831296 00000100:00100000:1.0:1788361697.112130:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429830784:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361697.112133:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831296 00010000:00020000:1.0:1788361697.112154:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361697.112180:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:2.0:1788361697.112189:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429831296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361697.112238:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429831296:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361697.112252:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00080000:2.0:1788361697.112271:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361697.112281:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429831168:0@lo:400:kworker.0 00000100:00100000:2.0:1788361697.112310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361697.112343:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831168 00000100:00100000:2.0:1788361697.112347:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831168 00000100:00100000:2.0:1788361697.112374:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:2.0:1788361697.112381:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429831168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361697.112425:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429831168:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361697.112431:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00080000:2.0:1788361697.112448:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361697.112464:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429831296:0@lo:400:kworker.0 00000100:00100000:0.0:1788361697.112814:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429831040:0@lo:38:kworker.0 00000100:00100000:0.0:1788361697.112871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361697.112900:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429830784:12345-0@lo:38:kworker.0 Request processed in 768us (1045us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361697.112906:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429831424:0@lo:38:kworker.0 00000100:00100000:1.0:1788361697.112912:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1788361697.112953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361697.112997:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831424 00000100:00100000:1.0:1788361697.113002:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831424 00000100:00100000:1.0:1788361697.113025:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788361697.113029:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429831424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361697.113042:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361697.113129:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429831168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361697.113130:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429831424:12345-0@lo:38:kworker.0 Request processed in 97us (174us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788361697.113130:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361697.113140:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361697.113146:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1788361697.113148:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429831424:0@lo:38:kworker.0 00000100:00080000:0.0:1788361697.113166:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361697.113179:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361697.113183:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429830784:0@lo:38:kworker.0 00000100:00100000:0.0:1788361697.113216:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831040 00000100:00100000:0.0:1788361697.113220:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831040 00000100:00100000:0.0:1788361697.113250:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146 00000100:00100000:0.0:1788361697.113256:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429831040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788361697.113269:0:23939:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361697.113309:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429831040:12345-0@lo:38:kworker.0 Request processed in 51us (437us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361697.113316:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146 00000100:00080000:1.0:1788361697.113406:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361697.113411:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361697.113414:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429831040:0@lo:38:kworker.0 00010000:00010000:3.0:1788361697.366380:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788361697.672198:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407020928 offset 0 length 224: 4 00000100:00100000:1.0:1788361697.673062:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361697.673159:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021056 00000100:00100000:0.0:1788361697.673171:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021056 00000100:00100000:0.0:1788361697.673258:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1273 00000100:00100000:0.0:1788361697.673267:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230407021056:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:0.0:1788361697.673292:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361697.673353:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1875230407021056:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 86us (293us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361697.673360:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1273 00000100:00100000:0.0:1788361697.675814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361697.675869:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361697.675873:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021184 00000100:00100000:1.0:1788361697.675883:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021184 00000100:00100000:0.0:1788361697.675909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361697.675923:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021312 00000100:00100000:2.0:1788361697.675929:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021312 00000100:00100000:0.0:1788361697.675941:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021440 00000100:00100000:0.0:1788361697.675958:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021440 00000100:00100000:2.0:1788361697.675982:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1892 00000100:00100000:2.0:1788361697.675993:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407021312:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361697.676011:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 904 00000100:00100000:1.0:1788361697.676022:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407021184:12345-192.168.204.35@tcp:38:kworker.0 00010000:02000400:1.0:1788361697.676047:0:66901:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0001: Client f1e400d1-472b-42d1-b5e7-e80dc701272a (at 192.168.204.35@tcp) reconnecting 00000100:00100000:2.0:1788361697.676059:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407021312:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361697.676125:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1892 00000100:00100000:2.0:1788361697.676145:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1893 00000100:00100000:2.0:1788361697.676152:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407021440:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361697.676171:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407021440:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361697.676175:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1893 00000100:00080000:0.0:1788361697.676194:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361697.676199:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361697.676201:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788361697.679998:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp ffff99d1054f4000 cur 2737 last 1788361697 00000004:00100000:1.0:1788361697.680032:0:66901:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.204.35@tcp supports cksum type f7, return f7 00000100:00080000:1.0:1788361697.680064:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d1054f6800 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1788361697.680074:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d1054f6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361697.680152:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407021184:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 4132us (4345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361697.680163:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 904 00000100:00100000:0.0:1788361697.688897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361697.689080:0:66135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407018752 00000100:00100000:2.0:1788361697.689090:0:66135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407018752 00000100:00100000:2.0:1788361697.689203:0:66135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788361697.689214:0:66135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70977:x1875230407018752:12345-192.168.204.35@tcp:700:cp.0 00000100:00080000:2.0:1788361697.689281:0:66135:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99d136ef3b80 x1875230429831552/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361697.689301:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 0 seconds 00000100:00100000:1.0:1788361698.135153:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00000020:01000004:3.0:1788361698.345010:0:92291:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788361698.345018:0:92291:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788361698.345019:0:92291:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788361698.345134:0:92291:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d0057c2000 00000020:01000004:3.0:1788361698.345151:0:92291:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788361698.345166:0:92291:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788361698.345181:0:92291:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d137c04d40) 00000020:00000080:3.0:1788361698.345199:0:92291:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788361698.390154:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788361698.399171:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788361698.403477:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.404799:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.405802:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.406084:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.406300:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.406631:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.406867:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.407116:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.407298:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.408161:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.408378:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.408699:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.408884:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.409144:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.409398:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.409694:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.411602:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.412130:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788361698.412396:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.412642:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788361698.412860:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.413467:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788361698.413758:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.414037:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788361698.414446:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.414903:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.415329:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788361698.415633:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788361698.415924:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.416207:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.416543:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788361698.416815:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788361698.417402:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788361698.419536:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.428057:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788361698.428808:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788361698.429027:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788361698.429408:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788361698.430393:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.430858:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788361698.431232:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.432978:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.435178:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.436019:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.436914:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788361698.437260:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.438778:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.440204:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.440674:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.441320:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.441911:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788361698.442443:0:92291:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788361698.443266:0:92291:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788361698.443490:0:92291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788361698.443499:0:92291:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788361698.443510:0:92291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe37d4 00000020:01000004:1.0:1788361698.443517:0:92291:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788361698.443530:0:92291:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788361698.443644:0:92291:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d0057c2000 from MGS 00000020:01000004:1.0:1788361698.443648:0:92291:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788361698.443660:0:92291:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d104014d40) 00000020:00000080:1.0:1788361698.443674:0:92291:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1788361698.443737:0:92291:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d0057c2000 from MGS, refs=2 00080000:01000000:1.0:1788361698.443742:0:92291:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788361698.443748:0:92291:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe37e2 00010000:00010000:1.0:1788361698.444021:0:92291:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788361698.449107:0:92291:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788361698.450272:0:92295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788361698.450298:0:92291:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788361698.450336:0:92291:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361698.451325:0:92291:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788361698.451627:0:92291:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361698.451783:0:92291:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788361698.451789:0:92291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788361698.452949:0:92291:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788361698.452957:0:92291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788361698.453695:0:92291:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788361698.453704:0:92291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361698.454466:0:92291:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361698.454494:0:92291:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788361698.454496:0:92291:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788361698.454500:0:92291:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1788361698.454506:0:92291:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788361698.454512:0:92291:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788361698.454516:0:92291:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788361698.454518:0:92291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788361698.454527:0:92291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d1170df480 x1875230429827200/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361698.454589:0:92291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d002d57100 x1875230429828992/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361698.454612:0:92291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d12cd46a00 x1875230429830400/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361713 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788361698.454627:0:92291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788361698.454631:0:92291:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788361698.454632:0:92291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788361698.454636:0:92291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788361698.454661:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429830400:0@lo:400:kworker.0 00000100:00100000:0.0:1788361698.454703:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429828992:0@lo:400:kworker.0 00000100:00100000:2.0:1788361698.454998:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429827200:0@lo:400:kworker.0 10000000:01000000:0.0:1788361698.455128:0:92291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788361698.455144:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455166:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455173:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788361698.455253:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455263:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe339e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe33a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455280:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455287:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455293:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455296:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455300:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371ff000/0x1b69fa8920fe3304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455309:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455316:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455321:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455323:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455327:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fe800/0x1b69fa8920fe3320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3327 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455347:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455354:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455360:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455364:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455368:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371ff600/0x1b69fa8920fe334a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3351 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455376:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455383:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455388:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455392:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455396:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe335f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455406:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455413:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455419:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455428:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455432:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d14166ac00/0x1b69fa8920fe3374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455442:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455449:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455453:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455457:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455461:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe3382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455470:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455477:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455482:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455488:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455492:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917e00/0x1b69fa8920fe33ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe33b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455506:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455513:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455529:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455534:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455538:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fe200/0x1b69fa8920fe3312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3319 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455553:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455657:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455662:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361698.455782:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455788:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fec00/0x1b69fa8920fe332e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3335 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.455802:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.455808:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.455813:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361698.455987:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.455992:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fe400/0x1b69fa8920fe333c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3343 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.456004:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.456022:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.456027:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361698.456105:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.456111:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1371fe000/0x1b69fa8920fe3366 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.456121:0:92291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361698.456128:0:92291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.456134:0:92291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361698.456264:0:92291:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788361698.456270:0:92291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309000/0x1b69fa8920fe3390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3397 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788361698.456287:0:92291:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99d1054f2000 already not connected (conn 51, was 0): DISCONN 00000100:00080000:0.0:1788361698.456292:0:92291:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361698.456297:0:92291:0:(import.c:510:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 2705 00000100:00080000:0.0:1788361698.456304:0:92291:0:(import.c:624:import_select_connection()) MGC192.168.204.135@tcp: import ffff99d1054f2000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361698.456329:0:92291:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d004a08000 x1875230429831680/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361698.456357:0:92291:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1788361698.456432:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429831680:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788361698.456492:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.456534:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831680 00000100:00100000:2.0:1788361698.456541:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831680 00000100:00100000:2.0:1788361698.456578:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361698.456585:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875230429831680:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788361698.456610:0:92296:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo t0 exp 0000000000000000 cur 2738 last 0 00000020:00000080:2.0:1788361698.456638:0:92296:0:(genops.c:1406:class_connect()) connect: client c8a6f36d-efb9-41cf-af98-5917323f2b0d, cookie 0x1b69fa8920fe37e9 00000100:00080000:2.0:1788361698.456753:0:92296:0:(import.c:65:import_set_state_nolock()) ffff99d11e630800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361698.456799:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:3649:x1875230429831680:12345-0@lo:250:mount.lustre.0 Request processed in 214us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.456806:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361698.456844:0:3649:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 28 00000100:00080000:3.0:1788361698.456852:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:3.0:1788361698.456860:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788361698.456864:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788361698.456868:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788361698.456871:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788361698.456892:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788361698.456901:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429831680:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1788361698.456917:0:85876:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.135@tcp 10000000:01000000:2.0:1788361698.456944:0:85876:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788361698.456948:0:85876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788361698.456950:0:85876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361698.456953:0:85876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361698.456954:0:85876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361698.456956:0:85876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361698.456957:0:85876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361698.456959:0:85876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361698.456961:0:85876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361698.456962:0:85876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788361698.456993:0:85876:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788361698.456996:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429831808:0@lo:253:kworker.0 10000000:01000000:2.0:1788361698.456999:0:85876:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788361698.457001:0:85876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788361698.457009:0:85876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788361698.457010:0:85876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361698.457011:0:85876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361698.457013:0:85876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361698.457015:0:85876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361698.457016:0:85876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361698.457017:0:85876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361698.457018:0:85876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:0.0:1788361698.457029:0:92291:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000100:00100000:3.0:1788361698.457030:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788361698.457043:0:92291:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:2.0:1788361698.457046:0:85876:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788361698.457052:0:85876:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788361698.457055:0:85876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788361698.457056:0:85876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788361698.457058:0:85876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361698.457059:0:85876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361698.457060:0:85876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361698.457061:0:85876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361698.457063:0:85876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361698.457064:0:85876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361698.457065:0:85876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788361698.457068:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429831936:0@lo:253:kworker.0 00000100:00100000:3.0:1788361698.457069:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831808 00000100:00100000:3.0:1788361698.457075:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831808 00000020:01000000:2.0:1788361698.457079:0:85876:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788361698.457107:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429832064:0@lo:253:kworker.0 00000100:00100000:0.0:1788361698.457115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.457151:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.457181:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831936 00000100:00100000:2.0:1788361698.457185:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831936 00000100:00100000:3.0:1788361698.457188:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832064 00000100:00100000:3.0:1788361698.457190:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832064 00000100:00100000:2.0:1788361698.457199:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361698.457205:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3653:x1875230429831808:12345-0@lo:253:kworker.0 00000100:00100000:3.0:1788361698.457209:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361698.457214:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3650:x1875230429831936:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788361698.457224:0:92296:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788361698.457227:0:92299:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:0.0:1788361698.457262:0:92291:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788361698.457267:0:92291:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788361698.457361:0:92291:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788361698.457383:0:92291:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788361698.457387:0:92291:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788361698.457388:0:92291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361698.457390:0:92291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361698.457391:0:92291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361698.457392:0:92291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361698.457393:0:92291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361698.457394:0:92291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361698.457396:0:92291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361698.457397:0:92291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361698.457398:0:92291:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361698.457400:0:92291:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788361698.457402:0:92291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361698.457403:0:92291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361698.457403:0:92291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361698.457404:0:92291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361698.457405:0:92291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361698.457406:0:92291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361698.457406:0:92291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361698.457407:0:92291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361698.457408:0:92291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361698.457408:0:92291:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361698.457419:0:92291:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788361698.457427:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832192:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361698.457452:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.457461:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c966c0 going to sleep for 11 seconds 10000000:01000000:1.0:1788361698.457624:0:92300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1788361698.458611:0:92297:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788361698.458617:0:92297:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788361698.458771:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832192 00000100:00100000:1.0:1788361698.458778:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832192 00000100:00100000:0.0:1788361698.458843:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361698.458853:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429832064:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788361698.458883:0:92301:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361698.459343:0:92296:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 119 20000000:01000000:2.0:1788361698.461015:0:92302:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788361698.461023:0:92302:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788361698.461026:0:92302:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788361698.461029:0:92302:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788361698.461263:0:92302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788361698.461508:0:92296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361698.461530:0:92296:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361698.463085:0:92296:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361698.463097:0:92296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788361698.463136:0:92300:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361698.463143:0:92300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788361698.463178:0:92299:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1788361698.463178:0:92300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463198:0:92300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361698.463209:0:92300:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067076s 00010000:00010000:1.0:1788361698.463213:0:92300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463220:0:92300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463228:0:92300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463235:0:92300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463241:0:92300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361698.463246:0:92300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463255:0:92300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463282:0:92300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463290:0:92300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.463297:0:92300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe37f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.463490:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3653:x1875230429831808:12345-0@lo:253:kworker.0 Request processed in 6279us (6455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.463502:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1788361698.463519:0:3653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361698.463529:0:3653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361698.463531:0:3653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361698.463533:0:3653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361698.463535:0:3653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361698.463536:0:3653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361698.463538:0:3653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361698.463540:0:3653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361698.463542:0:3653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361698.463547:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429831808:0@lo:253:kworker.0 00000100:00100000:0.0:1788361698.463547:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361698.463561:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92291:x1875230429832192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361698.463607:0:92296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361698.463610:0:92296:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361698.463612:0:92296:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788361698.463617:0:92296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788361698.465253:0:92299:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361698.465275:0:92299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788361698.465303:0:92301:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788361698.465345:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92291:x1875230429832192:12345-0@lo:253:mount.lustre.0 Request processed in 1786us (7888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.465355:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361698.465419:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361698.465433:0:92291:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788361698.465436:0:92291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361698.465439:0:92291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361698.465440:0:92291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361698.465441:0:92291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361698.465442:0:92291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361698.465443:0:92291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361698.465444:0:92291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361698.465446:0:92291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361698.465448:0:92291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361698.465450:0:92291:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361698.465470:0:92291:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d0057c2000 from lustre-MDT0000 00000100:00100000:3.0:1788361698.465480:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:3650:x1875230429831936:12345-0@lo:253:kworker.0 Request processed in 8263us (8367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.465489:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:0.0:1788361698.465498:0:92291:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788361698.465507:0:92291:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00000020:01000004:1.0:1788361698.465511:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788361698.465514:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361698.465516:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 10000000:01000000:0.0:1788361698.465518:0:92291:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d0057c2000 00000020:01000004:1.0:1788361698.465519:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361698.465523:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361698.465525:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 10000000:01000000:0.0:1788361698.465525:0:92291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:01000004:1.0:1788361698.465529:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361698.465532:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 10000000:01000000:0.0:1788361698.465534:0:92291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99d0057c2000 00000020:01000004:1.0:1788361698.465535:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361698.465540:0:92291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 00000100:00100000:1.0:1788361698.465542:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429831936:0@lo:253:kworker.0 10000000:01000000:0.0:1788361698.465546:0:92291:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d0057c2000 from 1 10000000:01000000:0.0:1788361698.465550:0:92291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361698.465584:0:92291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465593:0:92291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465602:0:92291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.465620:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361698.465653:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.465689:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96600 going to sleep for 11 seconds 20000000:01000000:0.0:1788361698.465703:0:92300:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361698.465706:0:92300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361698.465717:0:92300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465729:0:92300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361698.465737:0:92300:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067076s 00010000:00010000:0.0:1788361698.465742:0:92300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465749:0:92300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465762:0:92300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465770:0:92300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.465777:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832320 00010000:00010000:0.0:1788361698.465777:0:92300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361698.465784:0:92300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.465786:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832320 00010000:00010000:0.0:1788361698.465796:0:92300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465808:0:92300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465817:0:92300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.465849:0:92300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe37fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.465862:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361698.465871:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92291:x1875230429832320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361698.465886:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361698.466043:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100030000/0x1b69fa8920fe3805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe37f7 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.466072:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100030000/0x1b69fa8920fe3805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe37f7 expref: 7 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.466082:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100030000/0x1b69fa8920fe3805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe37f7 expref: 7 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.466099:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030000, rc 0) 00000100:00100000:0.0:1788361698.466350:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92291:x1875230429832320:12345-0@lo:101:mount.lustre.0 Request processed in 480us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.466357:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361698.466468:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361698.466478:0:92291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361698.466492:0:92291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361698.466508:0:92291:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788361698.466518:0:92291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361698.466526:0:92291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361698.466533:0:92291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788361698.466537:0:92291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361698.466542:0:92291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d0057c2000 10000000:01000000:2.0:1788361698.466545:0:92291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788361698.466548:0:92291:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788361698.466550:0:92291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361698.466566:0:92291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361698.466573:0:92291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361698.466581:0:92291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361698.466594:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361698.466622:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.466877:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361698.467115:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832448 00000100:00100000:3.0:1788361698.467120:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832448 00000100:00100000:3.0:1788361698.467158:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361698.467166:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92291:x1875230429832448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361698.467176:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361698.467189:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe380c expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.467206:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 8 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.467221:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 8 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.467229:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207ce00, rc 0) 00000100:00100000:3.0:1788361698.467270:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92291:x1875230429832448:12345-0@lo:101:mount.lustre.0 Request processed in 105us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.467276:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361698.467395:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361698.467409:0:92291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361698.467418:0:92291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361698.467470:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361698.467496:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.467520:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.467803:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832576 00000100:00100000:0.0:1788361698.467808:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832576 00000100:00100000:0.0:1788361698.467869:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361698.467880:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92291:x1875230429832576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361698.468244:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361698.468244:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429832576:12345-0@lo:501:mount.lustre.0 Request processed in 365us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.468258:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361698.468282:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361698.468395:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.468425:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.468500:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832704 00000100:00100000:0.0:1788361698.468505:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832704 00000100:00100000:0.0:1788361698.468537:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361698.468545:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429832704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361698.469285:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429832704:12345-0@lo:503:mount.lustre.0 Request processed in 739us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.469294:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361698.469315:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429832704:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1788361698.469883:0:92301:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361698.469893:0:92301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788361698.470022:0:92300:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361698.470028:0:92300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361698.470049:0:92300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470069:0:92300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361698.470085:0:92300:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067076s 00010000:00010000:1.0:1788361698.470090:0:92300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470097:0:92300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470104:0:92300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470111:0:92300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470117:0:92300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361698.470122:0:92300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470130:0:92300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470143:0:92300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.470151:0:92300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.470157:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429832064:12345-0@lo:253:kworker.0 Request processed in 11302us (13003us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361698.470160:0:92300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe381a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.470171:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788361698.470180:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788361698.470183:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788361698.470185:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361698.470187:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361698.470189:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361698.470191:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361698.470193:0:3651:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361698.470196:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361698.470198:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788361698.470202:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429832064:0@lo:253:kworker.0 00000100:00100000:3.0:1788361698.470779:0:92303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92303:1875230429832832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361698.470841:0:92303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.470875:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832832 00000100:00100000:3.0:1788361698.470877:0:92303:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.470883:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832832 00000100:00100000:0.0:1788361698.470942:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361698.470960:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92303:x1875230429832832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361698.472308:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92303:x1875230429832832:12345-0@lo:502:llog_process_th.0 Request processed in 1347us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.472319:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361698.472360:0:92303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92303:1875230429832832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361698.472395:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361698.472406:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.472414:0:92303:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361698.472420:0:92303:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788361698.472423:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361698.472436:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d137c019c0) 00000020:00000080:3.0:1788361698.472456:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788361698.472461:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788361698.472536:0:92303:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788361698.472543:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe3828 00000020:00000080:3.0:1788361698.472758:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361698.472762:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361698.472766:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.472767:0:92303:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361698.472770:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361698.472774:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.472775:0:92303:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788361698.472778:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361698.472785:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d1349b0000) 00000020:00000080:3.0:1788361698.472797:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788361698.472801:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788361698.472803:0:92303:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788361698.472805:0:92303:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788361698.472812:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788361698.472890:0:92303:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d0057c2000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788361698.472902:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d1349b19c0) 00000020:00000080:3.0:1788361698.472914:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788361698.472980:0:92303:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788361698.472985:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe383d 00000020:00000080:3.0:1788361698.473084:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788361698.473092:0:92303:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788361698.473096:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b69fa8920fe3844 00080000:01000000:3.0:1788361698.473101:0:92303:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788361698.473104:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe384b 00010000:00010000:2.0:1788361698.516310:0:92303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788361698.516742:0:92303:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116997 lx: 0 gen 22 00000001:00080000:2.0:1788361698.516798:0:92303:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f1e400d1-472b-42d1-b5e7-e80dc701272a idx: 2 lr: 0 srv lr: 115964116997 lx: 0 gen 24 00000001:00000004:2.0:1788361698.516940:0:92303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116997 00000001:00080000:1.0:1788361698.517411:0:92303:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1788361698.517483:0:92303:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d002c1b600: xid 1875230429822464, transno 115964116997, client gen 22, slot idx 1 00000001:00080000:1.0:1788361698.517495:0:92303:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d002c1b480: xid 1875230429822208, transno 115964116996, client gen 22, slot idx 2 00000020:00000080:1.0:1788361698.518030:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d104013380) 00000020:00000080:1.0:1788361698.518052:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1788361698.518134:0:92303:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788361698.518143:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe3867 00000020:00000080:3.0:1788361698.519146:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361698.522088:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b69fa8920fe386e 00000020:00000080:3.0:1788361698.522606:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788361698.522616:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361698.522620:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.522622:0:92303:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788361698.522625:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361698.522627:0:92303:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788361698.522628:0:92303:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361698.522629:0:92303:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361698.522630:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361698.522632:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.522632:0:92303:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361698.522634:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361698.522637:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.522638:0:92303:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788361698.522641:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788361698.522678:0:92303:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788361698.522694:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361698.522697:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.522699:0:92303:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788361698.522702:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361698.522705:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361698.522707:0:92303:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788361698.522710:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361698.522715:0:92303:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:3.0:1788361698.522738:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361698.522753:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d001c619c0) 00000020:00000080:3.0:1788361698.522770:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788361698.522775:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361698.522911:0:92303:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788361698.522917:0:92303:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788361698.522923:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe387c 00010000:00080000:3.0:1788361698.522968:0:92303:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d1171e2800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361698.525525:0:92303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1788361698.526599:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361698.526614:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788361698.526647:0:92303:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788361698.526670:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe3883 00000100:00080000:1.0:1788361698.526680:0:92303:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361698.526686:0:92303:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99d1171e2800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361698.526721:0:92303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1076a6d80 x1875230429832960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361698.526746:0:92303:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788361698.526787:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429832960:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788361698.526885:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361698.526890:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361698.526892:0:92303:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788361698.526895:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361698.526898:0:92303:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788361698.526899:0:92303:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361698.526901:0:92303:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361698.526903:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361698.526906:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361698.526908:0:92303:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361698.526911:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361698.526915:0:92303:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788361698.526920:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361698.526921:0:92303:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788361698.526944:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788361698.526948:0:92303:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1788361698.526967:0:92303:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788361698.526970:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1788361698.526976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788361698.526981:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d104010000) 00000020:00000080:1.0:1788361698.526998:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788361698.527003:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788361698.527050:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429832960 00000100:00100000:3.0:1788361698.527057:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429832960 00000004:00080000:1.0:1788361698.527088:0:92303:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:3.0:1788361698.527093:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147 00080000:01000000:1.0:1788361698.527096:0:92303:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00100000:3.0:1788361698.527102:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429832960:12345-0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788361698.527103:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe3891 00010000:00080000:3.0:1788361698.527130:0:8449:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2738 last 0 00010000:00080000:1.0:1788361698.527139:0:92303:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d006c8f000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00000020:00000080:3.0:1788361698.527166:0:8449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe3898 00000004:00100000:3.0:1788361698.527183:0:8449:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361698.527276:0:8449:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361698.527331:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429832960:12345-0@lo:38:llog_process_th.0 Request processed in 229us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.527339:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147 00000100:00100000:3.0:1788361698.527384:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361698.527394:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788361698.527402:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00010000:00010000:1.0:1788361698.527405:0:92303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:3.0:1788361698.527407:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788361698.527411:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1171e2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361698.527428:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429832960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361698.527480:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429833088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361698.527511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.527541:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833088 00000100:00100000:0.0:1788361698.527543:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833088 00000100:00100000:0.0:1788361698.527578:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148 00000100:00100000:0.0:1788361698.527584:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429833088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788361698.527605:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1788361698.527641:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429833088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.527648:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148 00000100:00100000:0.0:1788361698.527679:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d004a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429833088:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788361698.527703:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361698.527708:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361698.527709:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361698.527713:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2737 00000100:00080000:2.0:1788361698.527715:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361698.527718:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361698.527733:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136ef1880 x1875230429833216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361698.527766:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429833216:0@lo:38:kworker.0 00000100:00080000:2.0:1788361698.527768:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361698.527773:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361698.527775:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361698.527779:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2737 00000100:00080000:2.0:1788361698.527782:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361698.527785:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361698.527800:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136ef1180 x1875230429833472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361698.527804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361698.527849:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361698.527852:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361698.527854:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361698.527857:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2737 00000100:00080000:2.0:1788361698.527859:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788361698.527870:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361698.527891:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1170df480 x1875230429833728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361698.527919:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361698.527922:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361698.527924:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788361698.527926:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429833600:0@lo:400:kworker.0 00000100:00080000:2.0:1788361698.527941:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2737 00000100:00080000:2.0:1788361698.527944:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1788361698.527945:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429833856:0@lo:400:kworker.0 00000100:00080000:2.0:1788361698.527948:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361698.527961:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44a80 x1875230429834112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361698.527975:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361698.527982:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.528004:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833216 00000100:00100000:2.0:1788361698.528008:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833216 00000100:00100000:3.0:1788361698.528021:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833856 00000100:00100000:3.0:1788361698.528025:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833856 00000100:00100000:2.0:1788361698.528028:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833600 00000100:00100000:2.0:1788361698.528030:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833600 00000100:00100000:3.0:1788361698.528053:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:2.0:1788361698.528053:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1788361698.528058:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429833472:0@lo:38:kworker.0 00000100:00100000:3.0:1788361698.528063:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429833856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361698.528063:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429833600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361698.528091:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1788361698.528098:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.528102:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429833216:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361698.528113:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429833856:12345-0@lo:400:kworker.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.528113:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429833600:12345-0@lo:400:kworker.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.528121:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1788361698.528124:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429833728:0@lo:38:kworker.0 00000100:00100000:3.0:1788361698.528127:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:2.0:1788361698.528134:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833472 00000100:00100000:2.0:1788361698.528138:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833472 00000100:00100000:1.0:1788361698.528155:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429833216:12345-0@lo:38:kworker.0 Request processed in 54us (350us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788361698.528161:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1788361698.528165:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429833856:0@lo:400:kworker.0 00000100:00100000:2.0:1788361698.528171:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429833472:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788361698.528171:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1788361698.528252:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429833472:12345-0@lo:38:kworker.0 Request processed in 81us (153us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361698.528252:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.528262:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1788361698.528375:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429834112:0@lo:38:kworker.0 00000100:00100000:0.0:1788361698.528399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361698.528418:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361698.528421:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361698.528423:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429833216:0@lo:38:kworker.0 00000100:00100000:2.0:1788361698.528433:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834112 00000100:00080000:0.0:1788361698.528437:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788361698.528439:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834112 00000100:00080000:0.0:1788361698.528445:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361698.528448:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429833472:0@lo:38:kworker.0 00000100:00100000:2.0:1788361698.528463:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1788361698.528465:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429833984:0@lo:400:kworker.0 00000100:00100000:2.0:1788361698.528472:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429834112:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361698.528486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.528503:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361698.528507:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429833344:0@lo:400:kworker.0 00000100:00100000:2.0:1788361698.528522:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429834112:12345-0@lo:38:kworker.0 Request processed in 49us (119us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361698.528529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.528535:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1788361698.528552:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833344 00000100:00100000:0.0:1788361698.528554:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833984 00000100:00100000:2.0:1788361698.528556:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833344 00000100:00100000:0.0:1788361698.528558:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833984 00000100:00100000:2.0:1788361698.528584:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1788361698.528587:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:2.0:1788361698.528601:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429833344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361698.528601:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429833984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361698.528630:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429833984:12345-0@lo:400:kworker.0 Request processed in 37us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.528635:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:2.0:1788361698.528650:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429833344:12345-0@lo:400:kworker.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.528657:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1788361698.528660:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429833344:0@lo:400:kworker.0 00000100:00100000:0.0:1788361698.528671:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429833984:0@lo:400:kworker.0 00000100:00100000:3.0:1788361698.528723:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429833600:0@lo:400:kworker.0 00000100:00100000:3.0:1788361698.528740:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429833728 00000100:00100000:3.0:1788361698.528743:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429833728 00000100:00100000:3.0:1788361698.528763:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149 00000100:00100000:3.0:1788361698.528767:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429833728:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361698.528798:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429833728:12345-0@lo:38:kworker.0 Request processed in 29us (558us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361698.528804:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149 00000100:00080000:0.0:1788361698.529024:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361698.529028:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361698.529032:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429833728:0@lo:38:kworker.0 00000100:00080000:0.0:1788361698.529040:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361698.529043:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361698.529045:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429834112:0@lo:38:kworker.0 00000040:01000000:3.0:1788361698.529289:0:92303:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361698.529466:0:92303:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788361698.532313:0:92303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361698.532523:0:92303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:3.0:1788361698.535741:0:92303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:3.0:1788361698.536202:0:92309:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1788361698.536207:0:92309:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788361698.536662:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361698.536711:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788361698.536744:0:92303:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788361698.536763:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe389f 00000100:00080000:2.0:1788361698.536772:0:92303:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361698.536779:0:92303:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d006c8f000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361698.536808:0:92303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44e00 x1875230429834240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361698.536885:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429834240:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361698.536961:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361698.537069:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834240 00000100:00100000:3.0:1788361698.537077:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834240 00000100:00100000:3.0:1788361698.537117:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:3.0:1788361698.537125:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875230429834240:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788361698.537150:0:26159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2738 last 0 00000020:00000080:3.0:1788361698.537176:0:26159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe38a6 00002000:00100000:3.0:1788361698.537189:0:26159:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d001c6b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788361698.537194:0:26159:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788361698.537197:0:26159:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788361698.537258:0:26159:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361698.537279:0:26159:0:(import.c:65:import_set_state_nolock()) ffff99d001c6a000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788361698.537366:0:92303:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788361698.537418:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361698.537421:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.537423:0:92303:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788361698.537425:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361698.537426:0:92303:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788361698.537428:0:92303:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361698.537433:0:92303:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361698.537434:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361698.537436:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.537437:0:92303:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361698.537438:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361698.537441:0:92303:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788361698.537443:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.537444:0:92303:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788361698.537446:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361698.537448:0:92303:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788361698.537463:0:92303:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788361698.537465:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361698.537472:0:92303:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99d0042e3380) 00000020:00000080:2.0:1788361698.537483:0:92303:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788361698.537486:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788361698.537542:0:92303:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788361698.537549:0:92303:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788361698.537556:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe38b4 00010000:00080000:2.0:1788361698.537581:0:92303:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d11729c800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788361698.537805:0:92303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788361698.537893:0:92303:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361698.537908:0:92303:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788361698.537962:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429834240:12345-0@lo:8:llog_process_th.0 Request processed in 836us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.537965:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788361698.537974:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000100:00080000:0.0:1788361698.537974:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788361698.537984:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361698.537988:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788361698.537990:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d006c8f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788361698.538002:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361698.538007:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429834240:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788361698.538033:0:92309:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788361698.538072:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429834368:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788361698.538078:0:92309:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2738547254687ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788361698.538083:0:92309:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788361698.538107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.538147:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834368 00000100:00100000:2.0:1788361698.538188:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834368 00000100:00080000:0.0:1788361698.538216:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361698.538237:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1788361698.538245:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429834368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361698.538266:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361698.538305:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429834368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.538322:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1788361698.538337:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429834368:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788361698.539552:0:92292:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1788361698.540303:0:92303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361698.540763:0:92303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:0.0:1788361698.540909:0:92303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:0.0:1788361698.541224:0:92311:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:0.0:1788361698.541229:0:92311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788361698.541814:0:92303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361698.541924:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788361698.541974:0:92303:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788361698.541997:0:92303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe38bb 00000100:00080000:2.0:1788361698.542007:0:92303:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361698.542013:0:92303:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d11729c800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361698.542048:0:92303:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd45f80 x1875230429834496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361698.542076:0:92303:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788361698.542152:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429834496:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788361698.542216:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.542263:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834496 00000100:00100000:1.0:1788361698.542272:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834496 00000020:01000000:2.0:1788361698.542343:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361698.542347:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.542349:0:92303:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788361698.542352:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361698.542356:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.542357:0:92303:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788361698.542360:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788361698.542362:0:92303:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788361698.542363:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361698.542365:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.542366:0:92303:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788361698.542369:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361698.542371:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.542372:0:92303:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788361698.542376:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788361698.542403:0:92303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92303:1875230429834624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361698.542449:0:92303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.542463:0:92303:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.542530:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834624 00000100:00100000:0.0:1788361698.542535:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834624 00000100:00100000:0.0:1788361698.542574:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361698.542582:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92303:x1875230429834624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361698.542626:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4915 00000100:00100000:1.0:1788361698.542633:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3649:x1875230429834496:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788361698.542657:0:26160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2738 last 0 00000020:00000080:1.0:1788361698.542688:0:26160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe38c2 00000100:00100000:0.0:1788361698.542699:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92303:x1875230429834624:12345-0@lo:502:llog_process_th.0 Request processed in 116us (248us total) trans 0 rc 0/0 00002000:00100000:1.0:1788361698.542702:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d002ded000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788361698.542710:0:26160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:0.0:1788361698.542716:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00100000:1.0:1788361698.542722:0:26160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788361698.542788:0:26160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361698.542811:0:26160:0:(import.c:65:import_set_state_nolock()) ffff99d002de9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361698.542846:0:92303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92303:1875230429834624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361698.542880:0:92303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361698.542884:0:92303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361698.542887:0:92303:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000100:00100000:1.0:1788361698.542889:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429834496:12345-0@lo:8:llog_process_th.0 Request processed in 254us (671us total) trans 0 rc 0/0 00000040:00080000:2.0:1788361698.542892:0:92303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1788361698.542972:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4915 00000020:01000000:0.0:1788361698.543199:0:92291:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788361698.543234:0:92291:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361698.543250:0:92291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.543260:0:92291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.543274:0:92291:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d0057c2000 from 1 10000000:01000000:0.0:1788361698.543277:0:92291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361698.543302:0:92291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.543309:0:92291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.543317:0:92291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.543329:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429834752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361698.543354:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.543382:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.543406:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361698.543413:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788361698.543418:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361698.543422:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788361698.543431:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d11729c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788361698.543452:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834752 00000004:00080000:0.0:1788361698.543454:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361698.543457:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834752 00000100:00100000:0.0:1788361698.543462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429834496:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788361698.543482:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361698.543488:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:92291:x1875230429834752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361698.543495:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361698.543505:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe38c9 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.543520:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 9 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.543528:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 9 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.543533:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e400, rc 0) 00000100:00100000:1.0:1788361698.543559:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429834752:12345-0@lo:101:mount.lustre.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361698.543564:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:2.0:1788361698.543642:0:92311:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788361698.543660:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361698.543671:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429834880:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788361698.543695:0:92311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2738552870838ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788361698.543703:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:2.0:1788361698.543703:0:92311:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788361698.543724:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429834880 00000100:00100000:1.0:1788361698.543728:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429834880 00000100:00100000:0.0:1788361698.543756:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429834752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361698.543757:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1788361698.543766:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429834880:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788361698.543774:0:92291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1788361698.543780:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00010000:00010000:0.0:1788361698.543785:0:92291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.543842:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429834880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361698.543847:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1788361698.543920:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429834880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361698.544304:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835008:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788361698.544338:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.544485:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361698.544488:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835008 00000100:00100000:2.0:1788361698.544493:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835008 00000100:00080000:0.0:1788361698.544499:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361698.544523:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361698.544531:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429835008:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788361698.544546:0:92299:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788361698.544562:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788361698.544566:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788361698.544569:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788361698.544572:0:92299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 122 00000100:00100000:2.0:1788361698.544768:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429835008:12345-0@lo:256:mount.lustre.0 Request processed in 238us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.544776:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361698.544997:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835008:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788361698.545530:0:92291:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361698.545750:0:92291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.545761:0:92291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361698.545769:0:92291:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0057c2000 from 1 10000000:01000000:0.0:1788361698.545772:0:92291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361698.545799:0:92291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.545806:0:92291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.545815:0:92291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.545849:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361698.545886:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.545967:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361698.546153:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835136 00000100:00100000:1.0:1788361698.546162:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835136 00000100:00100000:1.0:1788361698.546216:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361698.546226:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:92291:x1875230429835136:12345-0@lo:101:mount.lustre.0 00000004:00080000:2.0:1788361698.546237:0:92292:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788361698.546237:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361698.546250:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785fc00/0x1b69fa8920fe38de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe38d7 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.546292:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785fc00/0x1b69fa8920fe38de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe38d7 expref: 10 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.546303:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785fc00/0x1b69fa8920fe38de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe38d7 expref: 10 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.546312:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785fc00, rc 0) 00000100:00100000:1.0:1788361698.546356:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92291:x1875230429835136:12345-0@lo:101:mount.lustre.0 Request processed in 132us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361698.546363:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361698.546384:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361698.546410:0:92291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.546422:0:92291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361698.546478:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361698.546505:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.546526:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361698.546556:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835264 00000100:00100000:3.0:1788361698.546561:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835264 00000100:00100000:3.0:1788361698.546597:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361698.546604:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92291:x1875230429835264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361698.546739:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92291:x1875230429835264:12345-0@lo:501:mount.lustre.0 Request processed in 135us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.546746:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361698.546819:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361698.546879:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361698.546924:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.547031:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361698.547461:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835392 00000100:00100000:1.0:1788361698.547467:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835392 00000100:00100000:1.0:1788361698.547502:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361698.547508:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92291:x1875230429835392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361698.547861:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92291:x1875230429835392:12345-0@lo:503:mount.lustre.0 Request processed in 351us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361698.547869:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361698.547981:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361698.548436:0:92313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92313:1875230429835520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361698.548480:0:92313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.548512:0:92313:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361698.548534:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835520 00000100:00100000:2.0:1788361698.548539:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835520 00000100:00100000:2.0:1788361698.548608:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361698.548616:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92313:x1875230429835520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361698.549029:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92313:x1875230429835520:12345-0@lo:502:llog_process_th.0 Request processed in 412us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.549036:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361698.549137:0:92313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92313:1875230429835520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361698.549159:0:92313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361698.549168:0:92313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361698.549171:0:92313:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361698.549178:0:92313:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d0057c2000 00000020:00000080:0.0:1788361698.549181:0:92313:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361698.549188:0:92313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361698.549190:0:92313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361698.549192:0:92313:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361698.549201:0:92313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361698.549204:0:92313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361698.549206:0:92313:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361698.549209:0:92313:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d0057c2000 00000020:00000080:0.0:1788361698.549211:0:92313:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788361698.549290:0:92313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92313:1875230429835648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361698.549323:0:92313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.549350:0:92313:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361698.549775:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835648 00000100:00100000:3.0:1788361698.549782:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835648 00000100:00100000:3.0:1788361698.549819:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361698.549854:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92313:x1875230429835648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361698.549955:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92313:x1875230429835648:12345-0@lo:502:llog_process_th.0 Request processed in 102us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.549969:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361698.550116:0:92313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92313:1875230429835648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361698.550136:0:92313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361698.550140:0:92313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361698.550141:0:92313:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788361698.550144:0:92313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788361698.550394:0:92291:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788361698.550421:0:92291:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361698.550472:0:92291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.550483:0:92291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361698.550533:0:92291:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788361698.550536:0:92291:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d0057c2000 10000000:01000000:3.0:1788361698.550539:0:92291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d0057c2000 10000000:01000000:3.0:1788361698.550543:0:92291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361698.550549:0:92291:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0057c2000 from 1 10000000:01000000:3.0:1788361698.550551:0:92291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361698.550588:0:92291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.550596:0:92291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.550605:0:92291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361698.550620:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361698.550652:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361698.550694:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.550738:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835776 00000100:00100000:0.0:1788361698.550744:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835776 00000100:00100000:0.0:1788361698.550778:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361698.550786:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:92291:x1875230429835776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361698.550795:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361698.550807:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe38e5 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.550858:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 11 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.550869:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 11 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361698.550878:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100031200, rc 0) 00000100:00100000:0.0:1788361698.550911:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429835776:12345-0@lo:101:mount.lustre.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.550924:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361698.551033:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361698.551063:0:92291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.551085:0:92291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361698.551132:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361698.551157:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361698.551180:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.551373:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429835904 00000100:00100000:0.0:1788361698.551378:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429835904 00000100:00100000:0.0:1788361698.551411:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361698.551418:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429835904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361698.551518:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429835904:12345-0@lo:501:mount.lustre.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.551525:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361698.551599:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429835904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361698.551630:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429836032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361698.551664:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361698.551689:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.551735:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836032 00000100:00100000:0.0:1788361698.551739:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836032 00000100:00100000:0.0:1788361698.551805:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361698.551811:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429836032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361698.551903:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429836032:12345-0@lo:503:mount.lustre.0 Request processed in 92us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.551909:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361698.552156:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429836032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361698.552476:0:92315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92315:1875230429836160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361698.552511:0:92315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.552566:0:92315:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.552602:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836160 00000100:00100000:0.0:1788361698.552607:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836160 00000100:00100000:0.0:1788361698.552669:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361698.552676:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92315:x1875230429836160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361698.552754:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92315:x1875230429836160:12345-0@lo:502:llog_process_th.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.552761:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361698.552847:0:92315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92315:1875230429836160:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788361698.552895:0:92315:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788361698.552908:0:92315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99d1040119c0) 00000020:00000080:1.0:1788361698.552942:0:92315:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788361698.554523:0:92315:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d0057c2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361698.554531:0:92315:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d0057c2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361698.554534:0:92315:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d0057c2000 4 00010000:00080000:1.0:1788361698.554569:0:92315:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d116c06800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788361698.556263:0:92315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788361698.556361:0:92315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788361698.556404:0:92315:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788361698.556415:0:92315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b69fa8920fe38fa 00000100:00080000:1.0:1788361698.556424:0:92315:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361698.556429:0:92315:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d116c06800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361698.556458:0:92315:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1076a5880 x1875230429836288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361698.556479:0:92315:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788361698.557150:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429836288:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361698.557217:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361698.557296:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836288 00000100:00100000:3.0:1788361698.557304:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836288 00000100:00100000:3.0:1788361698.557336:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1788361698.557343:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429836288:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361698.557394:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429836288:12345-0@lo:38:llog_process_th.0 Request processed in 50us (176us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361698.557400:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1788361698.557435:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361698.557442:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c06800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361698.557446:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788361698.557449:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429836288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361698.561875:0:92315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92315:1875230429836416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361698.561961:0:92315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.561999:0:92315:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361698.562019:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836416 00000100:00100000:1.0:1788361698.562025:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836416 00000100:00100000:1.0:1788361698.562060:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361698.562068:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92315:x1875230429836416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361698.562174:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92315:x1875230429836416:12345-0@lo:502:llog_process_th.0 Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361698.562182:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361698.562229:0:92315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92315:1875230429836416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361698.562267:0:92315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92315:1875230429836544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361698.562298:0:92315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.562313:0:92315:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361698.562499:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836544 00000100:00100000:3.0:1788361698.562503:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836544 00000100:00100000:3.0:1788361698.562532:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361698.562539:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92315:x1875230429836544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361698.562619:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92315:x1875230429836544:12345-0@lo:502:llog_process_th.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.562625:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361698.562635:0:92315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92315:1875230429836544:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788361698.562654:0:92315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788361698.563542:0:92291:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788361698.563564:0:92291:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361698.563590:0:92291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.563601:0:92291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361698.563652:0:92291:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788361698.563654:0:92291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361698.563656:0:92291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361698.563657:0:92291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361698.563658:0:92291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361698.563660:0:92291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361698.563661:0:92291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361698.563663:0:92291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361698.563665:0:92291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361698.563666:0:92291:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361698.563670:0:92291:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788361698.563672:0:92291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361698.563673:0:92291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361698.563674:0:92291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361698.563675:0:92291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361698.563676:0:92291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361698.563678:0:92291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361698.563679:0:92291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361698.563684:0:92291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361698.563685:0:92291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361698.563686:0:92291:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361698.563704:0:92291:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361698.563716:0:92291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429836672:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361698.563755:0:92291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.563774:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836672 00000100:00100000:1.0:1788361698.563779:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836672 00000100:00100000:3.0:1788361698.563781:0:92291:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361698.563809:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361698.563817:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429836672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361698.563858:0:92299:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788361698.563871:0:92299:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788361698.568308:0:92299:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361698.568330:0:92299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788361698.568445:0:92300:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361698.568450:0:92300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361698.568472:0:92300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.568489:0:92300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.568497:0:92300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.568534:0:92300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.568546:0:92300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 2838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.568575:0:92300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92300:1875230429836800:0@lo:104: 00000100:00100000:1.0:1788361698.568642:0:92300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361698.568718:0:92300:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361698.568871:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:92291:x1875230429836672:12345-0@lo:253:mount.lustre.0 Request processed in 5053us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.568882:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361698.568968:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788361698.568989:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836800 00000100:00100000:2.0:1788361698.568996:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836800 00000100:00100000:2.0:1788361698.569038:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788361698.569046:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00319c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:92300:x1875230429836800:12345-0@lo:104: 00010000:00010000:2.0:1788361698.569058:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.569132:0:92300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92300:1875230429836800:0@lo:104: 00010000:00010000:1.0:1788361698.569153:0:92300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361698.569173:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788361698.569180:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00319c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:92300:x1875230429836800:12345-0@lo:104: Request processed in 135us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.569185:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00010000:3.0:1788361698.569267:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361698.569273:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569281:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030e00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361698.569285:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569293:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361698.569299:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361698.569305:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361698.569341:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569347:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361698.569374:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d100030e00/0x1b69fa8920fe38c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe38d0 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361698.569387:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788361698.569395:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361698.569399:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361698.569400:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429836928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361698.569402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361698.569433:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.569481:0:92291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92291:1875230429836672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361698.569498:0:92291:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788361698.569501:0:92291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361698.569503:0:92291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361698.569504:0:92291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361698.569506:0:92291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361698.569507:0:92291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361698.569508:0:92291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361698.569509:0:92291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361698.569510:0:92291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361698.569512:0:92291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361698.569513:0:92291:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788361698.569524:0:92291:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788361698.569554:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429836928 00000100:00100000:3.0:1788361698.569559:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429836928 00010000:00010000:3.0:1788361698.569575:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 2838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361698.569604:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1788361698.569611:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3650:x1875230429836928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361698.569621:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361698.569625:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 2838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569634:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 2838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569648:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe38d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe38c9 expref: 11 pid: 92296 timeout: 2838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569666:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569674:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361698.569693:0:9528:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001244564s 00010000:00010000:3.0:1788361698.569697:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569704:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569710:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569717:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569723:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785f600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361698.569727:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.569734:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.570373:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361698.570385:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361698.570426:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:3650:x1875230429836928:12345-0@lo:103:ldlm_bl.0 Request processed in 815us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361698.570435:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1788361698.570468:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429836928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361698.570521:0:92300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.570686:0:92300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361698.570695:0:92300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785f600/0x1b69fa8920fe3901 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788361698.574976:0:92291:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411366 00000040:01000000:0.0:1788361698.575423:0:92291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788361698.575627:0:92321:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411366 00000020:00080000:2.0:1788361698.575631:0:92321:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411366 00000040:01000000:0.0:1788361698.575950:0:92322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361698.575976:0:92291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788361698.576241:0:92323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92323:1875230429837056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361698.576315:0:92323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361698.576411:0:92323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1398c7540 going to sleep for 11 seconds 00000040:00080000:3.0:1788361698.576421:0:92322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361698.576462:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837056 00000100:00100000:0.0:1788361698.576472:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837056 00000100:00100000:0.0:1788361698.576559:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150 00000100:00100000:0.0:1788361698.576570:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92323:x1875230429837056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361698.576651:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92323:x1875230429837056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.576658:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150 00000100:00100000:0.0:1788361698.576741:0:92323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92323:1875230429837056:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788361698.576769:0:92323:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788361698.576801:0:92323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92323:1875230429837184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361698.576887:0:92323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.576957:0:92323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361698.576994:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837184 00000100:00100000:2.0:1788361698.576998:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837184 00000100:00100000:2.0:1788361698.577066:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4151 00000100:00100000:2.0:1788361698.577075:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92323:x1875230429837184:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788361698.577096:0:92291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788361698.577143:0:92291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361698.577183:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92323:x1875230429837184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361698.577191:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4151 00000100:00100000:0.0:1788361698.577243:0:92323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92323:1875230429837184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361698.577290:0:92323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92323:1875230429837312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361698.577321:0:92323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361698.577346:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837312 00000100:00100000:0.0:1788361698.577350:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837312 00000100:00100000:0.0:1788361698.577372:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152 00000100:00100000:0.0:1788361698.577378:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92323:x1875230429837312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788361698.577420:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92323:x1875230429837312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361698.577426:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152 00000100:00100000:0.0:1788361698.577444:0:92323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361698.577456:0:92323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92323:1875230429837312:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788361698.577489:0:92323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788361698.585113:0:92291:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788361698.585137:0:92291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788361698.585237:0:92291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361698.597268:0:92322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788361698.597363:0:92322:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788361698.599734:0:92291:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788361698.599734:0:92323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788361698.599848:0:92323:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788361698.599854:0:92323:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788361698.600381:0:92291:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788361698.600419:0:92291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788361698.600544:0:92291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788361698.601032:0:92291:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00010000:00080000:0.0:1788361698.603161:0:92291:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116997 00010000:00080000:0.0:1788361698.604408:0:92324:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92324 00010000:02000000:0.0:1788361698.604471:0:92324:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788361698.604474:0:92324:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788361698.604477:0:92324:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788361698.604606:0:92291:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361698.604623:0:92291:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361698.604644:0:92291:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788361698.604675:0:92291:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788361698.606036:0:92291:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788361698.607158:0:92291:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788361698.712575:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 0 seconds 00000100:00100000:1.0:1788361699.157896:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:0.0:1788361699.414630:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361699.738901:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 0 seconds 00000100:00100000:3.0:1788361700.181944:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00000100:00100000:3.0:1788361700.181967:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429837568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361700.182022:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.182057:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361700.182058:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837568 00000100:00100000:3.0:1788361700.182065:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429837440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361700.182067:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837568 00000100:00100000:3.0:1788361700.182094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361700.182125:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837440 00000100:00100000:2.0:1788361700.182129:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837440 00000100:00100000:3.0:1788361700.182130:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1788361700.182140:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429837568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361700.182157:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:2.0:1788361700.182168:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429837440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361700.182169:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00002000:00000024:2.0:1788361700.182190:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361700.182209:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429837568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.182215:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1788361700.182233:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429837440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361700.182241:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1788361700.182256:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429837440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361700.182272:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429837568:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788361700.182576:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361700.182579:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1788361700.373905:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361700.373913:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d0057c2000 from 123 10000000:01000000:1.0:1788361700.373920:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361700.373972:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.373983:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.373994:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.374019:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429837696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.374084:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.374114:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837696 00000100:00100000:0.0:1788361700.374122:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837696 00000100:00100000:1.0:1788361700.374124:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.374170:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361700.374180:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:6520:x1875230429837696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.374194:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361700.374213:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100031800/0x1b69fa8920fe390f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3908 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.374235:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100031800/0x1b69fa8920fe390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3908 expref: 11 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.374245:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100031800/0x1b69fa8920fe390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3908 expref: 11 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.374317:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100031800, rc 0) 00000100:00100000:0.0:1788361700.374363:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429837696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.374370:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361700.374398:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429837696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.374413:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.374422:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.374461:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429837824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.374483:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.374499:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.374520:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837824 00000100:00100000:0.0:1788361700.374524:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837824 00000100:00100000:0.0:1788361700.374554:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361700.374563:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429837824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361700.374577:0:92297:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361700.374594:0:92297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361700.374598:0:92297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 123 00000100:00100000:0.0:1788361700.374690:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429837824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.374697:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361700.374849:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429837824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361700.374950:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361700.374967:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.374979:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361700.374991:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361700.375004:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 52 10000000:01000000:3.0:1788361700.375007:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361700.375043:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.375052:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.375062:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.375084:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429837952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.375149:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.375194:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429837952 00000100:00100000:0.0:1788361700.375200:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429837952 00000100:00100000:0.0:1788361700.375226:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361700.375233:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429837952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.375242:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361700.375253:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3916 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.375276:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 12 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.375285:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 12 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.375292:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100031600, rc 0) 00000100:00100000:3.0:1788361700.375709:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.375721:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429837952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 486us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.375732:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361700.375735:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429837952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.375760:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.375770:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.375871:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.375918:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.375956:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.376064:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838080 00000100:00100000:0.0:1788361700.376072:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838080 00000100:00100000:0.0:1788361700.376113:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361700.376120:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429838080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.376333:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429838080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.376340:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361700.376460:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.376506:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.376553:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.376580:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.376593:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838208 00000100:00100000:1.0:1788361700.376597:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838208 00000100:00100000:1.0:1788361700.376634:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361700.376640:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429838208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.376721:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429838208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.376728:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361700.376976:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361700.377649:0:92527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788361700.377712:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788361700.377734:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361700.377744:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.377757:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361700.377768:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361700.377772:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 120 10000000:01000000:3.0:1788361700.377775:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361700.377805:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.377813:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.377845:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.377863:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.377917:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.377950:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.377965:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838336 00000100:00100000:3.0:1788361700.377970:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838336 00000100:00100000:3.0:1788361700.378006:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788361700.378015:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429838336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.378036:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361700.378048:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00207ca00/0x1b69fa8920fe392b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3924 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.378067:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00207ca00/0x1b69fa8920fe392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3924 expref: 13 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.378077:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00207ca00/0x1b69fa8920fe392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3924 expref: 13 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.378091:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207ca00, rc 0) 00000100:00100000:3.0:1788361700.378122:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429838336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.378129:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361700.378162:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.378179:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.378189:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.378242:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.378278:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.378302:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.378320:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838464 00000100:00100000:3.0:1788361700.378324:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838464 00000100:00100000:3.0:1788361700.378352:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361700.378358:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d112d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429838464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361700.378372:0:92299:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361700.378389:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361700.378394:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788361700.378397:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788361700.378401:0:92299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788361700.378404:0:92299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:3.0:1788361700.378491:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d112d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429838464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.378498:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361700.378515:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788361700.378616:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361700.378622:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.378631:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361700.378638:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788361700.378640:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788361700.378642:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788361700.378657:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.378677:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.378686:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.378699:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.378723:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.378738:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.378760:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838592 00000100:00100000:3.0:1788361700.378765:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838592 00000100:00100000:3.0:1788361700.378798:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361700.378804:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429838592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.378811:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361700.378819:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3932 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.378859:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 14 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.378940:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 14 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.378948:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207d000, rc 0) 00000100:00100000:3.0:1788361700.378977:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429838592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.378982:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361700.379017:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.379027:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.379034:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.379083:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.379106:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.379174:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.379202:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838720 00000100:00100000:1.0:1788361700.379206:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838720 00000100:00100000:1.0:1788361700.379265:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361700.379272:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429838720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.379395:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429838720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.379402:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361700.379447:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.379491:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.379526:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.379538:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.379547:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838848 00000100:00100000:3.0:1788361700.379550:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838848 00000100:00100000:3.0:1788361700.379571:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361700.379577:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429838848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.380263:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429838848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 684us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.380271:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361700.380280:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361700.381330:0:92528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788361700.381786:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788361700.381810:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788361700.381880:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.381903:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361700.381913:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788361700.381916:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d002df9000 from 1 10000000:01000000:3.0:1788361700.381919:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788361700.381954:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.381962:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.381973:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.382000:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.382050:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.382121:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00429a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.382153:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429838976 00000100:00100000:0.0:1788361700.382160:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429838976 00000100:00100000:0.0:1788361700.382230:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361700.382239:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429838976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.382251:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361700.382263:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100030800/0x1b69fa8920fe3947 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3940 expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382295:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100030800/0x1b69fa8920fe3947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3940 expref: 15 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382305:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100030800/0x1b69fa8920fe3947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3940 expref: 15 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382312:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030800, rc 0) 00000100:00100000:0.0:1788361700.382346:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429838976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.382353:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361700.382429:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429838976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.382441:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382450:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361700.382465:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788361700.382468:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382475:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361700.382481:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361700.382483:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d002df9000 from 7 10000000:01000000:0.0:1788361700.382485:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361700.382497:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382508:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.382516:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361700.382529:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.382554:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.382603:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.382632:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839104 00000100:00100000:3.0:1788361700.382636:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839104 00000100:00100000:3.0:1788361700.382695:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361700.382702:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429839104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.382709:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361700.382717:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00207d400/0x1b69fa8920fe3955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe394e expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.382731:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00207d400/0x1b69fa8920fe3955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe394e expref: 16 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.382740:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00207d400/0x1b69fa8920fe3955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe394e expref: 16 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.382747:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207d400, rc 0) 00000100:00100000:3.0:1788361700.382976:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429839104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.382982:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361700.384548:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.384573:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.384589:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.384674:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.384726:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.384778:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839232 00000100:00100000:3.0:1788361700.384784:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839232 00000100:00100000:3.0:1788361700.384906:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788361700.384915:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429839232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.385052:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.385128:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429839232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.385172:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.385204:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.385247:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.385295:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361700.385330:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.385465:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839360 00000100:00100000:3.0:1788361700.385469:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839360 00000100:00100000:0.0:1788361700.385588:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361700.385596:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429839360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.385680:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429839360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.385687:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361700.385725:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361700.386636:0:92529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788361700.386688:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788361700.386710:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361700.386718:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.386728:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361700.386737:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361700.386740:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 52 10000000:01000000:0.0:1788361700.386749:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361700.386782:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.386791:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.386801:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361700.386819:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.386878:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.387011:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.387050:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839488 00000100:00100000:1.0:1788361700.387055:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839488 00000100:00100000:1.0:1788361700.387085:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361700.387092:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429839488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.387103:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361700.387116:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe395c expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.387137:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 17 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.387148:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 17 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.387156:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785ea00, rc 0) 00000100:00100000:1.0:1788361700.387193:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429839488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.387199:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788361700.387413:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.387427:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.387436:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361700.387483:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.387508:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.387913:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.388285:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839616 00000100:00100000:3.0:1788361700.388291:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839616 00000100:00100000:3.0:1788361700.388390:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788361700.388398:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429839616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.388590:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429839616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.388598:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361700.388739:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.388782:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.388845:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.388867:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102bb4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.389129:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839744 00000100:00100000:3.0:1788361700.389134:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839744 00000100:00100000:3.0:1788361700.389245:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788361700.389254:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429839744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.389334:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429839744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.389342:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361700.389578:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361700.390254:0:92530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788361700.390728:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788361700.390753:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361700.390762:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.390773:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361700.390782:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788361700.390785:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788361700.390795:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788361700.390843:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.390852:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.390862:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.390880:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.390930:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.390959:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d121060300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.391148:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429839872 00000100:00100000:0.0:1788361700.391154:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429839872 00000100:00100000:0.0:1788361700.391185:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361700.391193:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429839872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.391205:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361700.391216:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe396a expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.391236:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 18 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.391246:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 18 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.391254:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030e00, rc 0) 00000100:00100000:0.0:1788361700.391447:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429839872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.391455:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788361700.397880:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429839872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.397919:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.397933:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.398019:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.398080:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.398123:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d121060300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.398194:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840000 00000100:00100000:1.0:1788361700.398201:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840000 00000100:00100000:1.0:1788361700.398246:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361700.398255:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429840000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.398411:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429840000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.398426:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361700.398469:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.398501:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.398539:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.398565:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.398581:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840128 00000100:00100000:1.0:1788361700.398585:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840128 00000100:00100000:1.0:1788361700.398618:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788361700.398625:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429840128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.400787:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429840128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2155us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.400799:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361700.401003:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361700.401701:0:92533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788361700.401754:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788361700.401775:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788361700.401785:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.401801:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361700.401811:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361700.401813:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0021f9800 from 7 10000000:01000000:3.0:1788361700.401816:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361700.401873:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.401882:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.401891:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.401921:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.401960:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.401988:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d121060300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.402092:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840256 00000100:00100000:1.0:1788361700.402098:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840256 00000100:00100000:1.0:1788361700.402142:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361700.402153:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429840256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.402165:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361700.402178:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785fe00/0x1b69fa8920fe397f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3978 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.402201:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785fe00/0x1b69fa8920fe397f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3978 expref: 19 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.402212:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785fe00/0x1b69fa8920fe397f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3978 expref: 19 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.402232:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785fe00, rc 0) 00000100:00100000:1.0:1788361700.402272:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429840256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.402279:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361700.402319:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.402335:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.402344:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.402402:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.402430:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.402448:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.402466:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840384 00000100:00100000:1.0:1788361700.402469:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840384 00000100:00100000:1.0:1788361700.402495:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361700.402502:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429840384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.402605:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429840384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.402614:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361700.402652:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.402683:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.402721:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.402752:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.402766:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840512 00000100:00100000:1.0:1788361700.402770:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840512 00000100:00100000:1.0:1788361700.402793:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788361700.402799:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1376d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429840512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.402915:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1376d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429840512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.402923:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788361700.402944:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361700.405053:0:92534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361700.405230:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361700.405254:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361700.405264:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.405275:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361700.405284:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361700.405286:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 52 10000000:01000000:1.0:1788361700.405289:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361700.405318:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.405326:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.405337:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.405358:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.405412:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.405465:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.405605:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840640 00000100:00100000:0.0:1788361700.405613:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840640 00000100:00100000:0.0:1788361700.405659:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361700.405670:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429840640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.405683:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361700.405696:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3986 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.405727:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 20 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.405738:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 20 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.405746:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030600, rc 0) 00000100:00100000:0.0:1788361700.405791:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429840640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.405797:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361700.406218:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.406237:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.406247:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.406306:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.406336:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.406373:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.406428:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840768 00000100:00100000:3.0:1788361700.406433:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840768 00000100:00100000:3.0:1788361700.406469:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361700.406477:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429840768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.406669:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429840768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.406678:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361700.406731:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.406761:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.406798:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.406813:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.406845:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429840896 00000100:00100000:1.0:1788361700.406849:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429840896 00000100:00100000:1.0:1788361700.406876:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361700.406882:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429840896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.407123:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429840896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.407235:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361700.407277:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429840896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361700.408413:0:92535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788361700.408494:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788361700.408519:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361700.408529:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.408546:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361700.408556:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788361700.408559:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788361700.408561:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361700.408587:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.408595:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.408605:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.408623:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.408666:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.408709:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.408885:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841024 00000100:00100000:0.0:1788361700.408891:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841024 00000100:00100000:0.0:1788361700.408947:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788361700.408956:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429841024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.408967:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361700.408980:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3994 expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.409001:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 21 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.409012:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 21 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.409020:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917e00, rc 0) 00000100:00100000:0.0:1788361700.409066:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429841024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.409074:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361700.409096:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.409115:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.409124:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361700.409171:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.409203:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.409250:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361700.409598:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841152 00000100:00100000:0.0:1788361700.409603:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841152 00000100:00100000:0.0:1788361700.409640:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361700.409648:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429841152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.409779:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429841152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.409786:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788361700.409881:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.409925:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.409963:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.409987:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.410001:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841280 00000100:00100000:1.0:1788361700.410005:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841280 00000100:00100000:1.0:1788361700.410032:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788361700.410041:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429841280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.410946:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429841280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 904us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.410954:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361700.410999:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1076a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361700.412010:0:92538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788361700.412097:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788361700.412122:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788361700.412133:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.412144:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361700.412153:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361700.412155:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d137d28000 from 7 10000000:01000000:3.0:1788361700.412158:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361700.412189:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.412195:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.412202:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.412216:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.412275:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.412312:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.412401:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841408 00000100:00100000:1.0:1788361700.412408:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841408 00000100:00100000:1.0:1788361700.412450:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788361700.412461:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429841408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.412473:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361700.412486:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe39a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe39a2 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.412508:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe39a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe39a2 expref: 22 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.412519:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe39a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe39a2 expref: 22 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.412528:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f200, rc 0) 00000100:00100000:1.0:1788361700.412853:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429841408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 394us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.412862:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361700.412888:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.412917:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.412926:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361700.412989:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361700.413028:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.413175:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.413601:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841536 00000100:00100000:1.0:1788361700.413607:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841536 00000100:00100000:1.0:1788361700.413645:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788361700.413653:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429841536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.413859:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429841536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.413866:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361700.413970:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.414004:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.414044:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.414100:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.414139:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841664 00000100:00100000:1.0:1788361700.414144:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841664 00000100:00100000:1.0:1788361700.414214:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361700.414222:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429841664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361700.414311:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429841664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.414318:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788361700.414384:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361700.415642:0:92539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788361700.415805:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788361700.416048:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361700.416057:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416065:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361700.416072:0:6520:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788361700.416074:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99d1349b4d40 from 1 10000000:01000000:0.0:1788361700.416076:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788361700.416100:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416106:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416113:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361700.416132:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.416172:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.416212:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361700.416215:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841792 00000100:00100000:3.0:1788361700.416220:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841792 00000100:00100000:3.0:1788361700.416262:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361700.416272:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429841792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361700.416283:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361700.416296:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00207c800/0x1b69fa8920fe39b7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe39b0 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.416318:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00207c800/0x1b69fa8920fe39b7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe39b0 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.416329:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00207c800/0x1b69fa8920fe39b7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe39b0 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361700.416338:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00207c800, rc 0) 00000100:00100000:3.0:1788361700.416385:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429841792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.416393:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361700.416448:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.416463:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416472:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361700.416491:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788361700.416495:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416501:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361700.416508:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788361700.416511:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:0.0:1788361700.416513:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788361700.416527:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416534:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.416540:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361700.416563:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.416587:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.416768:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.416855:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429841920 00000100:00100000:1.0:1788361700.416860:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429841920 00000100:00100000:1.0:1788361700.416886:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788361700.416906:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429841920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361700.416915:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361700.416925:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe39be expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.416940:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 24 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.416960:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 24 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361700.416968:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785ec00, rc 0) 00000100:00100000:1.0:1788361700.417000:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429841920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.417006:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361700.417006:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429841920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361700.417016:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.417024:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361700.417069:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429842048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.417092:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.417143:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842048 00000100:00100000:1.0:1788361700.417148:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842048 00000100:00100000:1.0:1788361700.417182:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788361700.417188:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429842048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361700.417234:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361700.417252:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429842048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (159us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361700.417259:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361700.417268:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429842048:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788361700.417418:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361700.417423:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361700.417428:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361700.438005:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361700.568499:0:92574:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788361700.754727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361700.754773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361700.754808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361700.754881:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021952 00000100:00100000:2.0:1788361700.754901:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021952 00000100:00100000:0.0:1788361700.754922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361700.754972:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 907 00000100:00100000:0.0:1788361700.754987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361700.754989:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2410:x1875230407021952:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361700.755023:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021696 00000100:00100000:0.0:1788361700.755028:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021696 00000100:00100000:0.0:1788361700.755061:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:0.0:1788361700.755068:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2408:x1875230407021696:12345-192.168.204.35@tcp:250:kworker.0 00010000:00080000:0.0:1788361700.755101:0:92296:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp t0 exp 0000000000000000 cur 2740 last 0 00000100:00100000:2.0:1788361700.755107:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2410:x1875230407021952:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 120us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361700.755119:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 907 00000020:00000080:0.0:1788361700.755139:0:92296:0:(genops.c:1406:class_connect()) connect: client 3956ab41-635b-456b-967f-6c1073c5d2df, cookie 0x1b69fa8920fe39cc 00000100:00100000:2.0:1788361700.755140:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407021824 00000100:00100000:2.0:1788361700.755146:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407021824 00000100:00100000:2.0:1788361700.755171:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1278 00000100:00100000:2.0:1788361700.755176:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2408:x1875230407021824:12345-192.168.204.35@tcp:38:kworker.0 00010000:00080000:2.0:1788361700.755196:0:80345:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'f1e400d1-472b-42d1-b5e7-e80dc701272a' at ffff99d11e637000, cookie 0x1b69fa8920fe3859 00010000:00080000:2.0:1788361700.755202:0:80345:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp recovering/t0 exp ffff99d11e637000 cur 2740 last 1788361698 00010000:02000400:2.0:1788361700.755210:0:80345:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1788361700.755294:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022080 00000100:00100000:3.0:1788361700.755300:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022080 00000100:00080000:0.0:1788361700.755301:0:92296:0:(import.c:65:import_set_state_nolock()) ffff99d136e1f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361700.755338:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+5:2408:x1875230407021696:12345-192.168.204.35@tcp:250:kworker.0 Request processed in 268us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.755339:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022208 00000100:00100000:0.0:1788361700.755346:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:3.0:1788361700.755352:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022208 00000100:00100000:3.0:1788361700.755393:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1896 00000100:00100000:3.0:1788361700.755402:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407022080:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361700.755440:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407022080:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.755448:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1896 00000100:00100000:3.0:1788361700.755468:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1897 00000100:00100000:3.0:1788361700.755476:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407022208:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361700.755506:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407022208:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.755513:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1897 00000100:00080000:0.0:1788361700.755548:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361700.755553:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361700.755556:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361700.762499:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 0 seconds 00010000:00080000:2.0:1788361700.764608:0:80345:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788361700.764654:0:80345:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788361700.764818:0:80345:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361700.765227:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407021824:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 10045us (10241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361700.765238:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1278 00000100:00100000:0.0:1788361700.769321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361700.769430:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022336 00000100:00100000:3.0:1788361700.769442:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022336 00000100:00100000:3.0:1788361700.769515:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1279 00000100:00100000:3.0:1788361700.769525:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407022336:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788361700.769546:0:66901:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d136ed5500 x1875230407022336/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:6/0 lens 328/0 e 0 to 0 dl 1788361711 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361700.769614:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407022336:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 90us (302us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361700.769620:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1279 00010000:00080000:0.0:1788361700.769656:0:92324:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:0.0:1788361701.043078:0:92626:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788361701.043296:0:92626:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788361701.206099:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:3.0:1788361701.461928:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788361701.475744:0:92676:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788361701.476105:0:92676:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788361701.781923:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 0 seconds 00000100:00100000:0.0:1788361702.088535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361702.088656:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022464 00000100:00100000:2.0:1788361702.088666:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022464 00000100:00100000:2.0:1788361702.088718:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:2.0:1788361702.088727:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+5:70890:x1875230407022464:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361702.088744:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361702.088907:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d117aad800/0x1b69fa8920fe39d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fa4 expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361702.088935:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d117aad800/0x1b69fa8920fe39d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fa4 expref: 6 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361702.088946:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d117aad800/0x1b69fa8920fe39d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fa4 expref: 6 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361702.088956:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad800, rc 0) 00000100:00100000:2.0:1788361702.089043:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407022464:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 316us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361702.089050:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:0.0:1788361702.090889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361702.091212:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022592 00000100:00100000:2.0:1788361702.091220:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022592 00000100:00100000:2.0:1788361702.091433:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:2.0:1788361702.091443:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407022592:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361702.091492:0:92296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788361702.091507:0:92296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361702.091511:0:92296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788361702.091514:0:92296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788361702.091517:0:92296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788361702.091519:0:92296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:2.0:1788361702.092927:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407022592:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 1479us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361702.092938:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:0.0:1788361702.094739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361702.094847:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022720 00000100:00100000:1.0:1788361702.094858:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022720 00000100:00100000:1.0:1788361702.094965:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788361702.094976:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1184b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407022720:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361702.094992:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361702.095010:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fab expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361702.095036:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 7 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361702.095131:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 7 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361702.095141:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e000, rc 0) 00000100:00100000:1.0:1788361702.095186:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1184b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+7:70890:x1875230407022720:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 213us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.095194:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:0.0:1788361702.096104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361702.096180:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022848 00000100:00100000:1.0:1788361702.096184:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022848 00000100:00100000:1.0:1788361702.096249:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:1.0:1788361702.096256:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+7:70890:x1875230407022848:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361702.096362:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407022848:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.096367:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:0.0:1788361702.097523:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361702.097597:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407022976 00000100:00100000:2.0:1788361702.097604:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407022976 00000100:00100000:2.0:1788361702.097641:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:2.0:1788361702.097647:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407022976:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361702.097767:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407022976:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 119us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361702.097775:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:0.0:1788361702.100649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361702.100744:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407023104 00000100:00100000:2.0:1788361702.100753:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407023104 00000100:00100000:2.0:1788361702.101056:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:2.0:1788361702.101069:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407023104:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361702.101086:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361702.101104:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe39e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fb2 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361702.101131:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe39e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb2 expref: 9 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361702.101156:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe39e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb2 expref: 9 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361702.101163:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac600, rc 0) 00000100:00100000:2.0:1788361702.101205:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407023104:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 140us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361702.101211:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788361702.102432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361702.102535:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407023232 00000100:00100000:2.0:1788361702.102541:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407023232 00000100:00100000:2.0:1788361702.102585:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:2.0:1788361702.102593:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407023232:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361702.102760:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407023232:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 167us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361702.102768:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361702.103970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361702.104046:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407023360 00000100:00100000:1.0:1788361702.104054:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407023360 00000100:00100000:1.0:1788361702.104096:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:1.0:1788361702.104106:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407023360:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361702.104226:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407023360:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 121us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.104237:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788361702.107164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361702.107260:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407023488 00000100:00100000:1.0:1788361702.107432:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407023488 00000100:00100000:1.0:1788361702.107490:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:1.0:1788361702.107509:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407023488:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361702.107540:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361702.107566:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fb9 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361702.107597:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 10 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361702.107608:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 10 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361702.107617:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785e400, rc 0) 00000100:00100000:1.0:1788361702.107670:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407023488:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 171us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.107677:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788361702.109264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361702.109335:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407023616 00000100:00100000:2.0:1788361702.109344:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407023616 00000100:00100000:2.0:1788361702.109393:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:2.0:1788361702.109402:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407023616:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361702.110027:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407023616:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 624us (772us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361702.110036:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:1.0:1788361702.229957:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:3.0:1788361702.486030:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361702.806032:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 0 seconds 00000100:00100000:1.0:1788361703.254139:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 0 seconds 00010000:00010000:0.0:1788361703.510165:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361703.766336:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361703.766344:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361703.766348:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788361703.766478:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429842176:0@lo:400:kworker.0 00000100:00100000:0.0:1788361703.766559:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361703.766625:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361703.766635:0:66136:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1788361703.766635:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429842304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361703.766657:0:66136:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:0.0:1788361703.766676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361703.766716:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842304 00000100:00100000:0.0:1788361703.766723:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842304 00000100:00100000:0.0:1788361703.766773:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153 00000100:00100000:0.0:1788361703.766785:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429842304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788361703.766858:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1788361703.766941:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429842304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.766951:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153 00000100:00100000:0.0:1788361703.767053:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429842304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361703.767106:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842176 00000100:00100000:0.0:1788361703.767111:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842176 00000100:00100000:0.0:1788361703.767162:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788361703.767171:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429842176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361703.767211:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429842176:12345-0@lo:400:kworker.0 Request processed in 43us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.767218:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788361703.767250:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429842176:0@lo:400:kworker.0 00000100:00080000:2.0:1788361703.767504:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361703.767529:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd46a00 x1875230429842432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361703.767575:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361703.767579:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361703.767582:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361703.767587:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361703.767603:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d12cd44e00 x1875230429842688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361703.767609:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429842560:0@lo:400:kworker.0 00000100:00080000:2.0:1788361703.767637:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361703.767641:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361703.767643:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361703.767650:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361703.767665:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d137c91c00 x1875230429842944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361703.767678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361703.767712:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361703.767717:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361703.767718:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788361703.767723:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1788361703.767724:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361703.767737:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429842816:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.767743:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d007350e00 x1875230429843328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361703.767778:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788361703.767783:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361703.767784:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d116c06800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361703.767796:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d116c06800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361703.767808:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d007352680 x1875230429843712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361703.767859:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429843584:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.767902:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.767927:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361703.767932:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429843456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.767951:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.767977:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843584 00000100:00100000:2.0:1788361703.767981:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843584 00000100:00100000:2.0:1788361703.768015:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843456 00000100:00100000:2.0:1788361703.768018:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843456 00000100:00100000:2.0:1788361703.768038:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:2.0:1788361703.768044:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429843584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768079:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429843584:12345-0@lo:400:kworker.0 Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.768085:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:2.0:1788361703.768096:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1788361703.768101:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429843456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768124:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429843456:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.768129:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00080000:2.0:1788361703.768145:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361703.768149:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361703.768172:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429843456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768183:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429843584:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768207:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429843200:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768229:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.768248:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361703.768253:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10eaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429843072:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768270:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.768295:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843200 00000100:00100000:2.0:1788361703.768298:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843200 00000100:00100000:2.0:1788361703.768321:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843072 00000100:00100000:2.0:1788361703.768325:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843072 00000100:00100000:2.0:1788361703.768349:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1788361703.768356:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429843200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768402:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429843200:12345-0@lo:400:kworker.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.768407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.768417:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1788361703.768437:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:2.0:1788361703.768446:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429843072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361703.768476:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429842432:0@lo:38:kworker.0 00000100:00100000:2.0:1788361703.768485:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429843072:12345-0@lo:400:kworker.0 Request processed in 39us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.768494:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00080000:2.0:1788361703.768519:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361703.768527:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361703.768531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361703.768568:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429842688:0@lo:38:kworker.0 00000100:00100000:2.0:1788361703.768574:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10eaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429843072:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768597:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429843200:0@lo:400:kworker.0 00000100:00100000:1.0:1788361703.768605:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361703.768633:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429842944:0@lo:38:kworker.0 00000100:00100000:2.0:1788361703.768634:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842560 00000100:00100000:2.0:1788361703.768641:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842560 00000100:00100000:2.0:1788361703.768684:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842816 00000100:00100000:1.0:1788361703.768700:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.768701:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842816 00000100:00100000:2.0:1788361703.768731:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842432 00000100:00100000:1.0:1788361703.768733:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429843328:0@lo:38:kworker.0 00000100:00100000:2.0:1788361703.768736:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842432 00000100:00100000:2.0:1788361703.768756:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842688 00000100:00100000:2.0:1788361703.768761:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842688 00000100:00100000:1.0:1788361703.768775:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.768781:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1788361703.768790:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429842560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768867:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429842560:12345-0@lo:400:kworker.0 Request processed in 78us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.768873:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1788361703.768884:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788361703.768889:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429842816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.768913:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429842816:12345-0@lo:400:kworker.0 Request processed in 25us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.768918:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788361703.768934:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1788361703.768942:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429842432:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788361703.768966:0:80345:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2743 last 0 00000100:00100000:1.0:1788361703.768970:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429843712:0@lo:38:kworker.0 00000020:00000080:2.0:1788361703.769008:0:80345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe39ef 00000100:00100000:1.0:1788361703.769016:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:2.0:1788361703.769027:0:80345:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788361703.769066:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843328 00000100:00100000:1.0:1788361703.769074:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843328 00000100:00100000:1.0:1788361703.769104:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843712 00000100:00100000:1.0:1788361703.769108:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843712 00000100:00100000:1.0:1788361703.769129:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1788361703.769136:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875230429842688:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788361703.769195:0:80345:0:(import.c:65:import_set_state_nolock()) ffff99d141656800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361703.769243:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429842432:12345-0@lo:38:kworker.0 Request processed in 303us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.769250:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1788361703.769266:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1788361703.769271:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429843328:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788361703.769285:0:80345:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2743 last 0 00010000:00080000:1.0:1788361703.769288:0:67579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2743 last 0 00000020:00000080:2.0:1788361703.769347:0:80345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1b69fa8920fe39fd 00000004:00100000:2.0:1788361703.769356:0:80345:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:1.0:1788361703.769357:0:67579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b69fa8920fe39f6 00000004:00100000:1.0:1788361703.769378:0:67579:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361703.769382:0:80345:0:(import.c:65:import_set_state_nolock()) ffff99d141657000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788361703.769418:0:67579:0:(import.c:65:import_set_state_nolock()) ffff99d116c01000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361703.769427:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875230429843328:12345-0@lo:38:kworker.0 Request processed in 150us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.769433:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1788361703.769452:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1788361703.769456:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429843712:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788361703.769473:0:80345:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2743 last 0 00000100:00100000:1.0:1788361703.769487:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875230429842688:12345-0@lo:38:kworker.0 Request processed in 346us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.769498:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000020:00000080:2.0:1788361703.769505:0:80345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b69fa8920fe3a04 00000004:00100000:2.0:1788361703.769516:0:80345:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361703.769543:0:80345:0:(import.c:65:import_set_state_nolock()) ffff99d002ffe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361703.769584:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429843712:12345-0@lo:38:kworker.0 Request processed in 125us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.769590:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00080000:2.0:1788361703.769623:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361703.769666:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429842816:0@lo:400:kworker.0 00000100:00100000:2.0:1788361703.769683:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429842560:0@lo:400:kworker.0 00010000:00080000:2.0:1788361703.769719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d12cd46a00 x1875230429842432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.769732:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:0.0:1788361703.769888:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429842944 00000100:00100000:0.0:1788361703.769911:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429842944 00000100:00100000:0.0:1788361703.769942:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154 00000100:00100000:0.0:1788361703.769948:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429842944:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361703.769973:0:23938:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d11e636800, cookie 0x1b69fa8920fe3852 00010000:00080000:0.0:1788361703.769979:0:23938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d11e636800 cur 2743 last 1788361698 00000004:00100000:0.0:1788361703.769991:0:23938:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361703.770018:0:23938:0:(import.c:65:import_set_state_nolock()) ffff99d136ca5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361703.770077:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429842944:12345-0@lo:38:kworker.0 Request processed in 120us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.770085:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154 00010000:00080000:3.0:1788361703.770111:0:92324:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788361703.770119:0:92324:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 115964116998 00000020:00080000:3.0:1788361703.770124:0:92324:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361703.770128:0:92324:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116998 00000020:00080000:3.0:1788361703.770133:0:92324:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361703.770136:0:92324:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116998 00000001:00100000:3.0:1788361703.770206:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1788361703.770548:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d12cd46a00 x1875230429842432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361728 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.770558:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361703.770561:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361703.770571:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788361703.770576:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429842432:0@lo:38:kworker.0 00010000:00080000:2.0:1788361703.770594:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d12cd44e00 x1875230429842688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.770604:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:2.0:1788361703.771396:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d12cd44e00 x1875230429842688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361728 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.771405:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361703.771408:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361703.771412:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788361703.771416:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429842688:0@lo:38:kworker.0 00000100:00080000:2.0:1788361703.771436:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:2.0:1788361703.771444:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788361703.771448:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788361703.771450:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116997 gen 3 00000100:00080000:2.0:1788361703.771454:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d106904000 from lustre-MDT0000_UUID committed 115964116997 last 0 00000100:00080000:2.0:1788361703.771456:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788361703.771756:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429842944:0@lo:38:kworker.0 00010000:00080000:2.0:1788361703.771775:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d007350e00 x1875230429843328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.771786:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00010000:00080000:0.0:1788361703.772041:0:92690:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788361703.772045:0:92690:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788361703.772051:0:92690:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788361703.772796:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d007350e00 x1875230429843328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361728 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.772805:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788361703.772818:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788361703.772861:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788361703.772867:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000725023f6): req@ffff99d136ef3b80 x1875230429831552/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361703.772884:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429843328:0@lo:38:kworker.0 00000100:00100000:2.0:1788361703.772954:0:66135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.772977:0:66135:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1066a2d80 going to sleep for 11 seconds 00000100:00080000:0.0:1788361703.772980:0:92690:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00010000:00080000:2.0:1788361703.773004:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d007352680 x1875230429843712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361703.773015:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:2.0:1788361703.773020:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788361703.773024:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788361703.773026:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c06800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361703.773030:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429843712:0@lo:38:kworker.0 00000100:00100000:2.0:1788361703.773062:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429843840:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788361703.773087:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.773127:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843840 00000100:00100000:2.0:1788361703.773133:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843840 00000001:00100000:0.0:1788361703.773141:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788361703.773170:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155 00000100:00100000:2.0:1788361703.773178:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429843840:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788361703.773196:0:8449:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d007352680 x1875230429843840/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:9/0 lens 224/0 e 0 to 0 dl 1788361714 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361703.773216:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429843840:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (129us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361703.773222:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155 00000020:00080000:0.0:1788361703.773259:0:92324:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788361703.773264:0:92324:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116998 00010000:00080000:0.0:1788361703.773267:0:92324:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788361703.773269:0:92324:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788361703.773275:0:92324:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788361703.773278:0:92324:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788361703.773286:0:92324:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d136ed5500 x1875230407022336/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:6/0 lens 328/0 e 0 to 0 dl 1788361711 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788361703.773300:0:92324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00100000:3.0:1788361703.773322:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788361703.773325:0:92324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710f7a expref: -99 pid: 92324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.773348:0:92324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 92324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.773375:0:92324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 92324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.773384:0:92324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917200, rc 0) 00000100:00100000:1.0:1788361703.773424:0:66133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429831552 00000100:00100000:1.0:1788361703.773429:0:66133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429831552 00000100:00100000:1.0:1788361703.773460:0:66133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361703.773467:0:66133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66135:x1875230429831552:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:1.0:1788361703.773477:0:66133:0:(ldlm_lib.c:3211:target_queue_recovery_request()) @@@ not queueing req@ffff99d007350000 x1875230429831552/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:9/0 lens 264/0 e 0 to 0 dl 1788361714 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788361703.773502:0:92324:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1788361703.773512:0:92324:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1788361703.775089:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.775169:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407023744 00000100:00100000:3.0:1788361703.775176:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407023744 00000100:00100000:3.0:1788361703.775227:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 910 00000100:00100000:3.0:1788361703.775237:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407023744:12345-192.168.204.35@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788361703.775251:0:67579:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d136b5b100 x1875230407023744/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:9/0 lens 224/0 e 0 to 0 dl 1788361714 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361703.775305:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407023744:12345-192.168.204.35@tcp:400:ptlrpcd_rcv.0 Request processed in 71us (220us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361703.775313:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 910 00010000:00080000:0.0:1788361703.775337:0:92324:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788361703.775424:0:92324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 40000000:02000000:1.0:1788361703.776010:0:66133:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000001:00100000:2.0:1788361703.780467:0:92292:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:2.0:1788361703.780476:0:92292:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788361703.780587:0:92324:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788361703.780626:0:92324:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788361703.780639:0:92324:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d007352680 x1875230429843840/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:9/0 lens 224/0 e 0 to 0 dl 1788361714 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361703.780764:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788361703.780772:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d136b5a680 x1875230429843840/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361719 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361703.780774:0:66135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:66135:1875230429831552:0@lo:700:mdt_seqm_0000.0 40000000:02000000:2.0:1788361703.780790:0:66135:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00080000:0.0:1788361703.780799:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d136b5a680 x1875230429843840/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361719 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361703.780810:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788361703.780855:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788361703.780861:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fabbbc94): req@ffff99d108c6c000 x1875230429828864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361703.780876:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1ed344c): req@ffff99d1170ded80 x1875230429826944/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361702 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361703.780884:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429843840:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788361703.781019:0:66133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66135:x1875230429831552:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 7550us (8062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.781038:0:66133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788361703.781040:0:92324:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.35@tcp: req@ffff99d136b5b100 x1875230407023744/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:9/0 lens 224/0 e 0 to 0 dl 1788361714 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788361703.781105:0:92324:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:0.0:1788361703.781175:0:75544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361703.781200:0:75544:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137f0da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361703.781217:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429828864 00000100:00100000:0.0:1788361703.781222:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429828864 00000100:00100000:0.0:1788361703.781265:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156 00000100:00100000:0.0:1788361703.781272:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75544:x1875230429828864:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:0.0:1788361703.781332:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75544:x1875230429828864:12345-0@lo:1000:dist_txn-1.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.781338:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156 00000100:00100000:0.0:1788361703.781366:0:75544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c6c000 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:75544:1875230429828864:0@lo:1000:dist_txn-1.0 00000004:00080000:0.0:1788361703.781408:0:75544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d0038e93c0 with version 8 00000100:00100000:1.0:1788361703.781417:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:0.0:1788361703.781421:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444089 cancel update log [0x20000cf21:0x1:0x0].1: rc = 0 00000100:00100000:1.0:1788361703.781432:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429843968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361703.781479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788361703.781506:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444089 cancel update log [0x2400088d4:0x1:0x0].1: rc = 0 00000100:00100000:1.0:1788361703.781511:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429843968 00000100:00100000:1.0:1788361703.781517:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429843968 00000020:00080000:0.0:1788361703.781517:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000100:00100000:1.0:1788361703.781552:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4157 00000100:00100000:1.0:1788361703.781561:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429843968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788361703.781585:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1788361703.781629:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875230429843968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.781635:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4157 00000004:00080000:1.0:1788361703.781661:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 8 rpc_version 8 00000020:00100000:1.0:1788361703.781681:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788361703.781681:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429843968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361703.781929:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d1185e9c00 x1875230429844224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361703.781947:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429844224:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788361703.781975:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361703.781992:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788361703.782037:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361703.782281:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429844224 00000100:00100000:1.0:1788361703.782283:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429826944 00000100:00100000:0.0:1788361703.782286:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429844224 00000100:00100000:1.0:1788361703.782289:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429826944 00000100:00100000:0.0:1788361703.782318:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4158 00000100:00100000:1.0:1788361703.782330:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159 00000100:00100000:0.0:1788361703.782330:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75530:x1875230429844224:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788361703.782343:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429826944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788361703.782360:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1788361703.782398:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429826944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.782413:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159 00000100:00100000:1.0:1788361703.782447:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429826944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361703.784633:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75530:x1875230429844224:12345-0@lo:1000:osp_up0-1.0 Request processed in 2302us (2652us total) trans 120259084289 rc 0/0 00000100:00100000:0.0:1788361703.784644:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4158 00000100:00100000:1.0:1788361703.784683:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429844224:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788361703.787090:0:66135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70977:x1875230407018752:12345-192.168.204.35@tcp:700:cp.0 Request processed in 6097869us (6098194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.787103:0:66135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:0.0:1788361703.791530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.791634:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024000 00000100:00100000:2.0:1788361703.791647:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024000 00000100:00100000:2.0:1788361703.791766:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1284 00000100:00100000:2.0:1788361703.791778:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:70977:x1875230407024000:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:2.0:1788361703.791801:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.791854:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aad000/0x1b69fa8920fe3a12 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fc0 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.791959:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.791968:0:66901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.791978:0:66901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361703.792003:0:66901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66901:1875230429844352:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1788361703.792057:0:66901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.792084:0:66901:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.792101:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429844352 00000100:00100000:2.0:1788361703.792119:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429844352 00000100:00100000:2.0:1788361703.792164:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4160 00000100:00100000:2.0:1788361703.792171:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66901:x1875230429844352:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788361703.792185:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.792198:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe3a20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3a19 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792220:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe3a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3a19 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792235:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe3a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3a19 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792243:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:2.0:1788361703.792246:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361703.792250:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aace00, rc 0) 00000100:00100000:2.0:1788361703.792290:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66901:x1875230429844352:12345-0@lo:101:mdt00_003.0 Request processed in 118us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.792297:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4160 00000100:00100000:2.0:1788361703.792339:0:66901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66901:1875230429844352:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788361703.792354:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3a20 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792365:0:66901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3a20 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361703.792385:0:66901:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788361703.792393:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3a20 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792408:0:66901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3a20 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792581:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792591:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792600:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792612:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792620:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.792626:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361703.792757:0:66901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66901:1875230429844480:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788361703.792787:0:66901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.792805:0:66901:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.792819:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429844480 00000100:00100000:2.0:1788361703.792851:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429844480 00000100:00100000:2.0:1788361703.792879:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161 00000100:00100000:2.0:1788361703.792886:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66901:x1875230429844480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788361703.792953:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66901:x1875230429844480:12345-0@lo:1000:mdt00_003.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.792966:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161 00000100:00100000:2.0:1788361703.792998:0:66901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66901:1875230429844480:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1788361703.793865:0:66901:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x89:0x0], count =409 00000004:00080000:2.0:1788361703.793875:0:66901:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x89:0x0]+409 in llog 00000004:00080000:2.0:1788361703.793892:0:66901:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x222:0x0], index 1: 0 00010000:00010000:2.0:1788361703.794045:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac200/0x1b69fa8920fe3a35 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794057:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac200/0x1b69fa8920fe3a35 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794066:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac200/0x1b69fa8920fe3a35 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794101:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794108:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794113:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794119:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794124:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361703.794129:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788361703.794288:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788361703.794326:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794345:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:2.0:1788361703.794348:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361703.794353:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794359:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aacc00/0x1b69fa8920fe3a27 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361703.794373:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004604bb3a reply state 00000000b9f19311 transno 77309411446 ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794385:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794391:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff99d105584b00) 00010000:00010000:2.0:1788361703.794393:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361703.794396:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361703.794499:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aad000/0x1b69fa8920fe3a12 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc0 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794527:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac200/0x1b69fa8920fe3a35 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc0 expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.794535:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361703.794538:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361703.794540:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac200, rc 0) 00000100:00100000:2.0:1788361703.794643:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:70977:x1875230407024000:12345-192.168.204.35@tcp:101:cp.0 Request processed in 2867us (3121us total) trans 77309411446 rc 0/0 00000100:00100000:2.0:1788361703.794651:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1284 00000100:00100000:0.0:1788361703.797581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361703.797653:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024128 00000100:00100000:1.0:1788361703.797662:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024128 00000100:00100000:1.0:1788361703.797719:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4916 00000100:00100000:1.0:1788361703.797726:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407024128:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:1.0:1788361703.797741:0:26168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361703.797758:0:26168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fc7 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361703.797781:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.797805:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.797810:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.797820:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 6 pid: 26168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.797868:0:26168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 6 pid: 26168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.797882:0:26168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d11785f800, rc 0) 00000100:00080000:0.0:1788361703.797882:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361703.797939:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407024128:12345-192.168.204.35@tcp:101:cp.0 Request processed in 212us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.797947:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4916 00000004:00000080:3.0:1788361703.799070:0:92324:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa08886f3e10 00100000:10000000:3.0:1788361703.799080:0:92324:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1788361703.799394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000004:00080000:2.0:1788361703.799905:0:92310:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:2.0:1788361703.799949:0:92310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92310:1875230429844608:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361703.799993:0:92310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.800020:0:92310:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.800040:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024256 00000100:00100000:2.0:1788361703.800045:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024256 00000100:00100000:2.0:1788361703.800082:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429844608 00000100:00100000:2.0:1788361703.800085:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429844608 00000100:00100000:2.0:1788361703.800108:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4917 00000100:00100000:2.0:1788361703.800117:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:70977:x1875230407024256:12345-192.168.204.35@tcp:101:cp.0 00010000:00010000:2.0:1788361703.800131:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.800148:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fce expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.800175:0:8535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 7 pid: 26168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.800185:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.800190:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.800195:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.800220:0:8535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 7 pid: 26168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.800234:0:8535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 7 pid: 26168 timeout: 2843 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361703.800261:0:8535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1875230429844736:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361703.800313:0:8535:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.800329:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:2.0:1788361703.800336:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:92310:x1875230429844608:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788361703.800357:0:26159:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -62 00002000:02000040:2.0:1788361703.800363:0:26159:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1889) 00000004:00080000:3.0:1788361703.800545:0:92312:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:3.0:1788361703.800568:0:92312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92312:1875230429844864:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361703.800600:0:92312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.800628:0:92312:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d134a62540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361703.800666:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429844864 00000100:00100000:3.0:1788361703.800670:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429844864 00000100:00100000:3.0:1788361703.800694:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:3.0:1788361703.800700:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:92312:x1875230429844864:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361703.800714:0:26171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -63 00002000:02000040:3.0:1788361703.800717:0:26171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1889) 00002000:00010000:2.0:1788361703.807071:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.807088:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807110:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.807116:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.807123:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807138:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807146:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807151:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807200:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.807248:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.807257:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807282:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aadc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.807288:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807297:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807317:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.807319:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.807329:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807332:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2228bdf/0x1b69fa8920fe3a51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807349:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.807354:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.807358:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807367:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807376:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807376:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.807381:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.807384:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.807387:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807410:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.807433:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.807439:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807447:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aada00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361703.807448:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.807452:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807455:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807469:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807471:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.807485:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.807493:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807497:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807507:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807509:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe3a58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807527:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807536:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807538:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.807542:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.807546:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.807556:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361703.807567:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361703.807572:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807579:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361703.807583:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807590:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807601:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807620:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe3a5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361703.807624:0:8535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1875230429844736:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361703.807644:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.807648:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.807651:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361703.807664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:0.0:1788361703.807664:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807683:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aade00, rc 0) 00002000:00010000:2.0:1788361703.807699:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.807705:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361703.807708:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024384 00010000:00010000:2.0:1788361703.807716:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=2743s v=(0 0) 00000100:00100000:1.0:1788361703.807717:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024384 00010000:00010000:2.0:1788361703.807723:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.807727:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807737:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361703.807740:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:70977:x1875230407024256:12345-192.168.204.35@tcp:101:cp.0 Request processed in 7621us (8345us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361703.807752:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361703.807758:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4917 00010000:00010000:1.0:1788361703.807766:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 8 pid: 26168 timeout: 2843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.807767:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361703.807813:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2592 00000100:00100000:1.0:1788361703.807861:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2409:x1875230407024384:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361703.807876:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361703.807891:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 7 pid: 26168 timeout: 2843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.807902:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 7 pid: 26168 timeout: 2843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.807919:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d5de0b/0x1b69fa8920fe3a43 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc7 expref: 7 pid: 26168 timeout: 2843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.807931:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.807934:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.807942:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.807952:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807956:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361703.807963:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361703.807963:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.807985:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.807989:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808010:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.808015:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808017:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.808027:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361703.808037:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875230429844992:192.168.204.35@tcp:105: 00010000:00010000:2.0:1788361703.808042:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.808048:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.808053:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808055:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808073:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808074:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d177652/0x1b69fa8920fe3a66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361703.808087:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0180 going to sleep for 11 seconds 00010000:00010000:2.0:1788361703.808096:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808101:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.808103:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.808106:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808107:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808124:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.808131:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.808137:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808145:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.808149:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808157:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808164:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.808172:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808183:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.808185:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808187:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.808197:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808216:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047bdf8b2/0x1b69fa8920fe3a6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808233:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808241:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.808245:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808246:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808247:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808257:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808271:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.808280:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.808286:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808294:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aaca00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.808297:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808306:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808310:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.808319:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808322:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808335:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.808338:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000597d9c47/0x1b69fa8920fe3a74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808340:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.808348:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808358:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808360:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808361:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808369:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808371:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808391:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808410:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.808431:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.808438:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808446:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.808446:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.808451:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808455:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808461:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808470:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.808478:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.808483:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808484:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808507:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe3a7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808508:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808529:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808534:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.808537:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808539:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808540:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808556:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.808563:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.808568:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808576:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.808580:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808590:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.808600:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808605:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808627:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.808631:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.808631:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808640:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808646:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe3a82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808655:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808662:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.808664:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808666:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808666:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808677:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808691:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.808697:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.808700:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808706:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.808709:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808714:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808722:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808727:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.808738:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808740:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe3a89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808760:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.808762:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808764:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.808764:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.808766:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808772:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808781:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808800:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808813:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808853:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.808863:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.808868:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808875:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.808879:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808887:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.808893:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.808899:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808900:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808920:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe3a90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808921:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.808928:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.808937:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808947:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808948:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808956:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.808958:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.808966:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.808990:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.809000:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.809006:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809015:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.809018:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809026:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809037:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809043:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe3a97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809056:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.809058:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.809060:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361703.809176:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.809183:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809190:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.809193:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.809196:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809206:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809214:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809221:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809237:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.809262:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.809268:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809275:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5600 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361703.809278:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.809279:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809289:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809310:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.809313:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809325:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.809330:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809332:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809353:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809360:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe3a9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809364:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809385:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809390:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.809394:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.809408:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.809414:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.809419:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809427:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.809430:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809438:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.809444:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361703.809449:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.809449:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809460:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809473:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.809480:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.809482:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe3aa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809484:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809504:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809511:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809511:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.809514:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.809517:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.809525:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809535:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.809544:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.809550:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809558:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361703.809563:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.809563:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809570:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809581:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.809581:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809585:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.809590:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809601:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809603:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809608:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809622:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe3aac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809623:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809648:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.809652:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.809657:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.809670:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.809671:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361703.809673:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.809678:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809679:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809697:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.809697:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809702:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.809709:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809720:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809720:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809729:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809741:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809746:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe3ab3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809754:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.809761:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.809765:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809773:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.809778:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.809779:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361703.809782:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.809791:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809794:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809797:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.809802:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.809809:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809816:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809817:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.809864:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001571f58d/0x1b69fa8920fe3aba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809875:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809885:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809898:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.809909:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.809916:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.809925:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361703.809927:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.809929:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809932:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809950:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.809950:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809955:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.809964:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.809971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809976:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.809983:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe3ac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.809990:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810000:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810019:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.810023:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.810026:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810033:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.810037:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810044:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810055:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810063:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.810065:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810074:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361703.810083:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe3ac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810132:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.810142:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810149:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.810153:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.810157:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810169:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810175:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810175:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810177:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810186:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810186:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810201:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.810210:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.810216:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810223:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.810227:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810237:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.810246:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810252:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810272:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.810277:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.810277:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810283:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810290:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe3acf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810299:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810308:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810309:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810312:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.810315:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810321:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810334:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.810343:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.810348:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810355:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.810358:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810366:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.810371:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810372:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810379:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.810382:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.810384:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810385:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810392:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037598e69/0x1b69fa8920fe3ad6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810394:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810405:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810408:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810412:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810419:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810432:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.810453:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.810459:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810466:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.810470:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361703.810473:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810475:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810490:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.810494:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810495:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.810502:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810514:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810515:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810535:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810551:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810555:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe3add lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810577:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.810585:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.810594:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810601:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.810604:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810610:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.810612:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810615:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810622:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.810622:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810625:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.810629:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810630:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067984d29/0x1b69fa8920fe3ae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810638:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810643:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810645:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810647:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810658:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810667:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.810669:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.810673:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.810676:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810684:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.810692:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.810696:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810702:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.810706:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810716:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.810719:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810727:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.810729:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810733:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.810737:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810740:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810746:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810747:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000507419c5/0x1b69fa8920fe3aeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810755:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810761:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810762:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810762:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810764:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810774:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.810779:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.810782:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810789:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eae00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.810792:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810799:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810804:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.810809:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810809:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810817:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.810819:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.810852:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810858:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9a2c23/0x1b69fa8920fe3af2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810861:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810869:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810871:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810873:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810875:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810881:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810893:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.810899:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.810903:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810909:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.810913:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810920:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810930:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.810935:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.810938:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a839d551/0x1b69fa8920fe3af9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810940:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810947:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.810950:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.810954:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810962:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.810962:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810963:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.810969:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.810970:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810977:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.810990:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.811000:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.811008:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811018:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eba00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.811023:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.811026:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.811037:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811039:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811062:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.811064:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811066:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.811070:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811088:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fec79f8b/0x1b69fa8920fe3b00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811093:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811105:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811106:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.811109:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.811115:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811119:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.811143:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361703.811182:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.811188:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811195:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.811198:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.811202:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811211:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811231:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811237:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811253:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361703.811263:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.811263:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361703.811272:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811273:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.811290:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.811296:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.811299:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361703.811300:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811302:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811305:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811325:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.811330:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811331:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.811332:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811342:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811356:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811358:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811370:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012fefa7d/0x1b69fa8920fe3b0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811385:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811400:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef909702/0x1b69fa8920fe3b07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811411:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.811415:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.811418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.811424:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.811442:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.811444:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.811447:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.811455:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.811460:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811469:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.811473:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.811484:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.811493:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811500:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811506:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.811513:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.811517:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811519:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811538:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf0c7a42/0x1b69fa8920fe3b15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811542:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811556:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811559:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.811563:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.811566:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.811567:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.811586:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361703.811618:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.811623:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811630:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.811638:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.811642:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811649:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811657:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811664:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811680:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361703.811695:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361703.811701:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811709:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.811713:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.811714:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.811720:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811738:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.811738:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811745:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.811753:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811760:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811764:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811775:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3b1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811779:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811791:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361703.811794:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811796:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811815:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.811819:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.811849:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.811861:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811872:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811880:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3f4dd2/0x1b69fa8920fe3b23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811907:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.811911:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811918:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eac00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.811922:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811930:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811943:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811951:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064dee490/0x1b69fa8920fe3b2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.811964:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.811967:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.811969:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.811976:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788361703.812122:0:26159:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00000100:00100000:2.0:1788361703.812206:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:92310:x1875230429844608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11867us (12208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.812216:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00000100:00100000:1.0:1788361703.812247:0:92310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92310:1875230429844608:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788361703.812263:0:92310:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x723:0x0] 00010000:00010000:0.0:1788361703.812329:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361703.812342:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429845120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361703.812343:0:92310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d108c7e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92310:1875230429845248:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361703.812393:0:92310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.812408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361703.812424:0:92310:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.812447:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429845120 00000100:00100000:2.0:1788361703.812453:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429845120 00000100:00100000:0.0:1788361703.812477:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429845248 00000100:00100000:0.0:1788361703.812483:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429845248 00000100:00100000:2.0:1788361703.812495:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:2.0:1788361703.812507:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429845120:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361703.812525:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00002000:00000024:2.0:1788361703.812532:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361703.812537:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:92310:x1875230429845248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788361703.812564:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00000100:00100000:2.0:1788361703.812588:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429845120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.812594:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:1.0:1788361703.812725:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429845120:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1788361703.813016:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.813025:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813037:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.813041:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.813046:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813058:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813080:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813087:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813105:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361703.813116:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361703.813121:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813128:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207da00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361703.813132:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813140:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813154:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813163:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fce2493/0x1b69fa8920fe3b31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813182:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361703.813184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:3.0:1788361703.813191:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.813195:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361703.813206:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875230429844992:192.168.204.35@tcp:105: 00010000:00010000:2.0:1788361703.813223:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361703.813266:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2409:x1875230407024384:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 5444us (5606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.813276:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2592 00002000:00010000:3.0:1788361703.813320:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.813327:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813336:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.813340:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788361703.813344:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024640 00010000:00010000:3.0:1788361703.813345:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361703.813355:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024640 00000100:00100000:2.0:1788361703.813391:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 232 00010000:00010000:3.0:1788361703.813395:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361703.813403:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:70977:x1875230407024640:12345-192.168.204.35@tcp:35:cp.0 00010000:00010000:3.0:1788361703.813407:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813416:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813432:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.813441:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.813448:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813458:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207cc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.813463:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813484:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.813486:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.813498:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813504:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813507:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.813516:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.813519:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4d459bc/0x1b69fa8920fe3b38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813522:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813537:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.813540:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813540:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.813541:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.813551:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813559:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813577:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.813586:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.813591:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361703.813597:0:66130:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411447 00010000:00010000:0.0:1788361703.813599:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.813604:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813614:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813626:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.813633:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.813644:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813646:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8ca6f1f/0x1b69fa8920fe3b3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813666:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.813671:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.813673:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361703.813676:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:70977:x1875230407024640:12345-192.168.204.35@tcp:35:cp.0 Request processed in 274us (492us total) trans 77309411448 rc 0/0 00010000:00010000:0.0:1788361703.813676:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.813680:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813680:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361703.813690:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 232 00000020:00080000:2.0:1788361703.813696:0:66130:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361703.813697:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813708:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813727:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813744:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.813753:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.813758:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813765:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.813769:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813777:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813787:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.813789:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.813802:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813802:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064d9f216/0x1b69fa8920fe3b46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813866:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.813868:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.813877:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.813880:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.813885:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.813889:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813900:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813908:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813916:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813931:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.813942:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.813948:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813957:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.813961:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813969:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.813979:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.813981:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.813990:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e60204c/0x1b69fa8920fe3b4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.813992:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814006:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.814007:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814010:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814012:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.814014:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814018:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814029:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814037:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814044:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814062:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814088:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.814094:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814102:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.814106:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.814115:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.814126:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814133:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814138:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.814146:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.814152:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814154:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814170:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae51b10/0x1b69fa8920fe3b54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814171:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814201:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814204:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814206:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814210:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814216:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814231:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814241:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.814247:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814256:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.814260:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814267:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814276:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.814283:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.814290:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814309:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040da87fc/0x1b69fa8920fe3b5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814310:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.814317:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.814326:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814338:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814338:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814343:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814347:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814350:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814358:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814384:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814392:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.814396:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814401:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.814404:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814411:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814421:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814426:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000480f934f/0x1b69fa8920fe3b62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.814434:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.814438:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814441:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814442:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814450:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814454:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.814459:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.814463:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814472:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814481:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814488:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814502:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814512:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.814518:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814524:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.814526:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814532:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814540:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.814544:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.814546:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf413d8/0x1b69fa8920fe3b69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814553:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814563:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.814564:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814568:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814571:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814574:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.814579:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814589:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814597:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814605:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814618:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814625:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.814630:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814636:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.814638:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814652:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.814656:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.814661:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814663:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361703.814669:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:92310:x1875230429845248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2132us (2271us total) trans 4294968751 rc 0/0 00010000:00010000:0.0:1788361703.814681:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd478e66/0x1b69fa8920fe3b70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361703.814687:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00010000:00010000:3.0:1788361703.814690:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.814698:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.814702:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814705:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814708:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814710:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.814717:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814726:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814740:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814755:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814761:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.814765:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814771:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.814773:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814779:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814788:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.814800:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a8332f/0x1b69fa8920fe3b77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.814801:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.814816:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814817:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.814818:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361703.814896:0:92310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d108c7e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92310:1875230429845248:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361703.814910:0:92310:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00010000:00010000:3.0:1788361703.814928:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814939:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.814942:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.814946:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814956:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814964:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814971:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.814984:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.814996:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.815002:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815011:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.815014:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.815020:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.815023:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815026:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815036:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815039:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.815046:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.815057:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815057:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073070777/0x1b69fa8920fe3b7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815080:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815084:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.815087:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815090:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815096:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815102:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815115:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.815124:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.815130:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815138:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.815142:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.815149:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.815151:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815156:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815168:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.815170:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815171:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.815178:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815188:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d83b3c0/0x1b69fa8920fe3b85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815192:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815209:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.815211:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.815213:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815291:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815297:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815308:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.815315:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.815319:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815325:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.815327:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.815341:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.815342:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815348:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815360:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.815361:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815362:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.815369:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815378:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e01b28/0x1b69fa8920fe3b8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815383:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815394:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815396:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.815399:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815402:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815403:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815425:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.815432:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.815436:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815442:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.815444:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815451:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.815458:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.815463:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815464:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815482:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.815485:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.815493:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815502:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f598cb/0x1b69fa8920fe3b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815505:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815520:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815525:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815527:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815529:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.815533:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815546:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.815569:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788361703.815575:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.815576:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815583:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815594:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.815597:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.815603:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815605:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361703.815615:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.815619:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815634:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.815640:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815644:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.815656:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3ac30d1/0x1b69fa8920fe3b9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815660:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.815681:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361703.815682:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361703.815686:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815691:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.815709:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.815713:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361703.815722:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.815723:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815733:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.815740:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815742:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.815750:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.815760:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f31ae320/0x1b69fa8920fe3ba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815761:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815785:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.815789:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.815792:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.815796:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.815797:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815812:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.815857:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.815864:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.815871:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815880:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.815885:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815891:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815902:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.815917:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000212ea75f/0x1b69fa8920fe3ba8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.815937:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.815945:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.815970:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.815974:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.815978:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.815989:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.815997:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816004:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816022:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816024:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816026:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816039:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.816049:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.816063:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816072:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.816076:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816084:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.816095:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.816096:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816106:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816109:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ddfa47/0x1b69fa8920fe3baf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816127:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.816132:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.816137:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816138:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816142:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816144:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816153:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816162:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816169:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816183:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.816193:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.816198:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816206:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.816210:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.816224:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.816235:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816237:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816257:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.816258:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816263:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.816271:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816273:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6ce2e3/0x1b69fa8920fe3bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816297:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816299:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816302:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816304:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816312:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816320:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816338:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.816360:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.816365:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816375:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.816379:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.816384:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.816390:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816392:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816407:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.816412:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.816416:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816417:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816432:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335cd30c/0x1b69fa8920fe3bbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816444:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.816447:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816449:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816450:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816473:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816480:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816494:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.816504:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.816510:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816523:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.816528:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.816537:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.816537:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816548:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816556:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816558:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.816567:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.816574:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e050963a/0x1b69fa8920fe3bc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816576:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816612:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816622:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816630:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816634:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.816646:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.816649:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816666:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361703.816689:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.816696:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816704:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:2.0:1788361703.816706:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.816708:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816713:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816722:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816725:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.816732:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.816741:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816748:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816754:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816766:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816773:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038bb8eb1/0x1b69fa8920fe3bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816780:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816792:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816796:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361703.816800:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816801:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361703.816810:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361703.816814:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.816857:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.816865:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816871:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.816876:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361703.816882:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1e14928/0x1b69fa8920fe3bd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816884:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816904:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:0.0:1788361703.816908:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.816912:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816916:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361703.816916:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.816923:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816932:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816939:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816946:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.816958:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.816969:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.816976:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.816986:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.816990:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.816996:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361703.817000:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817001:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817020:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.817023:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.817026:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817028:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817036:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817041:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051555a7c/0x1b69fa8920fe3bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817046:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817056:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817059:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817063:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.817067:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817073:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361703.817077:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361703.817084:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817095:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817107:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817113:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca2a5c88/0x1b69fa8920fe3be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.817117:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.817124:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817132:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.817135:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.817139:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817148:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817155:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817160:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817177:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.817189:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817194:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.817198:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817205:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.817210:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817212:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817219:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.817221:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.817232:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817237:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817258:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.817262:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.817270:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817277:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2f353b/0x1b69fa8920fe3be7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817284:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817294:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817295:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817299:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817302:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817307:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817323:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.817332:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.817344:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817355:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.817359:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.817360:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.817370:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817373:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817387:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.817392:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361703.817394:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817396:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817413:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e7a082/0x1b69fa8920fe3bee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.817415:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817418:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817431:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817435:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817446:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817446:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817456:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817480:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361703.817516:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361703.817522:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817529:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:2.0:1788361703.817532:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.817536:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817545:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817553:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817561:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817592:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361703.817618:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361703.817626:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.817632:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.817639:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361703.817642:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817645:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817652:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361703.817658:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:1.0:1788361703.817660:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817664:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817666:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.817676:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817682:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.817690:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817696:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817697:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817699:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817726:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2667368/0x1b69fa8920fe3bf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817726:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817730:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817749:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a87f48f/0x1b69fa8920fe3bfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817766:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.817770:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.817777:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817778:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361703.817780:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817781:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.817785:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361703.817803:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.817805:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361703.817811:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817820:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361703.817876:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361703.817878:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817886:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817889:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7909a73/0x1b69fa8920fe3c03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817900:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=2743s v=(0 0) 00010000:00010000:3.0:1788361703.817910:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817910:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361703.817913:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.817914:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361703.817918:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361703.817925:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817932:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817937:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.817949:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361703.817985:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.817991:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.817999:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.818002:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.818021:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.818034:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.818043:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd90922/0x1b69fa8920fe3c0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.818057:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.818059:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.818061:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788361703.818174:0:26171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:2.0:1788361703.818255:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:92312:x1875230429844864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17552us (17652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.818265:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00100000:3.0:1788361703.818287:0:92312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92312:1875230429844864:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361703.818304:0:92312:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:3.0:1788361703.818381:0:92312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92312:1875230429845504:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361703.818414:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429845376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361703.818423:0:92312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.818448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.818457:0:92312:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d119c5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.818493:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429845376 00000100:00100000:2.0:1788361703.818500:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429845376 00000100:00100000:1.0:1788361703.818516:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429845504 00000100:00100000:1.0:1788361703.818521:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429845504 00000100:00100000:2.0:1788361703.818545:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1788361703.818555:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429845376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361703.818578:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361703.818602:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:1.0:1788361703.818612:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:92312:x1875230429845504:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361703.818621:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429845376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (172us total) trans 0 rc 0/0 00002000:00080000:1.0:1788361703.818636:0:26166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00000100:00100000:2.0:1788361703.818640:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1788361703.818645:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429845376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361703.820160:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:92312:x1875230429845504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1547us (1733us total) trans 4294968753 rc 0/0 00000100:00100000:1.0:1788361703.820169:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00000100:00100000:3.0:1788361703.820267:0:92312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92312:1875230429845504:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361703.820285:0:92312:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00000100:00100000:0.0:1788361703.821767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.821862:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024768 00000100:00100000:3.0:1788361703.821871:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024768 00000100:00100000:3.0:1788361703.821916:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1285 00000100:00100000:3.0:1788361703.821923:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71243:x1875230407024768:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788361703.821939:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361703.821957:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3c11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fd5 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361703.822931:0:66126:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 927us 00010000:00010000:0.0:1788361703.830341:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.830361:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.830372:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.830390:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.830398:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.830405:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361703.830533:0:66126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66126:1875230429845632:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788361703.830591:0:66126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361703.830781:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429845632 00000100:00100000:1.0:1788361703.830789:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429845632 00000100:00100000:0.0:1788361703.830794:0:66126:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0049059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361703.830871:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162 00000100:00100000:1.0:1788361703.830883:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66126:x1875230429845632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788361703.830980:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66126:x1875230429845632:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.830998:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162 00000100:00100000:0.0:1788361703.831518:0:66126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66126:1875230429845632:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788361703.831563:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3c26 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831574:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3c26 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831592:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3c26 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361703.831630:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3c26 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831645:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831651:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831658:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831665:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831671:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361703.831681:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831689:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831700:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:0.0:1788361703.831703:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361703.831707:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831713:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831730:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831736:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831742:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831746:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361703.831749:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831755:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831762:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d0010ec700) 00010000:00010000:0.0:1788361703.831765:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361703.831767:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831778:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe3c1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831813:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fd5 expref: 9 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831870:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3c26 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fd5 expref: 8 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.831888:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d0010ec900) 00010000:00010000:0.0:1788361703.831891:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361703.831899:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916e00, rc 0) 00000100:00100000:0.0:1788361703.831947:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71243:x1875230407024768:12345-192.168.204.35@tcp:101:rm.0 Request processed in 10024us (10183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.831954:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1285 00000100:00100000:1.0:1788361703.834344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.834460:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407024896 00000100:00100000:2.0:1788361703.834470:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407024896 00000100:00100000:2.0:1788361703.834522:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1286 00000100:00100000:2.0:1788361703.834535:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71243:x1875230407024896:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788361703.834558:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.834576:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c2d lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fdc expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.834621:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20000/0x1b69fa8920fe3c34 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.834630:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20000/0x1b69fa8920fe3c34 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.834638:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20000/0x1b69fa8920fe3c34 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361703.834683:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788361703.834687:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788361703.834720:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c2d lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fdc expref: 14 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.834736:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20000/0x1b69fa8920fe3c34 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fdc expref: 13 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.834744:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:2.0:1788361703.834746:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361703.834760:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20000, rc 0) 00000100:00100000:2.0:1788361703.834809:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71243:x1875230407024896:12345-192.168.204.35@tcp:101:rm.0 Request processed in 278us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.834816:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1286 00000100:00100000:1.0:1788361703.837027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.837077:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407025152 00000100:00100000:2.0:1788361703.837096:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407025152 00000100:00100000:2.0:1788361703.837156:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1287 00000100:00100000:2.0:1788361703.837176:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71243:x1875230407025152:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788361703.837197:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.837221:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fe3 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361703.837318:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788361703.837424:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fe3 expref: 15 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.837440:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d112e94d00) 00010000:00010000:2.0:1788361703.837443:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361703.837448:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fe3 expref: 15 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.837466:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21800, rc 0) 00000100:00100000:2.0:1788361703.837517:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71243:x1875230407025152:12345-192.168.204.35@tcp:101:rm.0 Request processed in 352us (498us total) trans 77309411449 rc 301/301 00000100:00100000:2.0:1788361703.837524:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1287 00000100:00100000:0.0:1788361703.840288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361703.840385:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407025280 00000100:00100000:1.0:1788361703.840401:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407025280 00000100:00100000:1.0:1788361703.840493:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 233 00000100:00100000:1.0:1788361703.840503:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71243:x1875230407025280:12345-192.168.204.35@tcp:37:rm.0 00000100:00100000:3.0:1788361703.843315:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71243:x1875230407025280:12345-192.168.204.35@tcp:37:rm.0 Request processed in 2802us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361703.843329:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 233 00000100:00100000:0.0:1788361703.845499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.845573:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407025536 00000100:00100000:2.0:1788361703.845583:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407025536 00000100:00100000:2.0:1788361703.845640:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 234 00000100:00100000:2.0:1788361703.845666:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71243:x1875230407025536:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:2.0:1788361703.845909:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:71243:x1875230407025536:12345-192.168.204.35@tcp:35:rm.0 Request processed in 245us (413us total) trans 77309411450 rc 0/0 00000100:00100000:2.0:1788361703.845918:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 234 00000100:00100000:0.0:1788361703.847462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.847514:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407025792 00000100:00100000:2.0:1788361703.847520:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407025792 00000100:00100000:2.0:1788361703.847573:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1288 00000100:00100000:2.0:1788361703.847579:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:71243:x1875230407025792:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788361703.847593:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.847610:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fea expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.847684:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3c50 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.847698:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3c50 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.847709:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3c50 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361703.847721:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788361703.847790:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fea expref: 18 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.847817:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3c50 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fea expref: 17 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.847893:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:2.0:1788361703.847896:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361703.847900:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20e00, rc 0) 00000100:00100000:2.0:1788361703.847959:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:71243:x1875230407025792:12345-192.168.204.35@tcp:101:rm.0 Request processed in 379us (500us total) trans 77309411451 rc 0/0 00000100:00100000:2.0:1788361703.847966:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1288 00000100:00100000:1.0:1788361703.852728:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.852781:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407025920 00000100:00100000:3.0:1788361703.852793:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407025920 00000100:00100000:3.0:1788361703.852881:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1289 00000100:00100000:3.0:1788361703.852891:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:71243:x1875230407025920:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788361703.852916:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361703.852938:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308600/0x1b69fa8920fe3c5e lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ff1 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.853016:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe3c65 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.853030:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe3c65 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.853043:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe3c65 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361703.853120:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1788361703.853124:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361703.853148:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe3c65 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.853177:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308600/0x1b69fa8920fe3c5e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ff1 expref: 19 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.853196:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe3c65 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ff1 expref: 18 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.853205:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:3.0:1788361703.853209:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361703.853212:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309e00, rc 0) 00000100:00100000:3.0:1788361703.853343:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:71243:x1875230407025920:12345-192.168.204.35@tcp:101:rm.0 Request processed in 452us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361703.853355:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1289 00000100:00100000:1.0:1788361703.855509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361703.855572:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407026176 00000100:00100000:0.0:1788361703.855580:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407026176 00000100:00100000:0.0:1788361703.855636:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1290 00000100:00100000:0.0:1788361703.855646:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:71243:x1875230407026176:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:0.0:1788361703.855673:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361703.855694:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c6c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710ff8 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361703.855782:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1788361703.855909:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c6c lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ff8 expref: 20 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.855919:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:0.0:1788361703.855921:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361703.855924:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d139916a00/0x1b69fa8920fe3c6c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ff8 expref: 20 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.855947:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916a00, rc 0) 00000100:00100000:0.0:1788361703.855994:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:71243:x1875230407026176:12345-192.168.204.35@tcp:101:rm.0 Request processed in 349us (491us total) trans 77309411452 rc 301/301 00000100:00100000:0.0:1788361703.856001:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1290 00000100:00100000:0.0:1788361703.858294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.858344:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407026304 00000100:00100000:3.0:1788361703.858354:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407026304 00000100:00100000:3.0:1788361703.858402:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:3.0:1788361703.858413:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:71243:x1875230407026304:12345-192.168.204.35@tcp:37:rm.0 00000100:00100000:3.0:1788361703.862048:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:71243:x1875230407026304:12345-192.168.204.35@tcp:37:rm.0 Request processed in 3625us (3749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361703.862065:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:1.0:1788361703.863988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361703.864162:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407026560 00000100:00100000:0.0:1788361703.864172:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407026560 00000100:00100000:0.0:1788361703.864274:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:0.0:1788361703.864286:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:71243:x1875230407026560:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:0.0:1788361703.864475:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:71243:x1875230407026560:12345-192.168.204.35@tcp:35:rm.0 Request processed in 192us (495us total) trans 77309411453 rc 0/0 00000100:00100000:0.0:1788361703.864482:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:0.0:1788361703.865743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.865936:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407026816 00000100:00100000:3.0:1788361703.865945:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407026816 00000100:00100000:3.0:1788361703.866004:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1291 00000100:00100000:3.0:1788361703.866015:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:71243:x1875230407026816:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788361703.866041:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361703.866064:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308600/0x1b69fa8920fe3c7a lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae710fff expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.866171:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3c81 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.866186:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3c81 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.866198:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3c81 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361703.866208:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1788361703.866320:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308600/0x1b69fa8920fe3c7a lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fff expref: 23 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.866335:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3c81 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fff expref: 22 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.866345:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:3.0:1788361703.866348:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361703.866352:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:3.0:1788361703.866403:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407026816:12345-192.168.204.35@tcp:101:rm.0 Request processed in 391us (664us total) trans 77309411454 rc 0/0 00000100:00100000:3.0:1788361703.866410:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1291 00000100:00100000:1.0:1788361703.868372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.868486:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407026944 00000100:00100000:2.0:1788361703.868496:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407026944 00000100:00100000:2.0:1788361703.868549:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1292 00000100:00100000:2.0:1788361703.868560:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71243:x1875230407026944:12345-192.168.204.35@tcp:41:rm.0 00000004:00000024:2.0:1788361703.868618:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382966272 00000100:00100000:2.0:1788361703.868702:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71243:x1875230407026944:12345-192.168.204.35@tcp:41:rm.0 Request processed in 144us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.868710:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1292 00000100:00100000:1.0:1788361703.871059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.871122:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407027200 00000100:00100000:2.0:1788361703.871132:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407027200 00000100:00100000:2.0:1788361703.871184:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1293 00000100:00100000:2.0:1788361703.871195:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407027200:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:2.0:1788361703.871251:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788361703.871279:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac200/0x1b69fa8920fe3a35 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fc0 expref: 22 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871365:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361703.871385:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe3c65 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710ff1 expref: 21 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871411:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:2.0:1788361703.871414:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361703.871447:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871471:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871489:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871500:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871508:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871515:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871605:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871614:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.871621:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361703.872090:0:66128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4a:0x0].2, 64 off8320 00000004:00080000:2.0:1788361703.872106:0:66128:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 2743881282736ns, next at 2744881274621ns, rc = 0 00010000:00010000:2.0:1788361703.872167:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872177:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872184:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872193:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872200:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872207:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872284:0:66128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361703.872307:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872313:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872320:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872327:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361703.872331:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872339:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872353:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99d112e94e00) 00010000:00010000:2.0:1788361703.872357:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361703.872361:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872368:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20400/0x1b69fa8920fe3c9d lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872385:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872392:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872398:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872403:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872409:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361703.872412:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872422:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872430:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:2.0:1788361703.872432:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361703.872436:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872454:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21400/0x1b69fa8920fe3c8f lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361703.872466:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db5210c6 reply state 00000000d48aa120 transno 77309411455 ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872479:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.872486:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff99d105584b00) 00010000:00010000:2.0:1788361703.872488:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361703.872491:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361703.872578:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407027200:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1384us (1526us total) trans 77309411455 rc 0/0 00000100:00100000:2.0:1788361703.872586:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1293 00010000:00010000:1.0:1788361703.872658:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.872666:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.872678:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361703.872682:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.872688:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.872697:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99d112e94e00) 00010000:00010000:1.0:1788361703.872700:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361703.872702:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.872707:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe3ca4 lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.872728:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.872730:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.872732:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361703.876318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.876370:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407027456 00000100:00100000:3.0:1788361703.876389:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407027456 00000100:00100000:3.0:1788361703.876448:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:3.0:1788361703.876460:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407027456:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:3.0:1788361703.876698:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:71243:x1875230407027456:12345-192.168.204.35@tcp:35:rm.0 Request processed in 240us (389us total) trans 77309411456 rc 0/0 00000100:00100000:3.0:1788361703.876706:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:3.0:1788361703.878167:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.878646:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407027712 00000100:00100000:2.0:1788361703.878659:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407027712 00000100:00100000:2.0:1788361703.878723:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1294 00000100:00100000:2.0:1788361703.878737:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:71243:x1875230407027712:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:2.0:1788361703.878802:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788361703.878921:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3c81 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fff expref: 23 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.878952:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d100031e00/0x1b69fa8920fe379c lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f8f expref: 22 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.878969:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d0010ece00) 00010000:00010000:2.0:1788361703.879004:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20000/0x1b69fa8920fe3c34 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fdc expref: 21 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879013:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:2.0:1788361703.879017:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361703.879043:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879058:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879067:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879087:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879094:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879100:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879253:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879575:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879580:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361703.879781:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1788361703.879800:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879806:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879810:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879814:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361703.879817:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879853:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879861:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99d112e94000) 00010000:00010000:2.0:1788361703.879863:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361703.879865:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879870:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3cb9 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879889:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879892:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879896:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879900:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879908:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361703.879910:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879914:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879918:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:2.0:1788361703.879921:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361703.879925:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879929:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cab lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361703.879937:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0f8e7cb reply state 0000000018e35cbb transno 77309411457 ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879947:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.879951:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d112e94d00) 00010000:00010000:2.0:1788361703.879952:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361703.879955:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361703.880021:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407027712:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1287us (1858us total) trans 77309411457 rc 0/0 00000100:00100000:2.0:1788361703.880026:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1294 00000100:00100000:1.0:1788361703.881975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361703.882078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361703.882079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407027840 00000100:00100000:2.0:1788361703.882098:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407027840 00000100:00100000:0.0:1788361703.882130:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028096 00000100:00100000:0.0:1788361703.882135:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028096 00000100:00100000:0.0:1788361703.882173:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:0.0:1788361703.882184:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407028096:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:2.0:1788361703.882238:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 682 00000100:00100000:2.0:1788361703.882262:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2409:x1875230407027840:12345-192.168.204.35@tcp:103:rm.0 00010000:00010000:2.0:1788361703.882276:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361703.882303:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3c26 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fd5 expref: 8 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.882320:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d0010ec900) 00010000:00010000:2.0:1788361703.882330:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361703.882394:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2409:x1875230407027840:12345-192.168.204.35@tcp:103:rm.0 Request processed in 134us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.882402:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:71243:x1875230407028096:12345-192.168.204.35@tcp:35:rm.0 Request processed in 217us (322us total) trans 77309411458 rc 0/0 00000100:00100000:2.0:1788361703.882409:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 682 00000100:00100000:0.0:1788361703.882426:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:0.0:1788361703.884766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.884870:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028352 00000100:00100000:3.0:1788361703.884879:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028352 00000100:00100000:3.0:1788361703.884928:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1295 00000100:00100000:3.0:1788361703.884939:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:71243:x1875230407028352:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:3.0:1788361703.885009:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788361703.885033:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3c50 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fea expref: 23 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.885053:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d11785ee00/0x1b69fa8920fe3780 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f88 expref: 22 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.885068:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d103a4c200) 00010000:00010000:3.0:1788361703.885076:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361703.885121:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.885128:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.885138:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361703.885167:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429845760:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788361703.885213:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.885248:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.885268:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429845760 00000100:00100000:2.0:1788361703.885514:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429845760 00000100:00100000:2.0:1788361703.885552:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4163 00000100:00100000:2.0:1788361703.885560:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67579:x1875230429845760:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788361703.885570:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.885582:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3cc0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.885599:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 6 pid: 92324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.885606:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.885625:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 6 pid: 92324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.885643:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 6 pid: 92324 timeout: 2843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361703.885651:0:8449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8449:1875230429845888:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361703.885701:0:8449:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.887352:0:8449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8449:1875230429845888:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361703.887399:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.887413:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:2.0:1788361703.887417:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361703.887421:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.887432:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21400, rc 0) 00000100:00100000:2.0:1788361703.887494:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429845760:12345-0@lo:101:mdt00_004.0 Request processed in 1935us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.887502:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4163 00000100:00100000:3.0:1788361703.887550:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429845760:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788361703.887570:0:67579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.887582:0:67579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361703.888072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361703.888116:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028480 00000100:00100000:3.0:1788361703.888123:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028480 00010000:00010000:3.0:1788361703.888147:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 92324 timeout: 2843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361703.888174:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2593 00000100:00100000:3.0:1788361703.888222:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407028480:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361703.888234:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361703.888240:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 92324 timeout: 2843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888249:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 92324 timeout: 2843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888270:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710f7a expref: 7 pid: 92324 timeout: 2843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888302:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361703.888307:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888316:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888325:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888358:0:8456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361703.888371:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8456:1875230429846016:0@lo:105: 00000100:00100000:3.0:1788361703.888417:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.888466:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.888520:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846016 00000100:00100000:2.0:1788361703.888524:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846016 00000100:00100000:2.0:1788361703.888602:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788361703.888611:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8456:x1875230429846016:12345-0@lo:105: 00010000:00010000:2.0:1788361703.888622:0:10345:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.888643:0:10345:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.888653:0:10345:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.888661:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.888669:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.888683:0:10345:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.888707:0:10345:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d004308600) 00000100:00100000:2.0:1788361703.888742:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8456:x1875230429846016:12345-0@lo:105: Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.888748:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788361703.888773:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8456:1875230429846016:0@lo:105: 00010000:00010000:3.0:1788361703.888800:0:67579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.888802:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361703.888809:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361703.888858:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788361703.888864:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407028480:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 683us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.888870:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2593 00010000:00010000:3.0:1788361703.888893:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888901:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.888918:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361703.888932:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846144:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788361703.888961:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.888981:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002c1b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.889034:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846144 00000100:00100000:2.0:1788361703.889038:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846144 00000100:00100000:2.0:1788361703.889068:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4164 00000100:00100000:2.0:1788361703.889075:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429846144:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788361703.889090:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.889105:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cd5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3cce expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.889135:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cce expref: 10 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.889147:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cce expref: 10 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.889154:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d112e94000) 00010000:00010000:2.0:1788361703.889156:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361703.889158:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21e00, rc 0) 00000100:00100000:2.0:1788361703.889182:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429846144:12345-0@lo:101:mdt00_004.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.889187:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4164 00000100:00100000:3.0:1788361703.889305:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846144:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788361703.889314:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.889321:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361703.889329:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1788361703.889354:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846272:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361703.889372:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.889389:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361703.889408:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846272 00000100:00100000:0.0:1788361703.889412:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846272 00000100:00100000:0.0:1788361703.889439:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165 00000100:00100000:0.0:1788361703.889446:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429846272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361703.889562:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429846272:12345-0@lo:1000:mdt00_004.0 Request processed in 116us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.889568:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165 00000100:00100000:3.0:1788361703.889582:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846272:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361703.889620:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846400:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361703.889637:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.889652:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1039293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361703.889672:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846400 00000100:00100000:1.0:1788361703.889676:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846400 00000100:00100000:1.0:1788361703.889702:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4166 00000100:00100000:1.0:1788361703.889709:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429846400:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361703.889856:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429846400:12345-0@lo:1000:mdt00_004.0 Request processed in 147us (216us total) trans 0 rc 1/1 00000100:00100000:3.0:1788361703.889863:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846400:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361703.889864:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4166 00010000:00010000:3.0:1788361703.889902:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.889915:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.889930:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361703.889941:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846528:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788361703.889964:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361703.889988:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361703.890023:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846528 00000100:00100000:2.0:1788361703.890026:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846528 00000100:00100000:2.0:1788361703.890053:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4167 00000100:00100000:2.0:1788361703.890059:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429846528:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788361703.890067:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361703.890079:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3ce3 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3cdc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.890096:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3ce3 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cdc expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.890104:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3ce3 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cdc expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361703.890117:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d112e94800) 00010000:00010000:2.0:1788361703.890119:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361703.890120:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21a00, rc 0) 00000100:00100000:2.0:1788361703.890173:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429846528:12345-0@lo:101:mdt00_004.0 Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361703.890177:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4167 00000100:00100000:3.0:1788361703.890208:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429846528:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788361703.890215:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.890221:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.890238:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.890243:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.890249:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361703.890601:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].2, 432 off34200 00000040:00080000:3.0:1788361703.890654:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].2, 512 off34432 00000004:00080000:3.0:1788361703.890663:0:67579:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d103929a80 with version 9 00000004:00080000:1.0:1788361703.890724:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 9 rpc_version 9 00000020:00100000:1.0:1788361703.890745:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788361703.890755:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d10695f800 x1875230429846784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361703.890770:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429846784:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788361703.891031:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361703.891059:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361703.891104:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846784 00000100:00100000:3.0:1788361703.891108:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846784 00000100:00100000:3.0:1788361703.891146:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4168 00000100:00100000:3.0:1788361703.891154:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75530:x1875230429846784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788361703.893724:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75530:x1875230429846784:12345-0@lo:1000:osp_up0-1.0 Request processed in 2562us (2688us total) trans 120259084290 rc 0/0 00000100:00100000:3.0:1788361703.893738:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4168 00000100:00100000:1.0:1788361703.893780:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10695f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429846784:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1788361703.893809:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788361703.893862:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893872:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893881:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893893:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361703.893898:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893906:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893922:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d13a135e00) 00010000:00010000:3.0:1788361703.893926:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361703.893931:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893937:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308200/0x1b69fa8920fe3cea lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893956:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893976:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.893983:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.894010:0:67579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788361703.894022:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788361703.894027:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.894035:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.894042:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.894062:0:67579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1788361703.894066:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788361703.894071:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361703.894079:0:67579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894090:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361703.894098:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894106:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309200 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:1.0:1788361703.894111:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361703.894126:0:6512:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361703.894154:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:71243:x1875230407028352:12345-192.168.204.35@tcp:36:rm.0 Request processed in 9215us (9392us total) trans 77309411459 rc 0/0 00010000:00010000:1.0:1788361703.894157:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894165:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361703.894176:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1295 00010000:00010000:1.0:1788361703.894191:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894200:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004309200/0x1b69fa8920fe3cdc lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3ce3 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894215:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361703.894225:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894232:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:1.0:1788361703.894237:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.894238:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1788361703.894248:0:6512:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894270:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894276:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361703.894285:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429846912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361703.894311:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894324:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3cc0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3cc7 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361703.894334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361703.894338:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.894342:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.894344:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361703.894356:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361703.894369:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429847040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361703.894381:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429846912 00000100:00100000:2.0:1788361703.894388:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429846912 00000100:00100000:1.0:1788361703.894401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361703.894440:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429847040 00000100:00100000:2.0:1788361703.894444:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429847040 00000100:00100000:0.0:1788361703.894449:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1788361703.894461:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3653:x1875230429846912:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361703.894465:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1788361703.894477:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3651:x1875230429847040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361703.894491:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361703.894492:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361703.894513:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3ce3 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3cdc expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361703.894516:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21400/0x1b69fa8920fe3cc7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3cc0 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361703.894542:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff99d112e94800) 00010000:00010000:1.0:1788361703.894543:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:1.0:1788361703.894549:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361703.894555:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361703.894602:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3651:x1875230429847040:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361703.894605:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3653:x1875230429846912:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361703.894615:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1788361703.894625:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1788361703.894656:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429846912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361703.894662:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429847040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361704.534072:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361705.302228:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429847168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361705.302362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361705.302422:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429847168 00000100:00100000:0.0:1788361705.302437:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429847168 00000100:00100000:0.0:1788361705.302506:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1788361705.302517:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429847168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788361705.302545:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788361705.302551:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361705.302596:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429847168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361705.302604:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1788361705.302630:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429847168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361705.302715:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429847296:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788361705.302720:0:75535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 2745311895406ns, next at 2746311892334ns, rc = 0 00000100:00100000:1.0:1788361705.302750:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361705.302789:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429847296 00000100:00100000:2.0:1788361705.302794:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429847296 00000100:00100000:2.0:1788361705.302862:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00080000:1.0:1788361705.302869:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361705.302871:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429847296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361705.302890:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361705.302932:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429847296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361705.302940:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1788361705.302963:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429847296:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788361705.558029:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361705.863422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361705.863529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361705.863574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361705.863602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361705.863610:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028608 00000100:00100000:3.0:1788361705.863625:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028608 00000100:00100000:0.0:1788361705.863658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361705.863708:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028992 00000100:00100000:3.0:1788361705.863710:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:1.0:1788361705.863715:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028992 00000100:00100000:3.0:1788361705.863727:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:2410:x1875230407028608:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361705.863731:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028864 00000100:00100000:0.0:1788361705.863736:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028864 00000100:00100000:1.0:1788361705.863766:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029120 00000100:00100000:1.0:1788361705.863769:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029120 00000100:00100000:0.0:1788361705.863770:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407028736 00000100:00100000:0.0:1788361705.863797:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407028736 00000100:00100000:1.0:1788361705.863814:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1902 00000100:00100000:1.0:1788361705.863851:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407029120:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361705.863877:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:2410:x1875230407028608:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 146us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361705.863885:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 911 00000100:00100000:1.0:1788361705.863888:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407029120:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 67us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361705.863890:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:0.0:1788361705.863897:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2410:x1875230407028864:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361705.863900:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1902 00000100:00100000:1.0:1788361705.863918:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4922 00000100:00100000:1.0:1788361705.863926:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2408:x1875230407028992:12345-192.168.204.35@tcp:9:kworker.0 00000100:00100000:3.0:1788361705.863944:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 912 00000020:00000080:1.0:1788361705.863948:0:26170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3748 00000100:00100000:0.0:1788361705.863949:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2410:x1875230407028864:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 54us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361705.863959:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407028736:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:1.0:1788361705.863960:0:26170:0:(import.c:65:import_set_state_nolock()) ffff99d136ec7800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788361705.863968:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 911 00000100:00100000:3.0:1788361705.864001:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407028736:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361705.864010:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 912 00000001:00000004:1.0:1788361705.864034:0:26170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968751 00000100:00080000:0.0:1788361705.864035:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361705.864050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361705.864053:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361705.864055:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788361705.864077:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361705.864193:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+2:2408:x1875230407028992:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 268us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361705.864201:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4922 00010000:00010000:1.0:1788361706.581959:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361706.892265:0:92875:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 11:08:25 (1788361705) 00000020:00000080:0.0:1788361707.318339:0:92923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd811d0720 20000000:00000080:0.0:1788361707.318364:0:92923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99d136cdf400 uarg=0000000000000000 00000040:00100000:0.0:1788361707.318958:0:92923:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:0.0:1788361707.318968:0:92923:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:0.0:1788361707.319092:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:0.0:1788361707.319123:0:92923:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1788361707.319142:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:0.0:1788361707.319159:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:0.0:1788361707.319226:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:0.0:1788361707.319236:0:92923:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1788361707.319253:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:0.0:1788361707.319454:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:0.0:1788361707.320011:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:0.0:1788361707.320032:0:92923:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1788361707.320052:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:0.0:1788361707.320161:0:92923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:0.0:1788361707.320179:0:92923:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788361707.320207:0:92923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320227:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320234:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320241:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320247:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320253:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320270:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320278:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320285:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320292:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320303:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320312:0:92923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320321:0:92923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320373:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320387:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 9 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.320400:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847424:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788361707.320570:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320581:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 9 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.320588:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847552:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788361707.320613:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320619:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 23 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.320625:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847680:0@lo:104: 00000100:00100000:0.0:1788361707.320661:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361707.320694:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320699:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 23 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.320705:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847808:0@lo:104: 00000100:00100000:0.0:1788361707.320716:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361707.320745:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.320754:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 23 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.320776:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847936:0@lo:104: 00000100:00100000:3.0:1788361707.320786:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429847680 00000100:00100000:0.0:1788361707.320801:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361707.320803:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429847680 00000100:00100000:3.0:1788361707.321043:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429847808 00000100:00100000:3.0:1788361707.321059:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429847808 00010000:00010000:0.0:1788361707.321072:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.321083:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 23 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.321089:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429847936 00000100:00100000:3.0:1788361707.321095:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429847936 00000100:00100000:0.0:1788361707.321097:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848064:0@lo:104: 00000100:00100000:3.0:1788361707.321141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788361707.321142:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361707.321165:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848064 00000100:00100000:3.0:1788361707.321171:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:92923:x1875230429847680:12345-0@lo:104: 00010000:00010000:0.0:1788361707.321175:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.321180:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848064 00010000:00010000:0.0:1788361707.321195:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 23 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.321200:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00010000:00010000:3.0:1788361707.321204:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.321207:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848192:0@lo:104: 00000100:00100000:2.0:1788361707.321218:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92923:x1875230429847808:12345-0@lo:104: 00010000:00010000:2.0:1788361707.321237:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.321241:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361707.321258:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788361707.321270:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:1.0:1788361707.321309:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.321320:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 23 pid: 92296 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.321346:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848320:0@lo:104: 00010000:00010000:2.0:1788361707.321387:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788361707.321402:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92923:x1875230429847808:12345-0@lo:104: Request processed in 190us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.321411:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361707.321413:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00010000:3.0:1788361707.321449:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788361707.321457:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.321461:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:92923:x1875230429847680:12345-0@lo:104: Request processed in 301us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361707.321464:0:10345:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788361707.321485:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788361707.321488:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848192 00000100:00100000:0.0:1788361707.321489:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848320 00000100:00100000:2.0:1788361707.321499:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848192 00000100:00100000:0.0:1788361707.321499:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848320 00010000:00010000:1.0:1788361707.321507:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 23 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.321527:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848448:0@lo:104: 00000100:00100000:3.0:1788361707.321537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788361707.321554:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788361707.321555:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92923:x1875230429847936:12345-0@lo:104: 00010000:00010000:3.0:1788361707.321573:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.321574:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92923:x1875230429848064:12345-0@lo:104: 00000100:00100000:1.0:1788361707.321600:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361707.321603:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.321626:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1788361707.321635:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848448 00000100:00100000:0.0:1788361707.321639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848448 00010000:00010000:1.0:1788361707.321649:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.321664:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 23 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.321675:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848576:0@lo:104: 00010000:00010000:2.0:1788361707.321695:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788361707.321704:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92923:x1875230429848064:12345-0@lo:104: Request processed in 137us (566us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.321705:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788361707.321717:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788361707.321720:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361707.321731:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92923:x1875230429847936:12345-0@lo:104: Request processed in 170us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361707.321731:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788361707.321731:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:92923:x1875230429848192:12345-0@lo:104: 00010000:00010000:0.0:1788361707.321756:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.321774:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788361707.321775:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848576 00000100:00100000:2.0:1788361707.321781:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848576 00010000:00010000:1.0:1788361707.321785:0:92923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.321798:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788361707.321809:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92923:x1875230429848320:12345-0@lo:104: 00000100:00100000:2.0:1788361707.321817:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00010000:00010000:0.0:1788361707.321817:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.321895:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788361707.321895:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1788361707.321909:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.321911:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:92923:x1875230429848320:12345-0@lo:104: Request processed in 103us (501us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.321934:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e600 already unused, calling callback (ffffffffc1218c20) 00000100:00100000:0.0:1788361707.321935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 10000000:00010000:3.0:1788361707.321941:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.321949:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361707.321955:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361707.321960:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788361707.321967:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788361707.321980:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:92923:x1875230429848576:12345-0@lo:104: 00010000:00010000:0.0:1788361707.322000:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.322020:0:92923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 23 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322025:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.322036:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788361707.322052:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:92923:x1875230429848576:12345-0@lo:104: Request processed in 71us (337us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.322073:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361707.322080:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788361707.322081:0:92923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848704:0@lo:104: 00010000:00010000:3.0:1788361707.322113:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322123:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785e600/0x1b69fa8920fe3994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe399b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.322139:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1788361707.322149:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:1.0:1788361707.322152:0:92923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361707.322152:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:92923:x1875230429848192:12345-0@lo:104: Request processed in 420us (905us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.322158:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.322169:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00010000:00010000:3.0:1788361707.322181:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917c00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361707.322186:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322194:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361707.322202:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361707.322208:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788361707.322217:0:92923:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361707.322226:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848704 00000100:00100000:0.0:1788361707.322231:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848704 00010000:00010000:3.0:1788361707.322232:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322240:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788361707.322252:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847680:0@lo:104: 00000100:00100000:0.0:1788361707.322270:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00010000:00010000:3.0:1788361707.322271:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322277:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847808:0@lo:104: 00000100:00100000:0.0:1788361707.322284:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:92923:x1875230429848704:12345-0@lo:104: 00000100:00100000:1.0:1788361707.322303:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847936:0@lo:104: 00010000:00010000:0.0:1788361707.322306:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322315:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848064:0@lo:104: 00000100:00100000:1.0:1788361707.322335:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848192:0@lo:104: 00010000:00010000:3.0:1788361707.322350:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe39be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe39c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322359:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848320:0@lo:104: 00010000:00010000:3.0:1788361707.322376:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788361707.322382:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322385:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848576:0@lo:104: 00010000:00010000:0.0:1788361707.322385:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788361707.322407:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:92923:x1875230429848704:12345-0@lo:104: Request processed in 123us (255us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.322411:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d800 already unused, calling callback (ffffffffc1218c20) 00000100:00100000:1.0:1788361707.322415:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848704:0@lo:104: 10000000:00010000:3.0:1788361707.322417:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.322438:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:3.0:1788361707.322444:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361707.322455:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361707.322461:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361707.322482:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322488:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361707.322496:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322502:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207d800/0x1b69fa8920fe396a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3971 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322512:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788361707.322523:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322529:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785f000 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361707.322532:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322539:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361707.322545:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361707.322550:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361707.322566:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322572:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361707.322578:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322584:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785f000/0x1b69fa8920fe3986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe398d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322593:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361707.322596:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322601:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785fa00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361707.322604:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.322670:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:92923:x1875230429848448:12345-0@lo:104: 00010000:00010000:2.0:1788361707.322678:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322684:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429849216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361707.322698:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361707.322708:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361707.322714:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361707.322726:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788361707.322733:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361707.322738:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:92923:x1875230429848448:12345-0@lo:104: Request processed in 911us (1149us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.322745:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.322750:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:3.0:1788361707.322771:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361707.322779:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322781:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:2.0:1788361707.322791:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788361707.322793:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785fa00/0x1b69fa8920fe3932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322795:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429848832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361707.322804:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.322817:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429848448:0@lo:104: 00010000:00010000:3.0:1788361707.322818:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361707.322871:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322878:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361707.322882:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.322890:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361707.322897:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.322903:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361707.322913:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.322929:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207c200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361707.322937:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.322941:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361707.322950:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361707.322959:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361707.322966:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.322966:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361707.322980:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361707.322981:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.322990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788361707.322992:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361707.322992:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361707.322998:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323007:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361707.323017:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.323022:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323022:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323027:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d100031400/0x1b69fa8920fe395c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3963 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.323033:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429849344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361707.323037:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361707.323038:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361707.323055:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323055:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323067:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361707.323067:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207c200/0x1b69fa8920fe38e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe38ec expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323067:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d117aad200/0x1b69fa8920fe380c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3813 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323080:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.323080:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361707.323097:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361707.323098:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00207d600 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:2.0:1788361707.323103:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788361707.323105:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.323107:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361707.323109:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361707.323113:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361707.323120:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323124:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361707.323130:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849216 10000000:00010000:3.0:1788361707.323133:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.323136:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849216 10000000:01000000:3.0:1788361707.323146:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361707.323163:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 24 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323178:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.323180:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361707.323192:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788361707.323197:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848832 00000100:00100000:2.0:1788361707.323198:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849344 00000100:00100000:2.0:1788361707.323205:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849344 00000100:00100000:1.0:1788361707.323212:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848832 00010000:00010000:2.0:1788361707.323231:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 26 pid: 92296 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323232:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.323235:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 26 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.323281:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207d600/0x1b69fa8920fe3916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe391d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.323297:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00010000:00010000:3.0:1788361707.323303:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361707.323310:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429849216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361707.323311:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361707.323316:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361707.323326:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361707.323335:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 26 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.323342:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429848960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361707.323361:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 26 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.323367:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1788361707.323382:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429848832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361707.323388:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100030600/0x1b69fa8920fe398d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3986 expref: 26 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.323394:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361707.323403:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 25 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.323412:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361707.323413:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:3.0:1788361707.323421:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361707.323423:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 25 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.323431:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429849344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361707.323441:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361707.323447:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 25 pid: 92296 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.323469:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361707.323473:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429849216:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.323485:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00010000:00010000:2.0:1788361707.323503:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe399b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3994 expref: 24 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323503:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 24 pid: 92296 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.323506:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429848960 00000100:00100000:1.0:1788361707.323512:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429848960 00000100:00100000:3.0:1788361707.323522:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361707.323526:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361707.323527:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00207d000/0x1b69fa8920fe3939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3932 expref: 24 pid: 92296 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.323535:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 24 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323540:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361707.323561:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849472 00000100:00100000:3.0:1788361707.323565:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788361707.323567:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849472 00000100:00100000:2.0:1788361707.323574:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429848832:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361707.323574:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429849344:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361707.323582:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361707.323583:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00010000:00010000:1.0:1788361707.323589:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 24 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.323592:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1788361707.323608:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1788361707.323620:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429848960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361707.323628:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361707.323633:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 22 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.323644:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 22 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.323657:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361707.323666:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785ec00/0x1b69fa8920fe39c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe39be expref: 22 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.323680:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849088 00000100:00100000:3.0:1788361707.323686:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361707.323694:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849088 00010000:00010000:2.0:1788361707.323698:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361707.323698:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1788361707.323712:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429849472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361707.323720:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361707.323724:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 22 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.323748:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429848960:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.323771:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:3.0:1788361707.323775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361707.323784:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1788361707.323789:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429849088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361707.323801:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 22 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.323806:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361707.323809:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849728 00000100:00100000:2.0:1788361707.323816:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849728 00010000:00010000:0.0:1788361707.323852:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 21 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.323870:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785ea00/0x1b69fa8920fe3963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe395c expref: 21 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.323892:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361707.323907:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361707.323913:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361707.323918:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 20 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.323932:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 20 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.323943:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe3971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe396a expref: 20 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.323951:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429848960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361707.323958:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361707.324004:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429849088:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.324012:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1788361707.324036:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849600 00000100:00100000:0.0:1788361707.324041:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429849472:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.324043:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849600 00000100:00100000:0.0:1788361707.324056:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00010000:00010000:2.0:1788361707.324057:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 20 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.324065:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 20 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.324123:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1788361707.324131:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1788361707.324142:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429849600:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361707.324151:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429849728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361707.324158:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788361707.324165:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788361707.324166:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361707.324167:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 19 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.324177:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 19 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.324185:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429849856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361707.324206:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847424:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361707.324211:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 19 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361707.324230:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361707.324230:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 19 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.324255:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00207ce00/0x1b69fa8920fe3813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe380c expref: 19 pid: 92299 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.324369:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100031200/0x1b69fa8920fe38ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe38e5 expref: 18 pid: 92297 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361707.324384:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361707.324385:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849856 00000100:00100000:3.0:1788361707.324394:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849856 00010000:00010000:3.0:1788361707.324416:0:9529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 18 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361707.324431:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:3650:x1875230429849600:12345-0@lo:103:ldlm_bl.0 Request processed in 296us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.324442:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00010000:00010000:2.0:1788361707.324444:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361707.324465:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:3.0:1788361707.324484:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:3653:x1875230429849856:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361707.324492:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:3650:x1875230429849728:12345-0@lo:103:ldlm_bl.0 Request processed in 347us (744us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.324495:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361707.324499:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00010000:00010000:3.0:1788361707.324503:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 17 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.324518:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 16 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.324535:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100031600/0x1b69fa8920fe391d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3916 expref: 16 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.324611:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361707.324653:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3653:x1875230429849856:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361707.324662:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1788361707.324691:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429849856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361707.324713:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361707.324730:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361707.324731:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361707.324746:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361707.324775:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429849472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361707.324809:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029376 00000100:00100000:2.0:1788361707.324819:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029376 00010000:00010000:2.0:1788361707.324911:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.324945:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2603 00000100:00100000:2.0:1788361707.324954:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407029376:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361707.324963:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361707.324969:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.324981:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361707.325007:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361707.325056:0:92923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e000/0x1b69fa8920fe39da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fab expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.325075:0:92923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92923:1875230429847552:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788361707.325133:0:92923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.325186:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429848832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361707.325197:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429849344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361707.325206:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429849216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361707.325262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361707.325304:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029248 00000100:00100000:0.0:1788361707.325309:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029248 00010000:00010000:0.0:1788361707.325330:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361707.325363:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2604 00000100:00100000:0.0:1788361707.325373:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407029248:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361707.325386:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361707.325392:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325413:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325427:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785e400/0x1b69fa8920fe39e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb9 expref: 10 pid: 92301 timeout: 2847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325444:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325453:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325470:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325478:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325486:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325493:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325500:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361707.325504:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325512:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325544:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361707.325555:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361707.325604:0:92923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361707.325618:0:92923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.325628:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3956ab41-635b-456b-967f-6c1073c5d2df+9:2409:x1875230407029376:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 672us (900us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361707.325644:0:92923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916a00/0x1b69fa8920fe3cf1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361707.325644:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2603 00000100:00100000:0.0:1788361707.326170:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+8:2409:x1875230407029248:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 795us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361707.326182:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2604 00010000:00010000:2.0:1788361707.606148:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361708.630422:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361708.886062:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429850240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361708.886159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361708.886194:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429850496:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.886210:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429850752:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.886236:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361708.886253:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429849984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361708.886272:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429850880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.886285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361708.886308:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429850624:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.886324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361708.886356:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850496 00000100:00100000:1.0:1788361708.886357:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429851392:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.886366:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850496 00000100:00100000:1.0:1788361708.886390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361708.886415:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429851904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.886427:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850880 00000100:00100000:3.0:1788361708.886432:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850880 00000100:00100000:1.0:1788361708.886447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361708.886467:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851392 00000100:00100000:3.0:1788361708.886472:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851392 00000100:00100000:2.0:1788361708.886477:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851904 00000100:00100000:2.0:1788361708.886483:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851904 00000100:00100000:1.0:1788361708.886487:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:1.0:1788361708.886497:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429850112:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.886498:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1788361708.886510:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850240 00000100:00100000:0.0:1788361708.886516:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850240 00000100:00100000:3.0:1788361708.886523:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429850496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.886527:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788361708.886534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361708.886539:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.886555:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429849984 00000100:00100000:0.0:1788361708.886559:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429849984 00000100:00100000:1.0:1788361708.886570:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429850368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361708.886591:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4169 00000100:00100000:3.0:1788361708.886596:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429850496:12345-0@lo:400:kworker.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361708.886602:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429850880:12345-0@lo:400:kworker.0 Request processed in 63us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361708.886606:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3651:x1875230429850240:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361708.886612:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1788361708.886614:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361708.886622:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1788361708.886640:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000004:00000024:0.0:1788361708.886641:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444909056 avail 1298669568 00000100:00100000:2.0:1788361708.886647:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1788361708.886653:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429851392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.886659:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429851904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.886669:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429851008:0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.886679:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3651:x1875230429850240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361708.886684:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4169 00000100:00100000:0.0:1788361708.886700:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4170 00000100:00100000:0.0:1788361708.886707:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429849984:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361708.886717:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429851904:12345-0@lo:400:kworker.0 Request processed in 59us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361708.886719:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429851392:12345-0@lo:400:kworker.0 Request processed in 69us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361708.886720:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788361708.886721:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445298176 avail 1299058688 00000100:00100000:2.0:1788361708.886747:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1788361708.886753:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429851520:0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.886768:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429849984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361708.886774:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4170 00000100:00100000:0.0:1788361708.886786:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851008 00000100:00100000:0.0:1788361708.886792:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851008 00000100:00100000:1.0:1788361708.886806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361708.886816:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851520 00000100:00100000:0.0:1788361708.886819:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851520 00000100:00100000:1.0:1788361708.886847:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361708.886853:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4171 00000100:00100000:0.0:1788361708.886859:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3652:x1875230429851008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.886870:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172 00000100:00100000:2.0:1788361708.886880:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429851520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.886888:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361708.886894:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3652:x1875230429851008:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361708.886895:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1788361708.886901:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4171 00000100:00080000:0.0:1788361708.886924:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361708.886929:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361708.886936:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429850496:0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.886938:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429851520:12345-0@lo:400:kworker.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361708.886945:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850368 00000100:00100000:3.0:1788361708.886951:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850368 00000100:00100000:2.0:1788361708.886951:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172 00000100:00100000:1.0:1788361708.886958:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429850880:0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.886970:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850112 00000100:00100000:1.0:1788361708.886977:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429851392:0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.886977:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850112 00000100:00100000:1.0:1788361708.886995:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429851904:0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.887007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361708.887018:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788361708.887029:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3652:x1875230429850112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887037:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429851008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.887038:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429851136:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887049:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429851520:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887067:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429850112:0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.887072:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3652:x1875230429850112:12345-0@lo:400:kworker.0 Request processed in 46us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361708.887083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361708.887083:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788361708.887098:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852032 00000100:00100000:1.0:1788361708.887102:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852032 00000100:00100000:2.0:1788361708.887113:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429851648:0@lo:400:kworker.0 00000100:00080000:0.0:1788361708.887120:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361708.887125:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361708.887127:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1788361708.887139:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429850368:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361708.887143:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:2.0:1788361708.887150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361708.887158:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429852032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361708.887167:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361708.887170:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851136 00000100:00100000:0.0:1788361708.887175:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851136 00002000:00000024:1.0:1788361708.887181:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361708.887194:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429849984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361708.887221:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851648 00000100:00100000:0.0:1788361708.887226:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851648 00000100:00100000:1.0:1788361708.887230:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429852032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361708.887233:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1788361708.887245:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:2.0:1788361708.887247:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429851136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.887257:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875230429850368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361708.887260:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1788361708.887271:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:0.0:1788361708.887276:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3650:x1875230429851648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887292:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429850368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361708.887298:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429851136:12345-0@lo:400:kworker.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361708.887313:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1788361708.887325:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361708.887326:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429851648:12345-0@lo:400:kworker.0 Request processed in 53us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361708.887337:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00080000:0.0:1788361708.887365:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361708.887366:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429851136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361708.887381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361708.887387:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429851648:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.887411:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850624 00000100:00100000:3.0:1788361708.887416:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850624 00000100:00100000:2.0:1788361708.887424:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429850752 00000100:00100000:0.0:1788361708.887424:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429851264:0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.887430:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429850752 00000100:00080000:1.0:1788361708.887448:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361708.887454:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361708.887461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361708.887465:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1788361708.887471:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:3.0:1788361708.887477:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429850624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.887484:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429850752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887484:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851264 00000100:00100000:0.0:1788361708.887490:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429851776:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887491:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851264 00000100:00100000:3.0:1788361708.887535:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429850624:12345-0@lo:400:kworker.0 Request processed in 59us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361708.887536:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361708.887541:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:2.0:1788361708.887544:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429850752:12345-0@lo:400:kworker.0 Request processed in 65us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361708.887556:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1788361708.887557:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429851264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361708.887567:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1788361708.887578:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429850240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361708.887605:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429850624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361708.887606:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429851776 00000100:00100000:3.0:1788361708.887612:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429851776 00000100:00100000:0.0:1788361708.887612:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429850752:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887614:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429851264:12345-0@lo:400:kworker.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361708.887627:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1788361708.887638:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429851264:0@lo:400:kworker.0 00000100:00100000:1.0:1788361708.887652:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1788361708.887663:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429851776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361708.887681:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361708.887709:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429851776:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361708.887715:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:3.0:1788361708.887750:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429851776:0@lo:400:kworker.0 10000000:01000000:0.0:1788361709.014098:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361709.014106:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0057c2000 from 52 10000000:01000000:0.0:1788361709.014112:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361709.014162:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.014172:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.014184:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.014217:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.014291:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.014338:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.014357:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852160 00000100:00100000:3.0:1788361709.014366:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852160 00000100:00100000:3.0:1788361709.014422:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788361709.014432:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429852160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.014446:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.014460:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3cf8 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.014484:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 16 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.014520:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 16 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.014529:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308200, rc 0) 00000100:00100000:3.0:1788361709.014572:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429852160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.014580:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788361709.014618:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.014634:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.014655:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.014713:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.014755:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.014777:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.014813:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852288 00000100:00100000:2.0:1788361709.014818:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852288 00000100:00100000:2.0:1788361709.014862:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788361709.014868:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429852288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.014988:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429852288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361709.014996:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788361709.015022:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.015051:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.015090:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.015114:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.015135:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852416 00000100:00100000:3.0:1788361709.015139:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852416 00000100:00100000:3.0:1788361709.015166:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788361709.015172:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429852416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.015267:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429852416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.015275:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788361709.015297:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.015609:0:92926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92926:1875230429852544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.015644:0:92926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.015665:0:92926:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.015691:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852544 00000100:00100000:0.0:1788361709.015696:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852544 00000100:00100000:0.0:1788361709.015724:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788361709.015742:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:92926:x1875230429852544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.015840:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:92926:x1875230429852544:12345-0@lo:502:llog_process_th.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.015849:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788361709.015859:0:92926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92926:1875230429852544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.015901:0:92926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92926:1875230429852672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.015935:0:92926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.015961:0:92926:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96180 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.015986:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852672 00000100:00100000:1.0:1788361709.015992:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852672 00000100:00100000:1.0:1788361709.016021:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788361709.016030:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:92926:x1875230429852672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361709.016129:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:92926:x1875230429852672:12345-0@lo:502:llog_process_th.0 Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.016139:0:92926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92926:1875230429852672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361709.016139:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000040:00080000:3.0:1788361709.016169:0:92926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1788361709.016243:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1788361709.016263:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361709.016271:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.016280:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361709.016296:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788361709.016298:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:0.0:1788361709.016301:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361709.016316:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.016324:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.016331:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.016344:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.016370:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.016388:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.016416:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852800 00000100:00100000:2.0:1788361709.016420:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852800 00000100:00100000:2.0:1788361709.016445:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788361709.016451:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429852800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361709.016456:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361709.016464:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d06 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.016476:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 17 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.016482:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 17 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.016487:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20400, rc 0) 00000100:00100000:2.0:1788361709.016510:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429852800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361709.016520:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788361709.016531:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.016544:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.016553:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.016587:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.016611:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.016627:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.016647:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429852928 00000100:00100000:3.0:1788361709.016657:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429852928 00000100:00100000:3.0:1788361709.016683:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788361709.016690:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429852928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.016787:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429852928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.016796:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788361709.016817:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429852928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.016866:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.016902:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.016926:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.016942:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853056 00000100:00100000:3.0:1788361709.016948:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853056 00000100:00100000:3.0:1788361709.016974:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788361709.016981:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429853056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.017057:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429853056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.017064:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788361709.017135:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.017448:0:92927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92927:1875230429853184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.017482:0:92927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.017503:0:92927:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102ad20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.017531:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853184 00000100:00100000:1.0:1788361709.017537:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853184 00000100:00100000:1.0:1788361709.017563:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788361709.017572:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:92927:x1875230429853184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361709.017659:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:92927:x1875230429853184:12345-0@lo:502:llog_process_th.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.017665:0:92927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92927:1875230429853184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361709.017671:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000020:01000000:3.0:1788361709.017685:0:92927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361709.017694:0:92927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361709.017697:0:92927:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1788361709.017704:0:92927:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1788361709.017778:0:92927:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:3.0:1788361709.018429:0:92927:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00000001:00080000:2.0:1788361709.019941:0:92292:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00080000:10000000:3.0:1788361709.020329:0:92927:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:3.0:1788361709.021351:0:92927:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:3.0:1788361709.022255:0:92927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92927:1875230429853312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.022334:0:92927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.022384:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853312 00000100:00100000:3.0:1788361709.022385:0:92927:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c3dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.022393:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853312 00000100:00100000:2.0:1788361709.022439:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788361709.022449:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:92927:x1875230429853312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.022539:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:92927:x1875230429853312:12345-0@lo:502:llog_process_th.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361709.022545:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788361709.022562:0:92927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92927:1875230429853312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.022603:0:92927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92927:1875230429853440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.022633:0:92927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.022657:0:92927:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c3dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.022715:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853440 00000100:00100000:0.0:1788361709.022721:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853440 00000100:00100000:0.0:1788361709.022773:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788361709.022782:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:92927:x1875230429853440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.022913:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:92927:x1875230429853440:12345-0@lo:502:llog_process_th.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.022922:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788361709.022928:0:92927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92927:1875230429853440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361709.022952:0:92927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361709.022959:0:92927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361709.022961:0:92927:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:3.0:1788361709.022965:0:92927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1788361709.023052:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1788361709.023079:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361709.023105:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.023118:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361709.023129:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361709.023132:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 52 10000000:01000000:0.0:1788361709.023140:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361709.023165:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.023174:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.023184:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.023206:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.023235:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.023267:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.023275:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853568 00000100:00100000:3.0:1788361709.023280:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853568 00000100:00100000:3.0:1788361709.023312:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788361709.023319:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429853568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.023391:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.023407:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d14 expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.023429:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 18 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.023438:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 18 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.023447:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308c00, rc 0) 00000100:00100000:3.0:1788361709.023480:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429853568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.023486:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788361709.023518:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.023531:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.023540:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.023588:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.023615:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.023648:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.023707:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853696 00000100:00100000:1.0:1788361709.023712:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853696 00000100:00100000:1.0:1788361709.023793:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788361709.023802:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429853696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361709.023932:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429853696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.023940:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788361709.023974:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.024006:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.024047:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.024081:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.024093:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853824 00000100:00100000:0.0:1788361709.024099:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853824 00000100:00100000:0.0:1788361709.024134:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788361709.024141:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429853824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.024215:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429853824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.024225:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788361709.024251:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429853824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.024566:0:92928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92928:1875230429853952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.024603:0:92928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.024621:0:92928:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c3df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.024649:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429853952 00000100:00100000:0.0:1788361709.024655:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429853952 00000100:00100000:0.0:1788361709.024686:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788361709.024694:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:92928:x1875230429853952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.024798:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:92928:x1875230429853952:12345-0@lo:502:llog_process_th.0 Request processed in 104us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.024811:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788361709.024998:0:92928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92928:1875230429853952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.025085:0:92928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92928:1875230429854080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.025159:0:92928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.025212:0:92928:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d107d6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.025229:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854080 00000100:00100000:0.0:1788361709.025237:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854080 00000100:00100000:0.0:1788361709.025275:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788361709.025284:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:92928:x1875230429854080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.025368:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:92928:x1875230429854080:12345-0@lo:502:llog_process_th.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.025375:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788361709.025444:0:92928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92928:1875230429854080:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788361709.025467:0:92928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1788361709.025575:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1788361709.025611:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361709.025621:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.025632:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361709.025642:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788361709.025644:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1788361709.025647:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361709.025685:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.025701:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.025710:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.025740:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.025773:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.025797:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.025817:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854208 00000100:00100000:1.0:1788361709.025845:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854208 00000100:00100000:1.0:1788361709.025881:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788361709.025890:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429854208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361709.025899:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361709.025910:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d22 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.025929:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 19 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.025939:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 19 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.025947:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eac00, rc 0) 00000100:00100000:1.0:1788361709.025977:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429854208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.025989:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788361709.026024:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361709.026038:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.026047:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.026094:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.026120:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.026149:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.026169:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854336 00000100:00100000:3.0:1788361709.026175:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854336 00000100:00100000:3.0:1788361709.026202:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788361709.026209:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429854336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.026325:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429854336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.026333:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788361709.026407:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.026435:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.026471:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.026492:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.026511:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854464 00000100:00100000:0.0:1788361709.026528:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854464 00000100:00100000:0.0:1788361709.026561:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788361709.026569:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429854464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.026654:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429854464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.026661:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788361709.026698:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.027299:0:92929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92929:1875230429854592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.027410:0:92929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.027437:0:92929:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.027455:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854592 00000100:00100000:0.0:1788361709.027461:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854592 00000100:00100000:0.0:1788361709.027490:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788361709.027498:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:92929:x1875230429854592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.027892:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:92929:x1875230429854592:12345-0@lo:502:llog_process_th.0 Request processed in 395us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.027901:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788361709.027929:0:92929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92929:1875230429854592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361709.027957:0:92929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361709.027969:0:92929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361709.027971:0:92929:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:2.0:1788361709.027976:0:92929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788361709.028036:0:92929:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1788361709.028059:0:92929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92929:1875230429854720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.028093:0:92929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.028122:0:92929:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.028214:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854720 00000100:00100000:1.0:1788361709.028220:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854720 00000100:00100000:1.0:1788361709.028265:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788361709.028273:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:92929:x1875230429854720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361709.028365:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:92929:x1875230429854720:12345-0@lo:502:llog_process_th.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.028373:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788361709.028398:0:92929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92929:1875230429854720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.028433:0:92929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92929:1875230429854848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.028467:0:92929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.028485:0:92929:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.028504:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854848 00000100:00100000:3.0:1788361709.028510:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854848 00000100:00100000:3.0:1788361709.028546:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788361709.028554:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d112d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:92929:x1875230429854848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.028632:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d112d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:92929:x1875230429854848:12345-0@lo:502:llog_process_th.0 Request processed in 79us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.028640:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788361709.028668:0:92929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92929:1875230429854848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361709.028687:0:92929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361709.028691:0:92929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361709.028693:0:92929:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:2.0:1788361709.028696:0:92929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:0.0:1788361709.028949:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:0.0:1788361709.028966:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788361709.028973:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.028985:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361709.028991:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361709.028993:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 52 10000000:01000000:0.0:1788361709.028995:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361709.029012:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.029017:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.029023:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.029032:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.029051:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.029071:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.029091:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429854976 00000100:00100000:3.0:1788361709.029096:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429854976 00000100:00100000:3.0:1788361709.029126:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788361709.029130:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429854976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.029136:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.029147:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d30 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.029163:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 20 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.029169:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 20 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.029174:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309a00, rc 0) 00000100:00100000:3.0:1788361709.029209:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429854976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.029215:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788361709.029231:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429854976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.029245:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.029251:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.029285:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.029301:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.029324:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.029343:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855104 00000100:00100000:3.0:1788361709.029348:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855104 00000100:00100000:3.0:1788361709.029376:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788361709.029382:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429855104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.029468:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429855104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.029475:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788361709.029490:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.029512:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.029540:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.029553:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d139945840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.029580:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855232 00000100:00100000:1.0:1788361709.029585:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855232 00000100:00100000:1.0:1788361709.029614:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788361709.029623:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429855232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361709.029706:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429855232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.029714:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788361709.029724:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.029959:0:92930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92930:1875230429855360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.029983:0:92930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.030003:0:92930:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.030014:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855360 00000100:00100000:2.0:1788361709.030018:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855360 00000100:00100000:2.0:1788361709.030045:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788361709.030051:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:92930:x1875230429855360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.030124:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:92930:x1875230429855360:12345-0@lo:502:llog_process_th.0 Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.030138:0:92930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92930:1875230429855360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.030140:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788361709.030169:0:92930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92930:1875230429855488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.030197:0:92930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.030212:0:92930:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.030238:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855488 00000100:00100000:3.0:1788361709.030244:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855488 00000100:00100000:3.0:1788361709.030287:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788361709.030294:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:92930:x1875230429855488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.030370:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:92930:x1875230429855488:12345-0@lo:502:llog_process_th.0 Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.030381:0:92930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92930:1875230429855488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.030395:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000040:00080000:0.0:1788361709.030398:0:92930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1788361709.030468:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1788361709.030485:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361709.030491:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.030500:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361709.030508:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788361709.030510:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788361709.030512:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361709.030527:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.030534:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.030542:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.030552:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.030585:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.030601:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.030627:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855616 00000100:00100000:3.0:1788361709.030633:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855616 00000100:00100000:3.0:1788361709.030663:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788361709.030672:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429855616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.030680:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.030690:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d3e expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.030705:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 21 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.030713:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 21 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.030740:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309c00, rc 0) 00000100:00100000:3.0:1788361709.030781:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429855616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.030788:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788361709.030810:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361709.030859:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.030873:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.030915:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.030939:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.030956:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.030976:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855744 00000100:00100000:1.0:1788361709.030981:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855744 00000100:00100000:1.0:1788361709.031008:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788361709.031016:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429855744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361709.031096:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429855744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.031103:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788361709.031122:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.031150:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.031181:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.031198:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361709.031224:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429855872 00000100:00100000:0.0:1788361709.031230:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429855872 00000100:00100000:0.0:1788361709.031264:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788361709.031270:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429855872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.031339:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429855872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.031348:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788361709.031356:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429855872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361709.032034:0:92931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788361709.032089:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788361709.032113:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788361709.032125:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.032134:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361709.032141:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361709.032143:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 52 10000000:01000000:0.0:1788361709.032146:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361709.032162:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.032169:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.032178:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.032205:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.032238:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.032268:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.032282:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856000 00000100:00100000:3.0:1788361709.032288:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856000 00000100:00100000:3.0:1788361709.032322:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788361709.032330:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429856000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.032338:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.032347:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d4c expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.032367:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 22 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.032385:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 22 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.032392:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308a00, rc 0) 00000100:00100000:3.0:1788361709.032427:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429856000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.032433:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788361709.032449:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.032460:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.032470:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.032505:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.032529:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.032544:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.032563:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856128 00000100:00100000:3.0:1788361709.032567:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856128 00000100:00100000:3.0:1788361709.032589:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788361709.032595:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429856128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.032663:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429856128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.032670:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788361709.032684:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.032706:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.032748:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.032760:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.032797:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856256 00000100:00100000:1.0:1788361709.032803:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856256 00000100:00100000:1.0:1788361709.032863:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788361709.032872:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429856256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361709.032967:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429856256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.032977:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361709.032982:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.033159:0:92932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92932:1875230429856384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.033194:0:92932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.033225:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856384 00000100:00100000:2.0:1788361709.033231:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856384 00000100:00100000:0.0:1788361709.033234:0:92932:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.033266:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788361709.033275:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:92932:x1875230429856384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361709.033366:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:92932:x1875230429856384:12345-0@lo:502:llog_process_th.0 Request processed in 91us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361709.033373:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788361709.033406:0:92932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92932:1875230429856384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.033450:0:92932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92932:1875230429856512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361709.033483:0:92932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.033501:0:92932:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.033518:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856512 00000100:00100000:3.0:1788361709.033523:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856512 00000100:00100000:3.0:1788361709.033556:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788361709.033563:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:92932:x1875230429856512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361709.033636:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:92932:x1875230429856512:12345-0@lo:502:llog_process_th.0 Request processed in 73us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.033641:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788361709.033683:0:92932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:92932:1875230429856512:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788361709.033703:0:92932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1788361709.033887:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1788361709.033906:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361709.033912:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.033932:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361709.033941:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788361709.033943:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788361709.033946:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361709.033973:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.033981:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.033989:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.034001:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.034021:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.034039:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d122ddb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.034066:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856640 00000100:00100000:3.0:1788361709.034072:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856640 00000100:00100000:3.0:1788361709.034106:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361709.034113:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429856640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.034130:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.034139:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d5a expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.034155:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.034163:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.034169:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309800, rc 0) 00000100:00100000:3.0:1788361709.034202:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429856640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.034208:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788361709.034214:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361709.034225:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361709.034233:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.034272:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.034296:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.034320:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d122ddb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.034346:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856768 00000100:00100000:1.0:1788361709.034351:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856768 00000100:00100000:1.0:1788361709.034379:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361709.034386:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d140c7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429856768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361709.034471:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d140c7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429856768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.034479:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788361709.034490:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.034520:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.034552:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361709.034665:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429856896 00000100:00100000:3.0:1788361709.034670:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429856896 00000100:00100000:2.0:1788361709.034670:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d122ddb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361709.034698:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788361709.034705:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1376d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429856896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.034788:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1376d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429856896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.034795:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788361709.034818:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429856896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361709.035714:0:92933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788361709.035788:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788361709.035812:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361709.035842:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.035851:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361709.035873:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788361709.035876:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:0.0:1788361709.035879:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788361709.035900:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.035909:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.035917:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.035933:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429857024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.035970:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.035995:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361709.036043:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429857024 00000100:00100000:1.0:1788361709.036055:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429857024 00000100:00100000:1.0:1788361709.036117:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788361709.036124:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429857024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361709.036140:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361709.036160:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d68 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.036204:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 24 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.036216:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 24 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.036225:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea800, rc 0) 00000100:00100000:1.0:1788361709.036326:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429857024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.036361:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788361709.036457:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429857024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.036472:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.036479:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361709.036546:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429857152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361709.036585:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361709.036608:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.036632:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429857152 00000100:00100000:2.0:1788361709.036639:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429857152 00000100:00100000:2.0:1788361709.036677:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788361709.036686:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429857152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361709.036779:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429857152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (193us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361709.036786:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788361709.036885:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429857152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788361709.036915:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361709.036928:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.036937:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.191755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361709.191898:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029504 00000100:00100000:3.0:1788361709.191909:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029504 00000100:00100000:3.0:1788361709.191990:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:3.0:1788361709.192003:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407029504:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361709.192024:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361709.192043:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae711006 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.192095:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 9 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.192109:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 9 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.192118:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309000, rc 0) 00000100:00100000:3.0:1788361709.192178:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407029504:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 178us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.192186:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:2.0:1788361709.194956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361709.195057:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029632 00000100:00100000:3.0:1788361709.195066:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029632 00000100:00100000:3.0:1788361709.195116:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 115 00000100:00100000:3.0:1788361709.195125:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407029632:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.195290:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407029632:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 165us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.195299:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 115 00000100:00100000:1.0:1788361709.198228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361709.198312:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029760 00000100:00100000:3.0:1788361709.198322:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029760 00000100:00100000:3.0:1788361709.198376:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:3.0:1788361709.198385:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407029760:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361709.198527:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407029760:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 142us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.198535:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:2.0:1788361709.201072:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361709.201519:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407029888 00000100:00100000:0.0:1788361709.201533:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407029888 00000100:00100000:0.0:1788361709.202038:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:0.0:1788361709.202049:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:71833:x1875230407029888:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361709.202194:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:71833:x1875230407029888:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 146us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.202203:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:2.0:1788361709.204354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361709.204508:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030016 00000100:00100000:1.0:1788361709.204521:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030016 00000100:00100000:1.0:1788361709.204583:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:1.0:1788361709.204594:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12c551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:71833:x1875230407030016:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361709.204781:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12c551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:71833:x1875230407030016:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 184us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.204790:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:1.0:1788361709.206603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361709.206713:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030144 00000100:00100000:0.0:1788361709.206741:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030144 00000100:00100000:0.0:1788361709.206818:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:0.0:1788361709.206860:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407030144:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361709.206876:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361709.206895:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae71100d expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.206926:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 10 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.206938:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 10 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361709.206949:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917e00, rc 0) 00000100:00100000:0.0:1788361709.207034:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407030144:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 173us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361709.207042:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:2.0:1788361709.208898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361709.209013:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030272 00000100:00100000:1.0:1788361709.209088:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030272 00000100:00100000:1.0:1788361709.209140:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:1.0:1788361709.209148:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407030272:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361709.209324:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407030272:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 176us (577us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361709.209333:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 120 00010000:00010000:2.0:1788361709.654051:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361709.916640:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000020:00000080:1.0:1788361709.916650:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d136ec1800/f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00080000:1.0:1788361709.916669:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968751 is committed 00000020:00000080:3.0:1788361709.916861:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136ec1800/f1e400d1-472b-42d1-b5e7-e80dc701272a for lustre-OST0000 00000020:00000080:3.0:1788361709.916918:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136ec7800 for lustre-OST0000 00000004:00080000:1.0:1788361709.917481:0:75524:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00010000:00010000:1.0:1788361709.917527:0:75524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361709.917542:0:75524:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917588:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917596:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917603:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917610:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361709.917614:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917621:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917633:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff99d105584b00) 00010000:00010000:1.0:1788361709.917637:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361709.917641:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917647:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d117aac800/0x1b69fa8920fe3a2e lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917666:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917673:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917687:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917692:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361709.917695:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917702:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917759:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff99d105584b00) 00010000:00010000:1.0:1788361709.917763:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361709.917767:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917773:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3c96 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917794:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917800:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917806:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917811:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361709.917814:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917848:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917858:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff99d112e94d00) 00010000:00010000:1.0:1788361709.917860:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361709.917864:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917870:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3cb2 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.917987:0:75524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361709.917997:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429857280:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788361709.917997:0:75524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361709.918007:0:75524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308400/0x1b69fa8920fe3cce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3cd5 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361709.918023:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411459 is committed 00000004:00080000:1.0:1788361709.918042:0:75524:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:3.0:1788361709.918052:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429857408:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1788361709.918093:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361709.918093:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361709.918124:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429857408 00000100:00100000:1.0:1788361709.918131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429857408 00000100:00100000:1.0:1788361709.918185:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1788361709.918197:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3651:x1875230429857408:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788361709.918211:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361709.918229:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3cd5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3cce expref: 8 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.918241:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99d112e94000) 00010000:00010000:1.0:1788361709.918255:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361709.918296:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429857408:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361709.918304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1788361709.918332:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429857280 00000100:00100000:2.0:1788361709.918340:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429857408:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:3.0:1788361709.918547:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968753 is committed 00000100:00100000:1.0:1788361709.918596:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429857280 00000100:00100000:1.0:1788361709.918630:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923 00000100:00100000:1.0:1788361709.918635:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429857280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1788361709.918657:0:8535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:546 count 1 00010000:00010000:1.0:1788361709.918677:0:8535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.918695:0:8535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 5 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.918704:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x222:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1788361709.918717:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361709.918722:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.918746:0:8535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 5 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.918761:0:8535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 5 pid: 8535 timeout: 2849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361709.918772:0:8535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1875230429857536:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788361709.919095:0:8535:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d136fd4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361709.921907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361709.922257:0:8535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1875230429857536:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788361709.922318:0:8535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361709.922387:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030400 00000100:00100000:3.0:1788361709.922399:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030400 00010000:00010000:3.0:1788361709.922460:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 2849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361709.922503:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2605 00000100:00100000:3.0:1788361709.922515:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407030400:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361709.922532:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361709.922539:0:19648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 2849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922556:0:19648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 2849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922584:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc404cb2/0x1b69fa8920fe3a4a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fce expref: 6 pid: 8535 timeout: 2849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922611:0:19648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361709.922616:0:19648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361709.922622:0:19648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922645:0:19648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361709.922647:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361709.922682:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361709.922724:0:8535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.922737:0:8535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.922751:0:8535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361709.922753:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407030400:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 238us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361709.922783:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2605 00010000:00010000:1.0:1788361709.922784:0:8535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361709.922866:0:8535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361709.922872:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361709.922880:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922890:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361709.922895:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922906:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922924:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922932:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6bf172b/0x1b69fa8920fe3d84 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361709.922960:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361709.922970:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361709.922972:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361709.923114:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429857280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4475us (5019us total) trans 4294968754 rc 0/0 00000100:00100000:1.0:1788361709.923126:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923 00000004:00080000:2.0:1788361709.923162:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d1364fd500/2, rc 0, transno 4294968754 00000100:00100000:2.0:1788361709.923179:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429857280:0@lo:6:osp-syn-1-1.0 00000020:00000080:1.0:1788361710.217039:0:93030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff402a2330 20000000:00000080:1.0:1788361710.217053:0:93030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99d121185800 uarg=0000000000000000 00000040:00100000:1.0:1788361710.217594:0:93030:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:1.0:1788361710.217599:0:93030:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:1.0:1788361710.217684:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:1.0:1788361710.217724:0:93030:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788361710.217744:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:1.0:1788361710.217762:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:1.0:1788361710.217808:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:1.0:1788361710.217814:0:93030:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788361710.217862:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:1.0:1788361710.217882:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:1.0:1788361710.217926:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:1.0:1788361710.217933:0:93030:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788361710.217947:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:1.0:1788361710.217961:0:93030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:1.0:1788361710.217973:0:93030:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788361710.217992:0:93030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218007:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218013:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218017:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218021:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218025:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218029:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218038:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218042:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218046:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218052:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 9 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218056:0:93030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218060:0:93030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218092:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218108:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 9 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218123:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429857664:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788361710.218205:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 9 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218212:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 9 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218223:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429857792:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788361710.218248:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218254:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 23 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218260:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429857920:0@lo:104: 00000100:00100000:1.0:1788361710.218287:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361710.218313:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218319:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 23 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218325:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858048:0@lo:104: 00000100:00100000:0.0:1788361710.218325:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429857920 00000100:00100000:0.0:1788361710.218333:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429857920 00000100:00100000:0.0:1788361710.218392:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788361710.218406:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429857920:12345-0@lo:104: 00010000:00010000:0.0:1788361710.218420:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218423:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.218456:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858048 00000100:00100000:1.0:1788361710.218460:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858048 00000100:00100000:1.0:1788361710.218480:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00010000:00010000:0.0:1788361710.218482:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361710.218487:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429858048:12345-0@lo:104: 00000100:00100000:0.0:1788361710.218493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429857920:12345-0@lo:104: Request processed in 88us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361710.218496:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.218505:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:1.0:1788361710.218528:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788361710.218533:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429858048:12345-0@lo:104: Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.218545:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00010000:00010000:0.0:1788361710.218545:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361710.218553:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218570:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361710.218575:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218576:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218593:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218596:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 23 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361710.218609:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218614:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858176:0@lo:104: 10000000:01000000:0.0:1788361710.218623:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788361710.218639:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361710.218662:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218663:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218672:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 23 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218678:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788361710.218682:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858432:0@lo:104: 00000100:00100000:1.0:1788361710.218698:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361710.218712:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218721:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe3d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218730:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788361710.218735:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788361710.218740:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858176 00010000:00010000:0.0:1788361710.218740:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218744:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858176 00010000:00010000:0.0:1788361710.218751:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20000 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361710.218755:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218757:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858432 00000100:00100000:1.0:1788361710.218760:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858432 00010000:00010000:0.0:1788361710.218767:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218770:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788361710.218778:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429858176:12345-0@lo:104: 10000000:00010000:0.0:1788361710.218782:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218785:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361710.218798:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361710.218818:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218849:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361710.218857:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788361710.218859:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218866:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429858176:12345-0@lo:104: Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.218886:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00010000:00010000:0.0:1788361710.218890:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c20000/0x1b69fa8920fe3d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218903:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788361710.218904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00010000:00010000:0.0:1788361710.218909:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218915:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e522450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429858432:12345-0@lo:104: 00010000:00010000:0.0:1788361710.218921:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916c00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361710.218926:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.218927:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.218944:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361710.218953:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361710.218958:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361710.218974:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788361710.218977:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.218982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e522450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429858432:12345-0@lo:104: Request processed in 68us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361710.218990:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788361710.218994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00010000:0.0:1788361710.219007:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.219015:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916c00/0x1b69fa8920fe3d4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d53 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.219025:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361710.219034:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.219042:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361710.219045:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.219053:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.219059:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 23 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361710.219062:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361710.219074:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361710.219076:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 23 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219087:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858816:0@lo:104: 00010000:00010000:0.0:1788361710.219094:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.219101:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361710.219109:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219114:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361710.219122:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c21400/0x1b69fa8920fe3d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d45 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.219132:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361710.219136:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361710.219139:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858816 00010000:00010000:0.0:1788361710.219139:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361710.219145:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858816 00000100:00100000:1.0:1788361710.219164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788361710.219182:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429858816:12345-0@lo:104: 00010000:00010000:1.0:1788361710.219190:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.219224:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361710.219230:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429858816:12345-0@lo:104: Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.219246:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:2.0:1788361710.219247:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361710.219254:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.219261:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361710.219265:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.219273:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.219280:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 23 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361710.219282:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361710.219300:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361710.219303:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 23 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219314:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859072:0@lo:104: 00010000:00010000:2.0:1788361710.219328:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.219336:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361710.219343:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.219345:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361710.219352:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917800/0x1b69fa8920fe3d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.219363:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361710.219365:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361710.219367:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361710.219373:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361710.219380:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429858688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361710.219389:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429858560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.219417:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.219440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361710.219451:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 23 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.219462:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 23 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219472:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859328:0@lo:104: 00000100:00100000:3.0:1788361710.219478:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429858944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361710.219490:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858688 00000100:00100000:2.0:1788361710.219495:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858688 00000100:00100000:1.0:1788361710.219500:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.219520:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361710.219520:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 24 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.219525:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 24 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.219541:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 24 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219547:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859456:0@lo:104: 00000100:00100000:2.0:1788361710.219557:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858944 00000100:00100000:2.0:1788361710.219562:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858944 00000100:00100000:3.0:1788361710.219573:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:1.0:1788361710.219574:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361710.219579:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 25 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.219590:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3650:x1875230429858688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361710.219603:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361710.219604:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859072 00000100:00100000:2.0:1788361710.219609:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1788361710.219611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859072 00010000:00010000:3.0:1788361710.219613:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 25 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.219622:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3651:x1875230429858944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361710.219630:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 25 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219632:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859328 00010000:00010000:2.0:1788361710.219634:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361710.219638:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859328 00010000:00010000:2.0:1788361710.219643:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 25 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.219651:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361710.219657:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 25 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219659:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859456 00000100:00100000:1.0:1788361710.219663:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859456 00010000:00010000:2.0:1788361710.219674:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361710.219677:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788361710.219682:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:93030:x1875230429859072:12345-0@lo:104: 00010000:00010000:1.0:1788361710.219689:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.219715:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3650:x1875230429858688:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.219723:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1788361710.219733:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3651:x1875230429858944:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361710.219744:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788361710.219749:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788361710.219749:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1788361710.219756:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:93030:x1875230429859072:12345-0@lo:104: Request processed in 70us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361710.219757:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.219771:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00010000:3.0:1788361710.219773:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21a00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361710.219778:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.219785:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.219790:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788361710.219799:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429859328:12345-0@lo:104: 00010000:00010000:3.0:1788361710.219805:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.219811:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788361710.219811:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.219848:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429859200:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788361710.219866:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.219873:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788361710.219880:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361710.219896:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.219904:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788361710.219912:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858560 00010000:00010000:3.0:1788361710.219919:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.219925:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858560 00010000:00010000:3.0:1788361710.219932:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe3d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.219944:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 24 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.219946:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361710.219949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361710.219953:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361710.219979:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859200 00000100:00100000:3.0:1788361710.219981:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788361710.219984:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859200 00000100:00100000:3.0:1788361710.219995:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429859456:12345-0@lo:104: 00010000:00010000:1.0:1788361710.219996:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788361710.220002:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 25 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220009:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220009:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:93030:x1875230429859328:12345-0@lo:104: Request processed in 210us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.220027:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788361710.220031:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1788361710.220040:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3653:x1875230429858560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361710.220049:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361710.220055:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 25 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220064:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788361710.220066:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 25 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.220073:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429859456:12345-0@lo:104: Request processed in 82us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.220080:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:3.0:1788361710.220096:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361710.220100:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220112:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361710.220116:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220123:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361710.220129:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.220134:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361710.220153:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220159:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361710.220166:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220172:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917400/0x1b69fa8920fe3d14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220181:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361710.220184:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220189:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916600 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361710.220192:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220208:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361710.220214:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.220219:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361710.220234:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220240:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361710.220247:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.220248:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429858304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361710.220261:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916600/0x1b69fa8920fe3d06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3d0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.220273:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361710.220276:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361710.220278:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361710.220286:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.220316:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429858304 00000100:00100000:3.0:1788361710.220320:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429858304 00000100:00100000:0.0:1788361710.220322:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361710.220330:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429859584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361710.220338:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 26 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.220366:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788361710.220370:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.220378:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3653:x1875230429859200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361710.220387:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361710.220393:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 26 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.220395:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859584 00010000:00010000:1.0:1788361710.220431:0:93030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 26 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.220438:0:93030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 26 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.220441:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859584 00000100:00100000:1.0:1788361710.220447:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859712:0@lo:104: 00010000:00010000:0.0:1788361710.220462:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 27 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220471:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361710.220487:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1788361710.220493:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859712 00000100:00100000:0.0:1788361710.220496:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+27:3652:x1875230429858304:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.220502:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859712 00010000:00010000:0.0:1788361710.220506:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361710.220512:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 27 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220522:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 27 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220529:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00010000:00010000:0.0:1788361710.220535:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361710.220539:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429859712:12345-0@lo:104: 00010000:00010000:1.0:1788361710.220548:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.220587:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+27:3652:x1875230429858304:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (301us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361710.220593:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361710.220595:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1788361710.220601:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:93030:x1875230429859712:12345-0@lo:104: Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.220607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788361710.220614:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:0.0:1788361710.220623:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429859584:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.220629:0:93030:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d120e5e540 going to sleep for 11 seconds 00010000:00010000:0.0:1788361710.220632:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361710.220638:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 26 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220648:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 26 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.220652:0:93030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe3d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d68 expref: 26 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220663:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361710.220672:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429857920:0@lo:104: 00000100:00100000:1.0:1788361710.220684:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858048:0@lo:104: 00010000:00010000:1.0:1788361710.220696:0:93030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308a00/0x1b69fa8920fe3d53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d4c expref: 25 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.220714:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429859584:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.220721:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858176:0@lo:104: 00000100:00100000:0.0:1788361710.220727:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00010000:00010000:1.0:1788361710.220739:0:93030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309c00/0x1b69fa8920fe3d45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d3e expref: 23 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220749:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858432:0@lo:104: 00000100:00100000:0.0:1788361710.220759:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429859584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.220764:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429858816:0@lo:104: 00000100:00100000:0.0:1788361710.220774:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429858304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361710.220779:0:93030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3d29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d22 expref: 22 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220801:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788361710.220804:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859072:0@lo:104: 00010000:00010000:0.0:1788361710.220807:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220816:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc1218c20) 00000100:00100000:1.0:1788361710.220819:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859328:0@lo:104: 10000000:00010000:0.0:1788361710.220843:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220853:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220854:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859456:0@lo:104: 10000000:00010000:0.0:1788361710.220867:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220869:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429859712:0@lo:104: 10000000:01000000:0.0:1788361710.220880:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361710.220901:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220907:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361710.220919:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.220926:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429859968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361710.220928:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916800/0x1b69fa8920fe3cf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3cff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.220958:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361710.220959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361710.220963:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361710.220966:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361710.220978:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429860096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.220993:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429858944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361710.221006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.221007:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361710.221016:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429859840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361710.221036:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859968 00000100:00100000:0.0:1788361710.221041:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859968 00000100:00100000:1.0:1788361710.221048:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361710.221056:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 22 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.221068:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361710.221074:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860096 00000100:00100000:0.0:1788361710.221078:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860096 00010000:00010000:0.0:1788361710.221090:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 23 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.221091:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429858688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361710.221107:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429859840 00000100:00100000:0.0:1788361710.221110:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429859840 00010000:00010000:0.0:1788361710.221120:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 24 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.221130:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1788361710.221139:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429859968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361710.221148:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361710.221153:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 24 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.221163:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 24 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.221173:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137c20400/0x1b69fa8920fe3d0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d06 expref: 24 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.221191:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361710.221219:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3651:x1875230429859968:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.221252:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1788361710.221261:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:1.0:1788361710.221273:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1788361710.221273:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3652:x1875230429860096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361710.221285:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361710.221286:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3651:x1875230429859840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361710.221293:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 22 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.221298:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361710.221305:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 22 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.221306:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 22 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.221340:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308200/0x1b69fa8920fe3cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3cf8 expref: 22 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.221349:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361710.221378:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3652:x1875230429860096:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.221384:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00010000:00010000:1.0:1788361710.221403:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 20 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.221411:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429860096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361710.221418:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308c00/0x1b69fa8920fe3d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d14 expref: 20 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.221427:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361710.221445:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429859968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.221461:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3651:x1875230429859840:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.221466:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429859840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.221471:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00010000:00010000:2.0:1788361710.221556:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309800/0x1b69fa8920fe3d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d5a expref: 18 pid: 92299 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.221623:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361710.221649:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:3653:x1875230429858560:12345-0@lo:103:ldlm_bl.0 Request processed in 1611us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.221656:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1788361710.221690:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429858560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361710.221714:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361710.222024:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 16 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.222037:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309a00/0x1b69fa8920fe3d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3d30 expref: 16 pid: 92296 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.222046:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361710.222092:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3653:x1875230429859200:12345-0@lo:103:ldlm_bl.0 Request processed in 1716us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.222100:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788361710.222117:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429859200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361710.222266:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429857664:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361710.222443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361710.222643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361710.222647:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030528 00000100:00100000:0.0:1788361710.222653:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030528 00000100:00100000:1.0:1788361710.222663:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93030:1875230429857792:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788361710.222676:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 10 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.222726:0:93030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.222888:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030656 00000100:00100000:2.0:1788361710.222902:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030656 00000100:00100000:0.0:1788361710.222905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2615 00000100:00100000:0.0:1788361710.222918:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+11:2409:x1875230407030528:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361710.222924:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 11 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.222930:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361710.222939:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 11 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.222952:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 11 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.222958:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2616 00000100:00100000:2.0:1788361710.222971:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1349ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3956ab41-635b-456b-967f-6c1073c5d2df+11:2409:x1875230407030656:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361710.222983:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361710.222988:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71100d expref: 11 pid: 92301 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.222991:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 11 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223009:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 10 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.223079:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361710.223086:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711006 expref: 10 pid: 92297 timeout: 2850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223100:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223109:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223124:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223136:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223143:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223161:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223168:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361710.223172:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.223181:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+9:2409:x1875230407030528:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 263us (735us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361710.223183:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361710.223195:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2615 00010000:00010000:2.0:1788361710.223212:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.223222:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361710.223246:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1349ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3956ab41-635b-456b-967f-6c1073c5d2df+8:2409:x1875230407030656:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 279us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.223254:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2616 00010000:00010000:1.0:1788361710.223266:0:93030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.223285:0:93030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.223292:0:93030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb600/0x1b69fa8920fe3d8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.422064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429860352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361710.422067:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429860224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361710.422143:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.422192:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.422248:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860224 00000100:00100000:1.0:1788361710.422253:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860352 00000100:00100000:3.0:1788361710.422259:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860224 00000100:00100000:1.0:1788361710.422259:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860352 00000100:00080000:0.0:1788361710.422316:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361710.422322:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361710.422335:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1788361710.422343:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1788361710.422357:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429860224:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361710.422406:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429860352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788361710.422420:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788361710.422432:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788361710.422464:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429860224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.422470:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1788361710.422491:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1076a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875230429860352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.422499:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:2.0:1788361710.422501:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429860224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361710.422534:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429860352:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788361710.678018:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361710.933907:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361710.933915:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0057c2000 from 55 10000000:01000000:1.0:1788361710.933921:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361710.933960:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.933970:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.933978:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.934005:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429860480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.934103:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.934167:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.934179:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860480 00000100:00100000:0.0:1788361710.934188:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860480 00000100:00100000:0.0:1788361710.934237:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788361710.934245:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429860480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361710.934256:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361710.934268:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3d92 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.934286:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d92 expref: 16 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.934293:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3d92 expref: 16 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.934305:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917e00, rc 0) 00000100:00100000:0.0:1788361710.934346:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429860480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.934351:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788361710.934429:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429860480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.934440:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.934446:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.934489:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429860608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.934507:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.934520:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.934745:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860608 00000100:00100000:3.0:1788361710.934750:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860608 00000100:00100000:3.0:1788361710.934783:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788361710.934791:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429860608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.934932:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429860608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.934940:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361710.934967:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429860608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.935003:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429860736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.935045:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.935068:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.935147:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860736 00000100:00100000:0.0:1788361710.935152:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860736 00000100:00100000:0.0:1788361710.935181:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788361710.935187:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429860736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361710.935268:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429860736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.935275:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788361710.935353:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429860736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.935744:0:93031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93031:1875230429860864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.935780:0:93031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.935796:0:93031:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043ffb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.935819:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860864 00000100:00100000:3.0:1788361710.935842:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860864 00000100:00100000:3.0:1788361710.935872:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788361710.935878:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:93031:x1875230429860864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.935970:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:93031:x1875230429860864:12345-0@lo:502:llog_process_th.0 Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.935977:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788361710.936019:0:93031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93031:1875230429860864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.936049:0:93031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93031:1875230429860992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.936077:0:93031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.936106:0:93031:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043ffb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.936137:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429860992 00000100:00100000:0.0:1788361710.936142:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429860992 00000100:00100000:0.0:1788361710.936175:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788361710.936181:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:93031:x1875230429860992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361710.936240:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:93031:x1875230429860992:12345-0@lo:502:llog_process_th.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.936247:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788361710.936272:0:93031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93031:1875230429860992:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361710.936314:0:93031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1788361710.936391:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1788361710.936413:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361710.936422:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.936430:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.936437:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788361710.936440:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:3.0:1788361710.936442:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361710.936468:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.936476:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.936484:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.936497:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.936522:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.936539:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.936562:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861120 00000100:00100000:1.0:1788361710.936567:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861120 00000100:00100000:1.0:1788361710.936592:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788361710.936599:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429861120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.936608:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361710.936619:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3da0 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.936637:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3da0 expref: 17 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.936646:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3da0 expref: 17 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.936654:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eac00, rc 0) 00000100:00100000:1.0:1788361710.936684:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429861120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.936702:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788361710.936721:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361710.936733:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.936748:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.936803:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.936853:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.936874:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.936889:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861248 00000100:00100000:0.0:1788361710.936893:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861248 00000100:00100000:0.0:1788361710.936914:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788361710.936920:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1184b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429861248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361710.937006:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1184b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429861248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.937013:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788361710.937019:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.937043:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.937072:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.937086:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.937104:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861376 00000100:00100000:1.0:1788361710.937109:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861376 00000100:00100000:1.0:1788361710.937135:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788361710.937142:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429861376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.937210:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429861376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.937218:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788361710.937227:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.937507:0:93032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93032:1875230429861504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.937536:0:93032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.937548:0:93032:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.937557:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861504 00000100:00100000:3.0:1788361710.937561:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861504 00000100:00100000:3.0:1788361710.937583:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788361710.937589:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:93032:x1875230429861504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.937659:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:93032:x1875230429861504:12345-0@lo:502:llog_process_th.0 Request processed in 70us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.937667:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788361710.937676:0:93032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93032:1875230429861504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361710.937712:0:93032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361710.937721:0:93032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361710.937724:0:93032:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788361710.937730:0:93032:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1788361710.937747:0:93032:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000020:01000004:1.0:1788361710.938085:0:93033:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d0057c2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361710.938089:0:93033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d0057c2000 4 00000100:00100000:2.0:1788361710.938099:0:93032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93032:1875230429861632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.938135:0:93032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.938158:0:93032:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f70b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.938177:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861632 00000100:00100000:3.0:1788361710.938182:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861632 00000100:00100000:3.0:1788361710.938212:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788361710.938221:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:93032:x1875230429861632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.938289:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:93032:x1875230429861632:12345-0@lo:502:llog_process_th.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.938305:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788361710.938320:0:93032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93032:1875230429861632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361710.938341:0:93032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361710.938346:0:93032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361710.938352:0:93032:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788361710.938357:0:93032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1788361710.938752:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1788361710.938774:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788361710.938795:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.938805:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.938814:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361710.938817:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 55 10000000:01000000:3.0:1788361710.938820:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361710.938865:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.938873:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.938894:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.938908:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.938941:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.938958:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.939014:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861760 00000100:00100000:0.0:1788361710.939018:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861760 00000100:00100000:0.0:1788361710.939054:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788361710.939064:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429861760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361710.939072:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361710.939082:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916800/0x1b69fa8920fe3db5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3dae expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.939098:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916800/0x1b69fa8920fe3db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dae expref: 18 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.939107:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916800/0x1b69fa8920fe3db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dae expref: 18 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.939113:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916800, rc 0) 00000100:00100000:0.0:1788361710.939147:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429861760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.939153:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788361710.939181:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.939194:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.939204:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.939247:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.939286:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.939313:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.939334:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429861888 00000100:00100000:3.0:1788361710.939339:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429861888 00000100:00100000:3.0:1788361710.939362:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788361710.939369:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429861888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.939449:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429861888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.939464:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788361710.939471:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429861888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.939501:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.939535:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.939553:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.939596:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862016 00000100:00100000:0.0:1788361710.939601:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862016 00000100:00100000:0.0:1788361710.939627:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788361710.939632:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429862016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361710.939708:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429862016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.939717:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788361710.939736:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.939964:0:93034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93034:1875230429862144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.940000:0:93034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.940022:0:93034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361710.940035:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862144 00000100:00100000:2.0:1788361710.940041:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862144 00000100:00100000:2.0:1788361710.940071:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788361710.940080:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:93034:x1875230429862144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.940159:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:93034:x1875230429862144:12345-0@lo:502:llog_process_th.0 Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.940166:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788361710.940168:0:93034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93034:1875230429862144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.940213:0:93034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93034:1875230429862272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.940245:0:93034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.940263:0:93034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.940293:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862272 00000100:00100000:0.0:1788361710.940298:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862272 00000100:00100000:0.0:1788361710.940323:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788361710.940331:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:93034:x1875230429862272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361710.940420:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:93034:x1875230429862272:12345-0@lo:502:llog_process_th.0 Request processed in 89us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.940427:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788361710.940431:0:93034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93034:1875230429862272:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361710.940455:0:93034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1788361710.940525:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1788361710.940549:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361710.940555:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.940563:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361710.940571:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788361710.940573:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:2.0:1788361710.940576:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361710.940592:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.940599:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.940607:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.940619:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.940653:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.940673:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f70bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.940705:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862400 00000100:00100000:3.0:1788361710.940710:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862400 00000100:00100000:3.0:1788361710.940744:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788361710.940751:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429862400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361710.940759:0:92299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361710.940769:0:92299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308800/0x1b69fa8920fe3dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3dbc expref: -99 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.940786:0:92299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308800/0x1b69fa8920fe3dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dbc expref: 19 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.940796:0:92299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308800/0x1b69fa8920fe3dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dbc expref: 19 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.940803:0:92299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308800, rc 0) 00000100:00100000:3.0:1788361710.940851:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429862400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.940857:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788361710.940862:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361710.940873:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.940881:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.940922:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.940942:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.940964:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862528 00000100:00100000:2.0:1788361710.940968:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f70bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.940970:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862528 00000100:00100000:1.0:1788361710.941005:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788361710.941012:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429862528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.941109:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429862528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.941115:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788361710.941262:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.941286:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.941317:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.941357:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f70bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.941378:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862656 00000100:00100000:1.0:1788361710.941380:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862656 00000100:00100000:1.0:1788361710.941397:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788361710.941401:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429862656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.941452:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429862656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.941459:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788361710.941488:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429862656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.942265:0:93035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93035:1875230429862784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.942306:0:93035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361710.942349:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862784 00000100:00100000:0.0:1788361710.942353:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862784 00000100:00100000:2.0:1788361710.942355:0:93035:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f70bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.942379:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788361710.942384:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:93035:x1875230429862784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361710.942456:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:93035:x1875230429862784:12345-0@lo:502:llog_process_th.0 Request processed in 70us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.942463:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788361710.942484:0:93035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93035:1875230429862784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361710.942502:0:93035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361710.942511:0:93035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361710.942513:0:93035:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788361710.942520:0:93035:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1788361710.942536:0:93035:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1788361710.942550:0:93035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93035:1875230429862912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.942579:0:93035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.942598:0:93035:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.942626:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429862912 00000100:00100000:3.0:1788361710.942630:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429862912 00000100:00100000:3.0:1788361710.942651:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788361710.942655:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1398f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:93035:x1875230429862912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.942726:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1398f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:93035:x1875230429862912:12345-0@lo:502:llog_process_th.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.942731:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788361710.942747:0:93035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93035:1875230429862912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361710.942765:0:93035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361710.942768:0:93035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361710.942769:0:93035:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788361710.942772:0:93035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:1.0:1788361710.942858:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:1.0:1788361710.942884:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788361710.942892:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.942910:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361710.942919:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361710.942921:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 55 10000000:01000000:1.0:1788361710.942924:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361710.942943:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.942951:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.942960:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.942973:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.943011:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.943037:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.943066:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863040 00000100:00100000:3.0:1788361710.943077:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863040 00000100:00100000:3.0:1788361710.943108:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788361710.943117:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429863040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361710.943126:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361710.943137:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3dd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3dca expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.943159:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dca expref: 20 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.943169:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dca expref: 20 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.943190:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309000, rc 0) 00000100:00100000:3.0:1788361710.943234:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429863040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.943240:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788361710.943380:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.943391:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.943399:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.943438:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.943460:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.943486:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361710.943498:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863168 00000100:00100000:2.0:1788361710.943503:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863168 00000100:00100000:2.0:1788361710.943534:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788361710.943541:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429863168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.943623:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429863168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.943627:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788361710.944249:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.944280:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.944315:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.944344:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.944391:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863296 00000100:00100000:0.0:1788361710.944396:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863296 00000100:00100000:0.0:1788361710.944424:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788361710.944431:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429863296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361710.944511:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429863296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.944518:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788361710.944534:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.944755:0:93036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93036:1875230429863424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.944784:0:93036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.944803:0:93036:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.944847:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863424 00000100:00100000:3.0:1788361710.944852:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863424 00000100:00100000:3.0:1788361710.944881:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788361710.944888:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:93036:x1875230429863424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.944967:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:93036:x1875230429863424:12345-0@lo:502:llog_process_th.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.944974:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788361710.944994:0:93036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93036:1875230429863424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.945030:0:93036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93036:1875230429863552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361710.945082:0:93036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.945108:0:93036:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.945142:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863552 00000100:00100000:3.0:1788361710.945147:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863552 00000100:00100000:3.0:1788361710.945218:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788361710.945226:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:93036:x1875230429863552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.945311:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:93036:x1875230429863552:12345-0@lo:502:llog_process_th.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.945318:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788361710.945377:0:93036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93036:1875230429863552:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361710.945391:0:93036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1788361710.945495:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1788361710.945519:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361710.945527:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.945535:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361710.945541:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788361710.945542:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788361710.945544:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361710.945567:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.945581:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.945590:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.945603:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.945628:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.945645:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.945663:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863680 00000100:00100000:1.0:1788361710.945668:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863680 00000100:00100000:1.0:1788361710.945709:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788361710.945717:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429863680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.945726:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361710.945738:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea400/0x1b69fa8920fe3ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3dd8 expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.945758:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea400/0x1b69fa8920fe3ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dd8 expref: 21 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.945780:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea400/0x1b69fa8920fe3ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3dd8 expref: 21 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.945788:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea400, rc 0) 00000100:00100000:1.0:1788361710.945845:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429863680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.945856:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788361710.945870:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361710.945886:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361710.945895:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.945939:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.945959:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.946019:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.946047:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863808 00000100:00100000:0.0:1788361710.946052:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863808 00000100:00100000:0.0:1788361710.946083:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788361710.946090:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429863808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361710.946186:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429863808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.946192:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788361710.946215:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.946240:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.946290:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.946310:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.946327:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429863936 00000100:00100000:3.0:1788361710.946332:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429863936 00000100:00100000:3.0:1788361710.946361:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788361710.946367:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429863936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.946436:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429863936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.946443:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788361710.946446:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429863936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361710.947112:0:93037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788361710.947183:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788361710.947206:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788361710.947213:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.947221:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361710.947229:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361710.947231:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 55 10000000:01000000:1.0:1788361710.947233:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361710.947253:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.947261:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.947270:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.947283:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.947312:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.947340:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.947358:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864064 00000100:00100000:0.0:1788361710.947362:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864064 00000100:00100000:0.0:1788361710.947397:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788361710.947405:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429864064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361710.947414:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361710.947425:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916c00/0x1b69fa8920fe3ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3de6 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.947441:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916c00/0x1b69fa8920fe3ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3de6 expref: 22 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.947450:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916c00/0x1b69fa8920fe3ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3de6 expref: 22 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361710.947457:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916c00, rc 0) 00000100:00100000:0.0:1788361710.947494:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429864064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.947500:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788361710.947524:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.947538:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.947545:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361710.947583:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.947608:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.947633:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361710.947673:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864192 00000100:00100000:2.0:1788361710.947677:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864192 00000100:00100000:2.0:1788361710.947755:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788361710.947761:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429864192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.947849:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429864192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.947856:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788361710.947866:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.947888:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.947923:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.947934:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864320 00000100:00100000:3.0:1788361710.947938:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864320 00000100:00100000:1.0:1788361710.947940:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.947967:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788361710.947975:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429864320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.948036:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429864320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.948042:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788361710.948043:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.948254:0:93038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93038:1875230429864448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.948285:0:93038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.948306:0:93038:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.948347:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864448 00000100:00100000:3.0:1788361710.948351:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864448 00000100:00100000:3.0:1788361710.948378:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788361710.948385:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0039fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:93038:x1875230429864448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.948487:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0039fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:93038:x1875230429864448:12345-0@lo:502:llog_process_th.0 Request processed in 103us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.948494:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788361710.948548:0:93038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93038:1875230429864448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.948580:0:93038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93038:1875230429864576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361710.948608:0:93038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361710.948629:0:93038:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10ade9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.948649:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864576 00000100:00100000:3.0:1788361710.948654:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864576 00000100:00100000:3.0:1788361710.948705:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788361710.948714:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:93038:x1875230429864576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361710.948779:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:93038:x1875230429864576:12345-0@lo:502:llog_process_th.0 Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.948787:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788361710.948789:0:93038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:93038:1875230429864576:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788361710.948815:0:93038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1788361710.948948:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1788361710.948971:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361710.948979:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.948989:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.948997:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788361710.948999:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788361710.949001:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361710.949021:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.949029:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.949037:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.949050:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.949077:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.949098:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864704 00000100:00100000:3.0:1788361710.949103:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.949103:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864704 00000100:00100000:1.0:1788361710.949134:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788361710.949141:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429864704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.949147:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361710.949155:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe3dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3df4 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.949168:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe3dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3df4 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.949179:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe3dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3df4 expref: 23 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.949184:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb400, rc 0) 00000100:00100000:1.0:1788361710.949221:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429864704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.949252:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361710.949283:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.949292:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.949347:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.949381:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.949405:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361710.949447:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864832 00000100:00100000:2.0:1788361710.949451:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864832 00000100:00100000:1.0:1788361710.949485:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788361710.949599:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788361710.949607:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429864832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361710.949710:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429864832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.949717:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788361710.949728:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.949753:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361710.949779:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.949811:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361710.949848:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429864960 00000100:00100000:3.0:1788361710.949853:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429864960 00000100:00100000:3.0:1788361710.949880:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788361710.949888:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429864960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.949973:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429864960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.949980:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788361710.950049:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136596300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429864960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361710.951040:0:93039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788361710.951216:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788361710.951237:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788361710.951245:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.951260:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361710.951268:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788361710.951269:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:3.0:1788361710.951271:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788361710.951305:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.951319:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.951328:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.951346:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429865088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.951385:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.951422:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361710.951521:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865088 00000100:00100000:1.0:1788361710.951526:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865088 00000100:00100000:1.0:1788361710.951563:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788361710.951571:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429865088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361710.951581:0:92297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361710.951593:0:92297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe3e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3e02 expref: -99 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.951610:0:92297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe3e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e02 expref: 24 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.951620:0:92297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe3e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e02 expref: 24 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361710.951626:0:92297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb200, rc 0) 00000100:00100000:1.0:1788361710.951778:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429865088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.951784:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788361710.951870:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429865088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361710.951881:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.951890:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361710.951935:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429865216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361710.951958:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.951980:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d110bdcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361710.952002:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865216 00000100:00100000:0.0:1788361710.952007:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865216 00000100:00100000:0.0:1788361710.952039:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788361710.952062:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1042f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429865216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361710.952126:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1042f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429865216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361710.952130:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788361710.952157:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429865216:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788361710.952180:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788361710.952185:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361710.952192:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361710.984024:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361710.984077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361710.984115:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030784 00000100:00100000:1.0:1788361710.984128:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030784 00000100:00100000:1.0:1788361710.984206:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 159 00000100:00100000:2.0:1788361710.984207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361710.984226:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d112d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:2412:x1875230407030784:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361710.984305:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d112d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:2412:x1875230407030784:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.984313:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 159 00000100:00100000:1.0:1788361710.984520:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407030912 00000100:00100000:0.0:1788361710.984520:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031040 00000100:00100000:1.0:1788361710.984527:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407030912 00000100:00100000:0.0:1788361710.984528:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031040 00000100:00100000:3.0:1788361710.984561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361710.984608:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 919 00000100:00100000:1.0:1788361710.984615:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2412:x1875230407030912:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361710.984645:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031168 00000100:00100000:2.0:1788361710.984651:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031168 00000100:00080000:3.0:1788361710.984667:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361710.984680:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2412:x1875230407030912:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 63us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.984700:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 919 00000100:00100000:2.0:1788361710.984705:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1907 00000100:00100000:2.0:1788361710.984717:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407031168:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361710.984724:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 920 00000100:00100000:1.0:1788361710.984736:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407031040:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:3.0:1788361710.984739:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361710.984766:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407031168:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361710.984776:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1907 00000100:00100000:1.0:1788361710.984782:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407031040:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.984794:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 920 00000100:00100000:2.0:1788361711.303201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.303777:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031296 00000100:00100000:1.0:1788361711.303790:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031296 00000100:00100000:1.0:1788361711.303861:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 160 00000100:00100000:1.0:1788361711.303872:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407031296:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361711.303899:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361711.303924:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe3e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae711014 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.303957:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe3e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711014 expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.303969:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe3e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711014 expref: 9 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.303980:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb000, rc 0) 00000100:00100000:1.0:1788361711.304038:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407031296:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 169us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.304046:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 160 00000100:00100000:1.0:1788361711.306898:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.306951:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031424 00000100:00100000:1.0:1788361711.306961:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031424 00000100:00100000:1.0:1788361711.307021:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 161 00000100:00100000:1.0:1788361711.307033:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407031424:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361711.307189:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407031424:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 157us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.307199:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 161 00000100:00100000:1.0:1788361711.308495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.308556:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031552 00000100:00100000:3.0:1788361711.308564:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031552 00000100:00100000:3.0:1788361711.308615:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 162 00000100:00100000:3.0:1788361711.308626:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407031552:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361711.308749:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407031552:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.308758:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 162 00000100:00100000:2.0:1788361711.310154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.310209:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031680 00000100:00100000:1.0:1788361711.310217:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031680 00000100:00100000:1.0:1788361711.310258:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 163 00000100:00100000:1.0:1788361711.310268:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:71887:x1875230407031680:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361711.310386:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:71887:x1875230407031680:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.310393:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 163 00000100:00100000:3.0:1788361711.311438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.311615:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031808 00000100:00100000:1.0:1788361711.311622:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031808 00000100:00100000:1.0:1788361711.311665:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 164 00000100:00100000:1.0:1788361711.311673:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:71887:x1875230407031808:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361711.311787:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:71887:x1875230407031808:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.311795:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 164 00000100:00100000:3.0:1788361711.314356:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.314410:0:92296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407031936 00000100:00100000:2.0:1788361711.314421:0:92296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407031936 00000100:00100000:2.0:1788361711.314471:0:92296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 165 00000100:00100000:2.0:1788361711.314481:0:92296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407031936:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361711.314498:0:92296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.314517:0:92296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe3e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae71101b expref: -99 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.314564:0:92296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe3e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71101b expref: 10 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.314576:0:92296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe3e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71101b expref: 10 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.314585:0:92296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21400, rc 0) 00000100:00100000:2.0:1788361711.314649:0:92296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407031936:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 169us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.314663:0:92296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 165 00000100:00100000:2.0:1788361711.315779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.315842:0:92299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407032064 00000100:00100000:3.0:1788361711.315849:0:92299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407032064 00000100:00100000:3.0:1788361711.315894:0:92299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:3.0:1788361711.315962:0:92299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407032064:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361711.316056:0:92299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407032064:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 153us (281us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361711.316064:0:92299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:3.0:1788361711.662029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.662121:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407032192 00000100:00100000:2.0:1788361711.662132:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407032192 00000100:00100000:2.0:1788361711.662204:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1296 00000100:00100000:2.0:1788361711.662218:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71897:x1875230407032192:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:2.0:1788361711.662244:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.662280:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711022 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.662357:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3e25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.662372:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.662388:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361711.662458:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361711.662464:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361711.662511:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.662541:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711022 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.662558:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711022 expref: 7 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.662585:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:2.0:1788361711.662589:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361711.662593:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21200, rc 0) 00000100:00100000:2.0:1788361711.662684:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407032192:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 455us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.662695:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1296 00000100:00100000:1.0:1788361711.665375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.665535:0:66136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407032320 00000100:00100000:2.0:1788361711.665546:0:66136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407032320 00000100:00100000:2.0:1788361711.665605:0:66136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788361711.665616:0:66136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407032320:12345-192.168.204.35@tcp:700:mkdir.0 00000100:00100000:2.0:1788361711.665702:0:66136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407032320:12345-192.168.204.35@tcp:700:mkdir.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.665710:0:66136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788361711.668098:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.668228:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407032576 00000100:00100000:1.0:1788361711.668240:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407032576 00000100:00100000:1.0:1788361711.668342:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1297 00000100:00100000:1.0:1788361711.668354:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407032576:12345-192.168.204.35@tcp:36:mkdir.0 00010000:00010000:1.0:1788361711.668410:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361711.668437:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3e25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711022 expref: 7 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.668453:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:1.0:1788361711.668458:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361711.668516:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.668529:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.668552:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.668568:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.668576:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.668583:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669487:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669498:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669506:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361711.669522:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000478479ff reply state 00000000864e1215 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669532:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669539:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1be00) 00010000:00010000:1.0:1788361711.669542:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361711.669545:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361711.669551:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788361711.669568:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669576:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669582:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669589:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669595:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.669601:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669610:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669620:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:1.0:1788361711.669623:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.669626:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669632:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea000/0x1b69fa8920fe3e2c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361711.669646:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000478479ff reply state 00000000864e1215 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669654:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.669672:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99d112d1b000) 00010000:00010000:1.0:1788361711.669685:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361711.669688:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788361711.669771:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71897:x1875230407032576:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 1418us (1682us total) trans 120259084291 rc 0/0 00000100:00100000:1.0:1788361711.669780:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1297 00000100:00100000:1.0:1788361711.671449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.671506:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407032704 00000100:00100000:3.0:1788361711.671516:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407032704 00000100:00100000:3.0:1788361711.671567:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1298 00000100:00100000:3.0:1788361711.671580:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71897:x1875230407032704:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:3.0:1788361711.671600:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361711.671633:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3e41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711029 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.671708:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3e48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.671718:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.671732:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361711.671773:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361711.671777:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361711.671798:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.671859:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3e41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711029 expref: 10 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.671879:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3e48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711029 expref: 9 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.671888:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361711.671892:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361711.671896:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308200, rc 0) 00000100:00100000:3.0:1788361711.671944:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71897:x1875230407032704:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 367us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.671951:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1298 00000100:00100000:2.0:1788361711.675997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.678318:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407032960 00000100:00100000:3.0:1788361711.678341:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407032960 00000100:00100000:3.0:1788361711.678440:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1299 00000100:00100000:3.0:1788361711.678457:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71897:x1875230407032960:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:3.0:1788361711.678489:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361711.678517:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3e4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711030 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.678627:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.678646:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.678660:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.678690:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.678700:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.678707:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361711.678880:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788361711.678992:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679002:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679021:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679028:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679035:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361711.679041:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679050:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679066:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361711.679069:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361711.679074:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679081:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308400/0x1b69fa8920fe3e56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679095:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679100:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679106:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679110:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361711.679118:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679125:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679134:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99d112d1b000) 00010000:00010000:3.0:1788361711.679138:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361711.679143:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679149:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3e5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679211:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3e4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711030 expref: 11 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679223:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361711.679225:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361711.679229:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe3e4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711030 expref: 11 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.679240:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308a00, rc 0) 00000100:00100000:3.0:1788361711.679330:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71897:x1875230407032960:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 878us (3344us total) trans 120259084292 rc 301/301 00000100:00100000:3.0:1788361711.679337:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1299 00000100:00100000:2.0:1788361711.682056:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.682126:0:66138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407033088 00000100:00100000:1.0:1788361711.682136:0:66138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407033088 00000100:00100000:1.0:1788361711.682187:0:66138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:1.0:1788361711.682201:0:66138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71897:x1875230407033088:12345-192.168.204.35@tcp:900:mkdir.0 00000100:00100000:1.0:1788361711.682303:0:66138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71897:x1875230407033088:12345-192.168.204.35@tcp:900:mkdir.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.682311:0:66138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:3.0:1788361711.684171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.684262:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407033344 00000100:00100000:1.0:1788361711.684275:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407033344 00000100:00100000:1.0:1788361711.684341:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 239 00000100:00100000:1.0:1788361711.684354:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71897:x1875230407033344:12345-192.168.204.35@tcp:35:mkdir.0 00000100:00100000:1.0:1788361711.684635:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71897:x1875230407033344:12345-192.168.204.35@tcp:35:mkdir.0 Request processed in 283us (473us total) trans 120259084293 rc 0/0 00000100:00100000:1.0:1788361711.684644:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 239 00000100:00100000:2.0:1788361711.686748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.686811:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407033600 00000100:00100000:3.0:1788361711.686844:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407033600 00000100:00100000:3.0:1788361711.686905:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1300 00000100:00100000:3.0:1788361711.686926:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71897:x1875230407033600:12345-192.168.204.35@tcp:36:mkdir.0 00000100:00100000:3.0:1788361711.687446:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865344:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.687552:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.687614:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865344 00000100:00100000:3.0:1788361711.687616:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.687622:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865344 00000100:00100000:2.0:1788361711.687690:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4173 00000100:00100000:2.0:1788361711.687703:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361711.687855:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865344:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.687865:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4173 00000100:00100000:3.0:1788361711.688018:0:66128:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:3.0:1788361711.688025:0:66128:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:3.0:1788361711.688065:0:66128:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:3.0:1788361711.688070:0:66128:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d1039293c0 refcount 2 committed 0 result 0 batchid 73014444090 00000020:00080000:3.0:1788361711.688073:0:66128:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d140d1a600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d103929a80 00000020:00080000:3.0:1788361711.688076:0:66128:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].2 00000020:00080000:3.0:1788361711.688079:0:66128:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d140d1ad00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d101343e00 00000020:00080000:3.0:1788361711.688082:0:66128:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].2 00000100:00100000:3.0:1788361711.688128:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865344:0@lo:1000:mdt00_002.0 00000020:00080000:2.0:1788361711.688145:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444090 committed batchid 73014444089 00000100:00100000:3.0:1788361711.688238:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865472:0@lo:1000:mdt00_002.0 00000020:00080000:2.0:1788361711.688253:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000100:00100000:3.0:1788361711.688275:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.688343:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865472 00000100:00100000:2.0:1788361711.688350:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865472 00000100:00100000:3.0:1788361711.688394:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.688401:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4174 00000100:00100000:2.0:1788361711.688418:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361711.688525:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865472:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.688534:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4174 00000100:00100000:3.0:1788361711.688569:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865472:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.688627:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865600:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.688665:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.688709:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.688777:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865600 00000100:00100000:2.0:1788361711.688785:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865600 00000100:00100000:2.0:1788361711.688860:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4175 00000100:00100000:2.0:1788361711.688871:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361711.688978:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865600:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (308us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361711.688987:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4175 00000100:00100000:3.0:1788361711.689007:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865600:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788361711.689104:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.689116:0:66128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.689142:0:66128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.689156:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865728:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1788361711.689196:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.689224:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.689586:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865728 00000100:00100000:2.0:1788361711.689594:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865728 00000100:00100000:2.0:1788361711.689636:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176 00000100:00100000:2.0:1788361711.689645:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66128:x1875230429865728:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788361711.689659:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.689696:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3e6b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.689733:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.689745:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.689784:0:8449:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1788361711.689862:0:8449:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1788361711.689974:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.689987:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1be00) 00010000:00010000:2.0:1788361711.689997:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361711.690005:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.690025:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21e00, rc 0) 00000100:00100000:2.0:1788361711.690086:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66128:x1875230429865728:12345-0@lo:101:mdt00_002.0 Request processed in 439us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.690096:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176 00000100:00100000:3.0:1788361711.690135:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865728:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788361711.690168:0:66128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.690177:0:66128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361711.691803:0:92292:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084293 is committed 00010000:00010000:1.0:1788361711.691987:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.691999:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692024:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692031:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.692036:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692044:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692060:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99d112d1b000) 00010000:00010000:1.0:1788361711.692063:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.692068:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692080:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3e33 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692110:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692116:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692122:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692128:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.692131:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692152:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692160:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1be00) 00010000:00010000:1.0:1788361711.692162:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.692167:0:3637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692177:0:3637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692185:0:3637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692230:0:3637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361711.692240:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3637:1875230429865856:0@lo:105: 00000100:00100000:1.0:1788361711.692301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.692356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865856 00000100:00100000:1.0:1788361711.692358:0:3637:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.692366:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865856 00000100:00100000:2.0:1788361711.692433:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788361711.692447:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3637:x1875230429865856:12345-0@lo:105: 00010000:00010000:2.0:1788361711.692459:0:6506:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.692470:0:6506:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.692491:0:6506:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.692500:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.692507:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.692516:0:6506:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.692543:0:6506:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d004308a00) 00000100:00100000:2.0:1788361711.692590:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3637:x1875230429865856:12345-0@lo:105: Request processed in 147us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.692597:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788361711.692629:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3637:1875230429865856:0@lo:105: 00010000:00010000:1.0:1788361711.692648:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.692654:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e3a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.693228:0:66128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.693248:0:66128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361711.693280:0:66128:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788361711.693350:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.693358:0:66128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.693370:0:66128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.693414:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865984:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1788361711.693479:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361711.693511:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429865984 00000100:00100000:3.0:1788361711.693513:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.693519:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429865984 00000100:00100000:0.0:1788361711.693569:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177 00000100:00100000:0.0:1788361711.693579:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66128:x1875230429865984:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788361711.693609:0:23938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361711.693629:0:23938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3e79 expref: -99 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.693656:0:23938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e79 expref: 9 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.693670:0:23938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e79 expref: 9 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.693692:0:23938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99d10af47300) 00010000:00010000:0.0:1788361711.693695:0:23938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361711.693698:0:23938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916e00, rc 0) 00000100:00100000:0.0:1788361711.693750:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429865984:12345-0@lo:101:mdt00_002.0 Request processed in 172us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.693758:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177 00000100:00100000:3.0:1788361711.693799:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429865984:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788361711.693817:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.694165:0:66128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361711.694192:0:66128:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:3.0:1788361711.694248:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866112:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.694307:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.694333:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.694357:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429866112 00000100:00100000:0.0:1788361711.694364:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429866112 00000100:00100000:0.0:1788361711.694410:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178 00000100:00100000:0.0:1788361711.694418:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361711.694510:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866112:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.694517:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178 00000100:00100000:3.0:1788361711.694585:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d120e8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866112:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.694706:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866240:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.694739:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.694805:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.694864:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429866240 00000100:00100000:2.0:1788361711.694870:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429866240 00000100:00100000:2.0:1788361711.694931:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4179 00000100:00100000:2.0:1788361711.694941:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361711.695060:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866240:12345-0@lo:1000:mdt00_002.0 Request processed in 114us (313us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361711.695069:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4179 00000100:00100000:3.0:1788361711.695134:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866240:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.695199:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866368:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.695221:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.695243:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.695284:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429866368 00000100:00100000:0.0:1788361711.695289:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429866368 00000100:00100000:0.0:1788361711.695335:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4180 00000100:00100000:0.0:1788361711.695343:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361711.695427:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866368:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361711.695435:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4180 00000100:00100000:3.0:1788361711.695454:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866368:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.695491:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866496:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.695524:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.695539:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.695605:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429866496 00000100:00100000:0.0:1788361711.695610:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429866496 00000100:00100000:0.0:1788361711.695648:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4181 00000100:00100000:0.0:1788361711.695656:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361711.695725:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866496:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.695732:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4181 00000100:00100000:3.0:1788361711.695765:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866496:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.695804:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866624:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.695864:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.695882:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.695895:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429866624 00000100:00100000:2.0:1788361711.695901:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429866624 00000100:00100000:2.0:1788361711.695929:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4182 00000100:00100000:2.0:1788361711.695941:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361711.695994:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866624:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.695998:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4182 00000100:00100000:3.0:1788361711.696024:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866624:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.696073:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866752:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.696094:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.696114:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d105b48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.696139:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429866752 00000100:00100000:2.0:1788361711.696144:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429866752 00000100:00100000:2.0:1788361711.696170:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4183 00000100:00100000:2.0:1788361711.696177:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361711.696233:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66128:x1875230429866752:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.696241:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4183 00000100:00100000:3.0:1788361711.696258:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66128:1875230429866752:0@lo:1000:mdt00_002.0 00000040:00080000:3.0:1788361711.696716:0:66128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].3, 968 off35168 00000040:00080000:3.0:1788361711.696773:0:66128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].3, 1120 off35552 00000004:00080000:3.0:1788361711.696779:0:66128:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d105b489c0 with version 10 00000004:00080000:1.0:1788361711.696814:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 10 rpc_version 10 00000020:00100000:1.0:1788361711.696864:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788361711.696871:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d007353100 x1875230429867008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361711.696885:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429867008:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788361711.696914:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.696943:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.697013:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867008 00000100:00100000:0.0:1788361711.697019:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867008 00000100:00100000:0.0:1788361711.697048:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4184 00000100:00100000:0.0:1788361711.697057:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75530:x1875230429867008:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788361711.697373:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75530:x1875230429867008:12345-0@lo:1000:osp_up0-1.0 Request processed in 317us (457us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1788361711.697381:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4184 00000100:00100000:1.0:1788361711.697416:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429867008:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1788361711.697477:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697492:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697505:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361711.697519:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a11331d3 reply state 00000000ea3d172b transno 77309411460 ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697531:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697548:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135200) 00010000:00010000:3.0:1788361711.697551:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361711.697555:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788361711.697562:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:3.0:1788361711.697571:0:66128:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788361711.697576:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697585:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697592:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697613:0:66128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788361711.697618:0:66128:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788361711.697623:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.697629:0:66128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.697722:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407033600:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 10799us (10980us total) trans 77309411460 rc 0/0 00000100:00100000:3.0:1788361711.697729:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1300 00010000:00010000:0.0:1788361711.697774:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361711.697782:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.697792:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308a00 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:0.0:1788361711.697798:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361711.697806:0:6512:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.697883:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.697889:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361711.698014:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d107789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429867136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361711.698045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361711.698082:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.698093:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308a00/0x1b69fa8920fe3e6b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3e72 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.698113:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361711.698116:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361711.698118:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361711.698267:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867136 00000100:00100000:2.0:1788361711.698272:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867136 00000100:00100000:2.0:1788361711.698343:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1788361711.698354:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3651:x1875230429867136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361711.698365:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361711.698381:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe3e72 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3e6b expref: 10 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.698393:0:19648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1be00) 00010000:00010000:2.0:1788361711.698400:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361711.698433:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3651:x1875230429867136:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.698439:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1788361711.698442:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d107789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429867136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361711.699976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.700090:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407033856 00000100:00100000:3.0:1788361711.700097:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407033856 00000100:00100000:3.0:1788361711.700198:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1301 00000100:00100000:3.0:1788361711.700208:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407033856:12345-192.168.204.35@tcp:36:mkdir.0 00010000:00010000:3.0:1788361711.700260:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361711.700282:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3e48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711029 expref: 7 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.700296:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361711.700300:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361711.700415:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71897:x1875230407033856:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 208us (443us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788361711.700422:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1301 00000100:00100000:1.0:1788361711.701868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.701972:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407033984 00000100:00100000:2.0:1788361711.701978:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407033984 00000100:00100000:2.0:1788361711.702024:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1302 00000100:00100000:2.0:1788361711.702029:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71897:x1875230407033984:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:2.0:1788361711.702042:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.702059:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711037 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.702114:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3e95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.702126:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.702137:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361711.702177:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361711.702181:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361711.702195:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.702211:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711037 expref: 8 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.702222:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711037 expref: 7 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.702227:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:2.0:1788361711.702228:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361711.702230:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20e00, rc 0) 00000100:00100000:2.0:1788361711.702261:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407033984:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 232us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.702273:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1302 00010000:00010000:1.0:1788361711.702955:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361711.703527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.703583:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407034112 00000100:00100000:1.0:1788361711.703590:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407034112 00000100:00100000:1.0:1788361711.703630:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1303 00000100:00100000:1.0:1788361711.703638:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407034112:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:1.0:1788361711.703651:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361711.703663:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71103e expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703717:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703728:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703734:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703748:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703762:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703767:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703843:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703850:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703855:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361711.703883:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361711.703886:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361711.703905:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703918:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703926:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703933:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703941:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703957:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.703962:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703969:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703979:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:1.0:1788361711.703982:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.703986:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.703992:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704005:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704010:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704015:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704020:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebe00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.704022:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704027:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704045:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99d112d1b000) 00010000:00010000:1.0:1788361711.704047:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.704055:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704061:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3eaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704089:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 9 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704102:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 8 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.704109:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1bd00) 00010000:00010000:1.0:1788361711.704111:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361711.704113:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eba00, rc 0) 00000100:00100000:1.0:1788361711.704164:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71897:x1875230407034112:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 526us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.704171:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1303 00000100:00100000:3.0:1788361711.705579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.705626:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407034368 00000100:00100000:1.0:1788361711.705634:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407034368 00000100:00100000:1.0:1788361711.705690:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1304 00000100:00100000:1.0:1788361711.705699:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71897:x1875230407034368:12345-192.168.204.35@tcp:36:mkdir.0 00000100:00100000:1.0:1788361711.705848:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867264:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.705896:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.705928:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.705975:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867264 00000100:00100000:0.0:1788361711.705981:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867264 00000100:00100000:0.0:1788361711.706018:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4185 00000100:00100000:0.0:1788361711.706026:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429867264:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361711.706118:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429867264:12345-0@lo:1000:mdt00_004.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.706125:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4185 00000100:00100000:1.0:1788361711.706181:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867264:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.706221:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867392:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.706243:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.706260:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.706278:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867392 00000100:00100000:2.0:1788361711.706284:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867392 00000100:00100000:2.0:1788361711.706320:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4186 00000100:00100000:2.0:1788361711.706328:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429867392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361711.706418:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429867392:12345-0@lo:1000:mdt00_004.0 Request processed in 91us (173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361711.706425:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4186 00000100:00100000:1.0:1788361711.706493:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867392:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788361711.706539:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.706548:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.706559:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361711.706571:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867520:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1788361711.706593:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.706608:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361711.706622:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867520 00000100:00100000:3.0:1788361711.706627:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867520 00000100:00100000:3.0:1788361711.706662:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4187 00000100:00100000:3.0:1788361711.706671:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67579:x1875230429867520:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788361711.706694:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361711.706708:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3eb8 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.706731:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 7 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.706742:0:23939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 10 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.706777:0:23939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 7 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.706802:0:23939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 7 pid: 66127 timeout: 2851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.706843:0:23939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23939:1875230429867648:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788361711.706906:0:23939:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.708207:0:23939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23939:1875230429867648:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788361711.708235:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 10 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708246:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1bd00) 00010000:00010000:2.0:1788361711.708249:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361711.708253:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 10 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708261:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309c00, rc 0) 00000100:00100000:2.0:1788361711.708319:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429867520:12345-0@lo:101:mdt00_004.0 Request processed in 1650us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.708326:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4187 00000100:00100000:1.0:1788361711.708359:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867520:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1788361711.708377:0:67579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.708388:0:67579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.708660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.708713:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407034496 00000100:00100000:2.0:1788361711.708719:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407034496 00010000:00010000:2.0:1788361711.708746:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 8 pid: 66127 timeout: 2851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361711.708799:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2617 00000100:00100000:2.0:1788361711.708808:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2409:x1875230407034496:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361711.708839:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361711.708847:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 8 pid: 66127 timeout: 2851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708863:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 8 pid: 66127 timeout: 2851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708884:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3eb1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71103e expref: 8 pid: 66127 timeout: 2851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708893:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1bd00) 00010000:00010000:2.0:1788361711.708896:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 9 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708902:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 9 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708908:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 9 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.708935:0:8456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 9 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361711.708948:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8456:1875230429867776:0@lo:105: 00000100:00100000:2.0:1788361711.708987:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.709022:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11ef2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361711.709171:0:10345:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788361711.709183:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867776 00000100:00100000:1.0:1788361711.709186:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867776 00000100:00100000:1.0:1788361711.709232:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788361711.709238:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110602450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8456:x1875230429867776:12345-0@lo:105: 00010000:00010000:1.0:1788361711.709249:0:10345:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709258:0:10345:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709266:0:10345:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709273:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709280:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709288:0:10345:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709315:0:10345:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d1012ea000) 00000100:00100000:1.0:1788361711.709365:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110602450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8456:x1875230429867776:12345-0@lo:105: Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.709373:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00010000:2.0:1788361711.709445:0:67579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.709455:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361711.709474:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1788361711.709507:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.709514:0:67579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.709522:0:67579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361711.709537:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867904:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1788361711.709557:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8456:1875230429867776:0@lo:105: 00000100:00100000:2.0:1788361711.709568:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361711.709572:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361711.709613:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2409:x1875230407034496:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 805us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.709621:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2617 00000100:00100000:1.0:1788361711.709668:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429867904 00000100:00100000:1.0:1788361711.709683:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429867904 00000100:00100000:1.0:1788361711.709724:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4188 00000100:00100000:2.0:1788361711.709757:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361711.709791:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67579:x1875230429867904:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1788361711.709813:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361711.709896:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3ec6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709914:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3ec6 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709926:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3ec6 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.709934:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99d112d1b000) 00010000:00010000:1.0:1788361711.709937:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.709945:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea600, rc 0) 00000100:00100000:1.0:1788361711.709985:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429867904:12345-0@lo:101:mdt00_004.0 Request processed in 250us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.709992:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4188 00000100:00100000:2.0:1788361711.710024:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429867904:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788361711.710047:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.710059:0:67579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361711.710072:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:2.0:1788361711.710112:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868032:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361711.710139:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.710159:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.710178:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868032 00000100:00100000:0.0:1788361711.710194:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868032 00000100:00100000:0.0:1788361711.710226:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4189 00000100:00100000:0.0:1788361711.710233:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868032:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361711.710317:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868032:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.710325:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4189 00000100:00100000:2.0:1788361711.710341:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868032:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361711.710380:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868160:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361711.710409:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.710426:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361711.710454:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868160 00000100:00100000:3.0:1788361711.710458:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868160 00000100:00100000:3.0:1788361711.710483:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4190 00000100:00100000:3.0:1788361711.710488:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361711.710549:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868160:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (141us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361711.710554:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4190 00000100:00100000:2.0:1788361711.710580:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868160:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361711.710664:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868288:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788361711.710697:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.710722:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361711.710777:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868288 00000100:00100000:3.0:1788361711.710782:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868288 00000100:00100000:3.0:1788361711.710808:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4191 00000100:00100000:3.0:1788361711.710815:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361711.710899:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868288:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (200us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361711.710906:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4191 00000100:00100000:1.0:1788361711.710931:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.710980:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868416:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.711024:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.711048:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361711.711337:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868416 00000100:00100000:3.0:1788361711.711342:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868416 00000100:00100000:3.0:1788361711.711387:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4192 00000100:00100000:3.0:1788361711.711394:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361711.711458:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868416:12345-0@lo:1000:mdt00_004.0 Request processed in 65us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.711466:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4192 00000100:00100000:1.0:1788361711.711493:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868416:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.711541:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868544:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.711564:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.711591:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.711662:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868544 00000100:00100000:0.0:1788361711.711667:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868544 00000100:00100000:0.0:1788361711.711706:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4193 00000100:00100000:0.0:1788361711.711713:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868544:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788361711.711767:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868544:12345-0@lo:1000:mdt00_004.0 Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361711.711772:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4193 00000100:00100000:1.0:1788361711.711907:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868544:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.711954:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868672:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.711979:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.712003:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f70b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361711.712111:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868672 00000100:00100000:3.0:1788361711.712116:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868672 00000100:00100000:3.0:1788361711.712145:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4194 00000100:00100000:3.0:1788361711.712151:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361711.712205:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67579:x1875230429868672:12345-0@lo:1000:mdt00_004.0 Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.712213:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4194 00000100:00100000:1.0:1788361711.712245:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:67579:1875230429868672:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1788361711.712758:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].4, 968 off36136 00000040:00080000:1.0:1788361711.712813:0:67579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].4, 1120 off36672 00000004:00080000:1.0:1788361711.712819:0:67579:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d004ad4300 with version 11 00000004:00080000:2.0:1788361711.712879:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 11 rpc_version 11 00000020:00100000:2.0:1788361711.712904:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788361711.712913:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d12cd44e00 x1875230429868928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361711.712929:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429868928:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788361711.712963:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.712985:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.713006:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429868928 00000100:00100000:0.0:1788361711.713011:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429868928 00000100:00100000:0.0:1788361711.713055:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4195 00000100:00100000:0.0:1788361711.713063:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75530:x1875230429868928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788361711.713342:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75530:x1875230429868928:12345-0@lo:1000:osp_up0-1.0 Request processed in 280us (378us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1788361711.713350:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4195 00000100:00100000:2.0:1788361711.713456:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429868928:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788361711.713525:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713540:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713552:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361711.713565:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff7630a1 reply state 00000000705a7674 transno 77309411461 ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713574:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713578:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1b400) 00010000:00010000:1.0:1788361711.713581:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361711.713583:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361711.713587:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1788361711.713592:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1788361711.713600:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713614:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713619:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713636:0:67579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788361711.713640:0:67579:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1788361711.713643:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.713647:0:67579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.713669:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361711.713689:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.713699:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea000 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:2.0:1788361711.713704:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361711.713721:0:8455:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361711.713735:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71897:x1875230407034368:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 8034us (8157us total) trans 77309411461 rc 0/0 00000100:00100000:1.0:1788361711.713743:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1304 00010000:00010000:2.0:1788361711.713749:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.713757:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361711.713799:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.713811:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d1012ea000/0x1b69fa8920fe3eb8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3ebf expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.713856:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361711.713858:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361711.713859:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361711.713888:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361711.713901:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429869056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361711.713933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.713984:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869056 00000100:00100000:1.0:1788361711.713989:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869056 00000100:00100000:1.0:1788361711.714022:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1788361711.714029:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3653:x1875230429869056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361711.714040:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361711.714055:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe3ebf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3eb8 expref: 12 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.714067:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d112d1bd00) 00010000:00010000:1.0:1788361711.714082:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361711.714119:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3653:x1875230429869056:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.714127:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1788361711.714156:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429869056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361711.725653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.725862:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407034624 00000100:00100000:2.0:1788361711.725875:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407034624 00000100:00100000:2.0:1788361711.726015:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1305 00000100:00100000:2.0:1788361711.726030:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71898:x1875230407034624:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361711.726056:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.726079:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe3edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711045 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726159:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726178:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726211:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726234:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726241:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726249:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726363:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21000/0x1b69fa8920fe3ef0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726373:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21000/0x1b69fa8920fe3ef0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726380:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21000/0x1b69fa8920fe3ef0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361711.726421:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361711.726426:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361711.726464:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21000/0x1b69fa8920fe3ef0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726477:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726484:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726501:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726508:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361711.726512:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726519:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726538:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:2.0:1788361711.726542:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361711.726547:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726554:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe3ee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726569:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726575:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726581:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726586:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361711.726589:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726605:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726614:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99d009c1d500) 00010000:00010000:2.0:1788361711.726616:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361711.726619:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726625:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe3ee9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726664:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe3edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711045 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726689:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21000/0x1b69fa8920fe3ef0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711045 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.726697:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:2.0:1788361711.726700:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361711.726702:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21000, rc 0) 00000100:00100000:2.0:1788361711.726785:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71898:x1875230407034624:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 758us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.726794:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1305 00000100:00100000:3.0:1788361711.728766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.728951:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407034752 00000100:00100000:2.0:1788361711.728963:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407034752 00000100:00100000:2.0:1788361711.729098:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1306 00000100:00100000:2.0:1788361711.729109:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71898:x1875230407034752:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361711.729146:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.729168:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe3ef7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71104c expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729232:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729248:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729260:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729271:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729282:0:66128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3e79 expref: 10 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729290:0:66128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.729349:0:66128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3e79 expref: 10 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361711.729366:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429869184:0@lo:104: 00000100:00100000:2.0:1788361711.729411:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.729454:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055fd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361711.730210:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869184 00000100:00100000:0.0:1788361711.730220:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869184 00000100:00100000:0.0:1788361711.730277:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788361711.730286:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66128:x1875230429869184:12345-0@lo:104: 00010000:00010000:0.0:1788361711.730303:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.730377:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361711.730385:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66128:x1875230429869184:12345-0@lo:104: Request processed in 100us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.730393:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66128:1875230429869184:0@lo:104: 00000100:00100000:0.0:1788361711.730394:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:2.0:1788361711.730421:0:66128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.730640:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361711.730650:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.730660:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:3.0:1788361711.730667:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361711.730688:0:8454:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.730724:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.730737:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361711.730766:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.730775:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d004308600/0x1b69fa8920fe3e79 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3e80 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361711.730792:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429869312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361711.730802:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361711.730814:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361711.730816:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361711.730860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.731067:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869312 00000100:00100000:2.0:1788361711.731073:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869312 00010000:00010000:2.0:1788361711.731097:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b69fa8920fe3e79 expref: 11 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361711.731127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1788361711.731136:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3653:x1875230429869312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361711.731147:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1788361711.733060:0:92292:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084295 is committed 00010000:00010000:2.0:1788361711.733180:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3e80 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3e79 expref: 9 pid: 23938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.733211:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99d10af47300) 00010000:00010000:2.0:1788361711.733217:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.733228:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.733236:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.733271:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361711.733296:0:66128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733307:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361711.733346:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3653:x1875230429869312:12345-0@lo:103:ldlm_bl.0 Request processed in 2209us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.733357:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:3.0:1788361711.733432:0:66128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66128:1875230429869440:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361711.733476:0:66128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361711.733509:0:66128:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1055da9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361711.733537:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869440 00000100:00100000:1.0:1788361711.733544:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869440 00000100:00100000:1.0:1788361711.733594:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4196 00000100:00100000:1.0:1788361711.733606:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66128:x1875230429869440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361711.733646:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429869312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361711.733713:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66128:x1875230429869440:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.733722:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4196 00000100:00100000:3.0:1788361711.733747:0:66128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66128:1875230429869440:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788361711.733800:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3f0c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733811:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3f0c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733820:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3f0c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361711.733953:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3f0c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733966:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733973:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733979:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733986:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.733993:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361711.733998:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734006:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734016:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:3.0:1788361711.734019:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361711.734022:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734029:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe3efe lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734040:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734066:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734072:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734077:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361711.734080:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734086:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734094:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99d10af47300) 00010000:00010000:3.0:1788361711.734096:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361711.734099:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734104:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe3f05 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734142:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe3ef7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71104c expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734158:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3f0c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71104c expref: 9 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.734166:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135300) 00010000:00010000:3.0:1788361711.734169:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361711.734178:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308200, rc 0) 00000100:00100000:3.0:1788361711.734230:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71898:x1875230407034752:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 5122us (5473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.734238:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1306 00000100:00100000:0.0:1788361711.736581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.736815:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407034880 00000100:00100000:3.0:1788361711.736852:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407034880 00000100:00100000:3.0:1788361711.736920:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1307 00000100:00100000:3.0:1788361711.736932:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71898:x1875230407034880:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361711.736973:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361711.737000:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308600/0x1b69fa8920fe3f13 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711053 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.737074:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe3f1a lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.737089:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe3f1a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.737102:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe3f1a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361711.737157:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788361711.737161:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788361711.737192:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308600/0x1b69fa8920fe3f13 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711053 expref: 11 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.737204:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe3f1a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711053 expref: 10 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.737211:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135200) 00010000:00010000:3.0:1788361711.737223:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361711.737226:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309200, rc 0) 00000100:00100000:3.0:1788361711.737285:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71898:x1875230407034880:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 353us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.737292:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1307 00000100:00100000:2.0:1788361711.742006:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.742572:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407035136 00000100:00100000:3.0:1788361711.742584:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407035136 00000100:00100000:3.0:1788361711.742660:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1308 00000100:00100000:3.0:1788361711.742671:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71898:x1875230407035136:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361711.742705:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361711.742732:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3f21 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71105a expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361711.742890:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788361711.743005:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3f21 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71105a expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.743023:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d13a135d00) 00010000:00010000:3.0:1788361711.743026:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361711.743033:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3f21 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71105a expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.743053:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:3.0:1788361711.743115:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71898:x1875230407035136:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 446us (1117us total) trans 77309411462 rc 301/301 00000100:00100000:3.0:1788361711.743122:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1308 00000100:00100000:1.0:1788361711.746237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.746419:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407035392 00000100:00100000:2.0:1788361711.746433:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407035392 00000100:00100000:2.0:1788361711.746530:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1309 00000100:00100000:2.0:1788361711.746544:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71898:x1875230407035392:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:2.0:1788361711.746636:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361711.746691:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe3f1a lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711053 expref: 11 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.746720:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135200) 00010000:00010000:2.0:1788361711.746726:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361711.746758:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.746775:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.746786:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361711.747064:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068ce306b reply state 00000000a0c1c63d transno 77309411463 ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.747078:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.747084:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135200) 00010000:00010000:2.0:1788361711.747087:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788361711.747090:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788361711.747100:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:2.0:1788361711.747228:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71898:x1875230407035392:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 687us (1010us total) trans 77309411463 rc 0/0 00000100:00100000:2.0:1788361711.747237:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1309 00000100:00100000:0.0:1788361711.748717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.748784:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407035648 00000100:00100000:2.0:1788361711.748795:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407035648 00000100:00100000:2.0:1788361711.748888:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 240 00000100:00100000:2.0:1788361711.748901:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71898:x1875230407035648:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788361711.749295:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71898:x1875230407035648:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 387us (576us total) trans 77309411464 rc 0/0 00000100:00100000:2.0:1788361711.749312:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 240 00000100:00100000:3.0:1788361711.758962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361711.759155:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407035776 00000100:00100000:1.0:1788361711.759165:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407035776 00000100:00100000:1.0:1788361711.759224:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1310 00000100:00100000:1.0:1788361711.759234:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71899:x1875230407035776:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788361711.759256:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361711.759277:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe3f36 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711061 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759344:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759357:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759367:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759390:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759400:0:67579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3ec6 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759408:0:67579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.759440:0:67579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe3ec6 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361711.759455:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:67579:1875230429869568:0@lo:104: 00000100:00100000:1.0:1788361711.759512:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.759556:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361711.759638:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869568 00000100:00100000:2.0:1788361711.759652:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869568 00000100:00100000:2.0:1788361711.759732:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788361711.759751:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:67579:x1875230429869568:12345-0@lo:104: 00010000:00010000:2.0:1788361711.759775:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.759912:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788361711.759919:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:67579:x1875230429869568:12345-0@lo:104: Request processed in 177us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.759929:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788361711.759953:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:67579:1875230429869568:0@lo:104: 00010000:00010000:0.0:1788361711.759955:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361711.759963:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.759973:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21e00 already unused, calling callback (ffffffffc1835ed0) 00010000:00010000:1.0:1788361711.759977:0:67579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.759979:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361711.759988:0:6512:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.760018:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361711.760037:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788361711.760101:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429869696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361711.760138:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361711.760181:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.760189:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869696 00010000:00010000:0.0:1788361711.760190:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d137c21e00/0x1b69fa8920fe3ec6 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe3ecd expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.760196:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869696 00010000:00010000:0.0:1788361711.760215:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361711.760218:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361711.760221:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361711.760222:0:9529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b69fa8920fe3ec6 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.760256:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:3.0:1788361711.760266:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3650:x1875230429869696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361711.760276:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361711.760728:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe3ecd lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe3ec6 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.760746:0:9529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99d112d1b000) 00010000:00010000:3.0:1788361711.760751:0:9529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.760759:0:9529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.760766:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.760794:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361711.760851:0:67579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.760859:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361711.760875:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429869696:12345-0@lo:103:ldlm_bl.0 Request processed in 610us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.760884:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1788361711.760936:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429869696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361711.760972:0:67579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:67579:1875230429869824:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788361711.761026:0:67579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361711.761052:0:67579:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361711.761174:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429869824 00000100:00100000:3.0:1788361711.761180:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429869824 00000100:00100000:3.0:1788361711.761212:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4197 00000100:00100000:3.0:1788361711.761219:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67579:x1875230429869824:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788361711.761296:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67579:x1875230429869824:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361711.761303:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4197 00000100:00100000:1.0:1788361711.761336:0:67579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:67579:1875230429869824:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788361711.761374:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3f4b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761384:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3f4b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761392:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3f4b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361711.761414:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3f4b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761432:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761437:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761441:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761445:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761448:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.761451:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761456:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761468:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:1.0:1788361711.761470:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.761473:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761477:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3f3d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761483:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761487:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761490:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761493:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361711.761495:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761498:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761501:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99d112d1b000) 00010000:00010000:1.0:1788361711.761502:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361711.761504:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761507:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f44 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761539:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe3f36 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711061 expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761548:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3f4b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711061 expref: 10 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361711.761553:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d006cd7200) 00010000:00010000:1.0:1788361711.761554:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361711.761556:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eaa00, rc 0) 00000100:00100000:1.0:1788361711.761612:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71899:x1875230407035776:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 2379us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361711.761619:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1310 00000100:00100000:1.0:1788361711.763268:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.763444:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407035904 00000100:00100000:2.0:1788361711.763459:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407035904 00000100:00100000:2.0:1788361711.763522:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1311 00000100:00100000:2.0:1788361711.763535:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71899:x1875230407035904:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361711.763564:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361711.763589:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3f52 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711068 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.763661:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe3f59 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.763707:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe3f59 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.763718:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe3f59 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361711.763776:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788361711.763781:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788361711.763818:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21800/0x1b69fa8920fe3f52 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711068 expref: 15 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.763888:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe3f59 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711068 expref: 14 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.763896:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1b400) 00010000:00010000:2.0:1788361711.763899:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361711.763902:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20a00, rc 0) 00000100:00100000:2.0:1788361711.763957:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71899:x1875230407035904:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 427us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.763962:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1311 00000100:00100000:0.0:1788361711.767312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361711.767373:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407036160 00000100:00100000:3.0:1788361711.767387:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407036160 00000100:00100000:3.0:1788361711.767460:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1312 00000100:00100000:3.0:1788361711.767474:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71899:x1875230407036160:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361711.767501:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361711.767528:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3f60 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71106f expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361711.767646:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788361711.767793:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3f60 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71106f expref: 16 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.767810:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d13a135d00) 00010000:00010000:3.0:1788361711.767814:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361711.767819:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe3f60 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71106f expref: 16 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361711.767879:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:3.0:1788361711.767974:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:71899:x1875230407036160:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 503us (672us total) trans 77309411465 rc 301/301 00000100:00100000:3.0:1788361711.767993:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1312 00000100:00100000:3.0:1788361711.769901:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.769958:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407036416 00000100:00100000:2.0:1788361711.769970:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407036416 00000100:00100000:2.0:1788361711.770033:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1313 00000100:00100000:2.0:1788361711.770045:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:71899:x1875230407036416:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:2.0:1788361711.770108:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361711.770139:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe3f59 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711068 expref: 15 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.770190:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1b400) 00010000:00010000:2.0:1788361711.770196:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361711.770222:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.770238:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.770250:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361711.770450:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c06ba475 reply state 0000000060b67889 transno 77309411466 ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.770465:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361711.770482:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1b400) 00010000:00010000:2.0:1788361711.770485:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788361711.770488:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788361711.770497:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1788361711.770597:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:71899:x1875230407036416:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 554us (717us total) trans 77309411466 rc 0/0 00000100:00100000:2.0:1788361711.770606:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1313 00000100:00100000:1.0:1788361711.772233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361711.772328:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407036672 00000100:00100000:2.0:1788361711.772338:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407036672 00000100:00100000:0.0:1788361711.772440:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 241 00000100:00100000:0.0:1788361711.772455:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:71899:x1875230407036672:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788361711.772727:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:71899:x1875230407036672:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 276us (501us total) trans 77309411467 rc 0/0 00000100:00100000:0.0:1788361711.772735:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 241 00000001:00080000:3.0:1788361712.145135:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968754 is committed 00000001:00080000:2.0:1788361712.145589:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411467 is committed 00000020:00080000:2.0:1788361712.145620:0:75524:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444090 batchid updated 00010000:00010000:1.0:1788361712.145624:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145639:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145649:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145656:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.145661:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145688:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145720:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135200) 00010000:00010000:1.0:1788361712.145724:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361712.145730:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145737:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe3e87 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145759:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145766:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145772:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145786:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebe00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.145789:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788361712.145795:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00010000:00010000:1.0:1788361712.145796:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145808:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1b400) 00010000:00010000:1.0:1788361712.145811:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361712.145814:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145819:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe3ed4 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.145876:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361712.145905:0:75544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d13ff70e40 with version 12 00000020:00080000:0.0:1788361712.145919:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444090 cancel update log [0x20000cf21:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1788361712.146009:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444090 cancel update log [0x2400088d4:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1788361712.146017:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:0.0:1788361712.146026:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 12 rpc_version 12 00000020:00100000:0.0:1788361712.146058:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788361712.146068:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d10778b480 x1875230429870080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361712.146103:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429870080:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788361712.146175:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361712.146203:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70b40 going to sleep for 11 seconds 00010000:00010000:1.0:1788361712.146221:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146226:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146230:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.146232:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146236:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146244:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135200) 00010000:00010000:1.0:1788361712.146247:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361712.146250:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146261:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe3f2f lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146283:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146290:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361712.146293:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429870080 00010000:00010000:1.0:1788361712.146298:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146312:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.146316:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146322:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146333:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1b400) 00010000:00010000:1.0:1788361712.146336:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361712.146339:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.146345:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21a00/0x1b69fa8920fe3f6e lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361712.146366:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429870080 00000100:00100000:3.0:1788361712.146421:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4198 00000100:00100000:3.0:1788361712.146431:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13c37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75530:x1875230429870080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788361712.146743:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13c37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429870080:12345-0@lo:1000:osp_up0-1.0 Request processed in 313us (566us total) trans 120259084296 rc 0/0 00000100:00100000:3.0:1788361712.146751:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4198 00000100:00100000:0.0:1788361712.146913:0:75530:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084295 gen 3 00000004:00080000:0.0:1788361712.146920:0:75530:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084294 committed transno 120259084295 00000020:00080000:0.0:1788361712.146924:0:75530:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d105b48d80 refcount 2 committed 0 result 0 batchid 73014444091 00000020:00080000:0.0:1788361712.146928:0:75530:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d140d1a400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d105b489c0 00000020:00080000:0.0:1788361712.146932:0:75530:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].3 00000020:00080000:0.0:1788361712.146934:0:75530:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d140d1aa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d109032a00 00000020:00080000:0.0:1788361712.146937:0:75530:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].3 00000020:00080000:2.0:1788361712.146964:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444091 committed batchid 73014444090 00000020:00080000:2.0:1788361712.147002:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:0.0:1788361712.147050:0:75530:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084295 00000020:00080000:0.0:1788361712.147057:0:75530:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d10f70b240 refcount 2 committed 0 result 0 batchid 73014444092 00000020:00080000:0.0:1788361712.147060:0:75530:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d11786f600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d004ad4300 00000020:00080000:0.0:1788361712.147063:0:75530:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].4 00000020:00080000:0.0:1788361712.147066:0:75530:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99d11786f200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d005622000 00000020:00080000:0.0:1788361712.147069:0:75530:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].4 00000100:00100000:0.0:1788361712.147110:0:75530:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff99d10778b480 x1875230429870080/t120259084296(120259084296) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788361728 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:2.0:1788361712.147118:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444092 committed batchid 73014444090 00000100:00100000:0.0:1788361712.147129:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10778b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429870080:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1788361712.147137:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000020:00080000:2.0:1788361712.151275:0:75524:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444092 batchid updated 00000020:00080000:2.0:1788361712.151288:0:75524:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444091 batchid updated 00000020:00080000:0.0:1788361712.151337:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000004:00080000:0.0:1788361712.151401:0:75544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d120e5ee40 with version 13 00000020:00080000:0.0:1788361712.151419:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444091 cancel update log [0x20000cf21:0x1:0x0].3: rc = 0 00000004:00080000:2.0:1788361712.151440:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 13 rpc_version 13 00000020:00100000:2.0:1788361712.151481:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1788361712.151491:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444091 cancel update log [0x2400088d4:0x1:0x0].3: rc = 0 00000100:00100000:2.0:1788361712.151495:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d12cd46680 x1875230429870336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1788361712.151513:0:75544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d120e5e0c0 with version 14 00000020:00080000:0.0:1788361712.151525:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444092 cancel update log [0x20000cf21:0x1:0x0].4: rc = 0 00000100:00100000:2.0:1788361712.151526:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd46680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429870336:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1788361712.151558:0:75544:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444092 cancel update log [0x2400088d4:0x1:0x0].4: rc = 0 00000020:00080000:0.0:1788361712.151566:0:75544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000100:00100000:2.0:1788361712.151618:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361712.151651:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361712.151662:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429870336 00000100:00100000:0.0:1788361712.151684:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429870336 00000100:00100000:0.0:1788361712.151736:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4199 00000100:00100000:0.0:1788361712.151746:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75530:x1875230429870336:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788361712.151911:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75530:x1875230429870336:12345-0@lo:1000:osp_up0-1.0 Request processed in 166us (291us total) trans 120259084297 rc 0/0 00000100:00100000:0.0:1788361712.151920:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4199 00000100:00100000:2.0:1788361712.151940:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd46680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429870336:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788361712.151953:0:75530:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99d10f61fa80 version 14 rpc_version 14 00000020:00100000:2.0:1788361712.151964:0:75530:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788361712.151970:0:75530:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d12cd44e00 x1875230429870592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361712.151983:0:75530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429870592:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788361712.152005:0:75530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361712.152026:0:75530:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d002242840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361712.152063:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429870592 00000100:00100000:1.0:1788361712.152067:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429870592 00000100:00100000:1.0:1788361712.152098:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4200 00000100:00100000:1.0:1788361712.152107:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75530:x1875230429870592:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1788361712.152186:0:92292:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00000100:00100000:1.0:1788361712.152247:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75530:x1875230429870592:12345-0@lo:1000:osp_up0-1.0 Request processed in 141us (239us total) trans 120259084298 rc 0/0 00000100:00100000:1.0:1788361712.152255:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4200 00000100:00100000:2.0:1788361712.152326:0:75530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cd44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75530:1875230429870592:0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1788361712.157749:0:92292:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00000100:00100000:0.0:1788361712.183370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361712.183508:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407036800 00000100:00100000:1.0:1788361712.183522:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407036800 00000100:00100000:1.0:1788361712.183648:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1314 00000100:00100000:1.0:1788361712.183661:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71908:x1875230407036800:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361712.183718:0:66901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444868096 avail 1298628608 00000100:00100000:1.0:1788361712.183840:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71908:x1875230407036800:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 163us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.183850:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1314 00000100:00080000:0.0:1788361712.184040:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361712.186180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361712.186348:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407036928 00000100:00100000:1.0:1788361712.186358:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407036928 00000100:00100000:1.0:1788361712.186426:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1315 00000100:00080000:0.0:1788361712.186427:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361712.186438:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71908:x1875230407036928:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361712.186484:0:66127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:1.0:1788361712.186549:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71908:x1875230407036928:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 113us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.186556:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1315 00000100:00100000:1.0:1788361712.189176:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361712.189318:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037056 00000100:00100000:0.0:1788361712.189328:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037056 00000100:00100000:0.0:1788361712.189378:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4924 00000100:00100000:0.0:1788361712.189387:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2408:x1875230407037056:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:0.0:1788361712.189422:0:26171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2752 last 0 00000020:00000080:0.0:1788361712.189456:0:26171:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe3f75 00002000:00100000:0.0:1788361712.189470:0:26171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1e400d1-472b-42d1-b5e7-e80dc701272a/ffff99d007455000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361712.189490:0:26171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788361712.189581:0:26171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788361712.189615:0:26171:0:(import.c:65:import_set_state_nolock()) ffff99d007456000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361712.189697:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407037056:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 309us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361712.189705:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4924 00000100:00100000:0.0:1788361712.192063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361712.192142:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037184 00000100:00100000:1.0:1788361712.192151:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037184 00000100:00100000:1.0:1788361712.192216:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1552 00000100:00100000:1.0:1788361712.192227:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71908:x1875230407037184:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361712.192250:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361712.192314:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71908:x1875230407037184:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.192321:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1552 00000100:00080000:0.0:1788361712.192578:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361712.194297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361712.194386:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037312 00000100:00100000:0.0:1788361712.194396:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037312 00000100:00100000:0.0:1788361712.194460:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1553 00000100:00100000:0.0:1788361712.194497:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71908:x1875230407037312:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:0.0:1788361712.194525:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1788361712.194622:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361712.194731:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71908:x1875230407037312:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 263us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361712.194740:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1553 00000100:00100000:2.0:1788361712.225176:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361712.226155:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037568 00000100:00100000:0.0:1788361712.226164:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037568 00000100:00100000:0.0:1788361712.226214:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1316 00000100:00100000:0.0:1788361712.226226:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71915:x1875230407037568:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00010000:0.0:1788361712.226292:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361712.226321:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe3e95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711037 expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226338:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:0.0:1788361712.226344:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361712.226412:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226427:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226437:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226464:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226472:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226479:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.226999:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227006:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227010:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227014:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227017:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361712.227020:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227025:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227032:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:0.0:1788361712.227034:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361712.227036:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227046:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe3f7c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361712.227055:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f7d1335 reply state 000000002354c3dc transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227064:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361712.227068:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d105584300) 00010000:00010000:0.0:1788361712.227070:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361712.227072:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361712.227157:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71915:x1875230407037568:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 934us (2080us total) trans 120259084299 rc 0/0 00000100:00100000:0.0:1788361712.227164:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1316 00000100:00100000:2.0:1788361712.241087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361712.241158:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037696 00000100:00100000:3.0:1788361712.241176:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037696 00000100:00100000:3.0:1788361712.241281:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1317 00000100:00100000:3.0:1788361712.241306:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71918:x1875230407037696:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788361712.241344:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361712.241389:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711076 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.241484:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe3f91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.241501:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe3f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.241515:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe3f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361712.241585:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361712.241591:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361712.241625:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe3f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.241658:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711076 expref: 13 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.241706:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe3f91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711076 expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.241716:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361712.241720:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361712.241724:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:3.0:1788361712.241816:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71918:x1875230407037696:12345-192.168.204.35@tcp:101:rm.0 Request processed in 517us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361712.241896:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1317 00000100:00100000:3.0:1788361712.243530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361712.243574:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037824 00000100:00100000:1.0:1788361712.243585:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037824 00000100:00100000:1.0:1788361712.243640:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1318 00000100:00100000:1.0:1788361712.243650:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71918:x1875230407037824:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:1.0:1788361712.243683:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361712.243718:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe3f98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71107d expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243792:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243809:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243850:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243864:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243871:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243878:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243968:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243976:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.243983:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361712.244026:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:1.0:1788361712.244030:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361712.244051:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244070:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244080:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244087:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244093:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244100:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244105:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.244110:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244117:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244129:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:1.0:1788361712.244132:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361712.244137:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244143:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3f9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244158:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244169:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244175:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244180:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.244183:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244189:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244198:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d105584300) 00010000:00010000:1.0:1788361712.244200:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361712.244203:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244210:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244233:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe3f98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71107d expref: 14 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244247:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71107d expref: 13 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.244255:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99d103a4ce00) 00010000:00010000:1.0:1788361712.244258:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361712.244265:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eba00, rc 0) 00000100:00100000:1.0:1788361712.244329:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71918:x1875230407037824:12345-192.168.204.35@tcp:101:rm.0 Request processed in 679us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.244336:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1318 00000100:00100000:2.0:1788361712.247749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361712.247896:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038080 00000100:00100000:3.0:1788361712.247905:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038080 00000100:00100000:3.0:1788361712.247957:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1319 00000100:00100000:3.0:1788361712.247967:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71918:x1875230407038080:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:3.0:1788361712.248013:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788361712.248033:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe3fad lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71107d expref: 13 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248046:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99d103a4ce00) 00010000:00010000:3.0:1788361712.248064:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe3f91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711076 expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248070:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361712.248072:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361712.248092:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248107:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248115:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248122:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248127:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248131:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248192:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248196:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248200:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248418:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248425:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248430:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248442:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248446:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248450:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248464:0:66126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361712.248481:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248484:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361712.248486:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248494:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248494:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248508:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361712.248509:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361712.248511:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248514:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248518:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248522:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248526:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99d004359d00) 00010000:00010000:3.0:1788361712.248529:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361712.248532:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248538:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99d004359d00) 00010000:00010000:1.0:1788361712.248544:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788361712.248548:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe3fc2 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248548:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248562:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe3fc9 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248569:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248575:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248578:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361712.248579:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248583:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361712.248585:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361712.248587:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361712.248589:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361712.248592:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248596:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248601:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:3.0:1788361712.248602:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361712.248603:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248607:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309e00/0x1b69fa8920fe3fb4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361712.248613:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000665cecc1 reply state 000000003b0d50c2 transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248626:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361712.248630:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d105584300) 00010000:00010000:3.0:1788361712.248632:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361712.248634:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361712.248710:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71918:x1875230407038080:12345-192.168.204.35@tcp:36:rm.0 Request processed in 745us (973us total) trans 120259084300 rc 0/0 00000100:00100000:3.0:1788361712.248716:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1319 00010000:00010000:0.0:1788361712.726135:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361713.749983:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361714.006029:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429870848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361714.006114:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361714.006150:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429870720:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006161:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429871360:0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.006208:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361714.006209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361714.006234:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429871104:0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.006253:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429871232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006255:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429871872:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006272:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361714.006301:0:92297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429870720 00000100:00100000:3.0:1788361714.006309:0:92297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429870720 00000100:00100000:2.0:1788361714.006313:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361714.006316:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429871616:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006347:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429872384:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006355:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361714.006365:0:92297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788361714.006377:0:92297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429870720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006381:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429872128:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361714.006417:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788361714.006423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361714.006425:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429870976:0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.006441:0:92297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429870720:12345-0@lo:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361714.006450:0:92297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788361714.006454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361714.006477:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429871488:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006482:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871616 00000100:00100000:0.0:1788361714.006487:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871616 00000100:00100000:2.0:1788361714.006505:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361714.006506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361714.006533:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872128 00000100:00100000:3.0:1788361714.006537:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429871744:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006539:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872128 00000100:00100000:2.0:1788361714.006544:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429872000:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006575:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:3.0:1788361714.006579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361714.006584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361714.006589:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429871616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006605:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429872512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361714.006616:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429872256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006656:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361714.006669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361714.006669:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429871616:12345-0@lo:400:kworker.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361714.006679:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1788361714.006698:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871744 00000100:00100000:2.0:1788361714.006702:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429870848 00000100:00100000:0.0:1788361714.006702:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871744 00000100:00100000:2.0:1788361714.006708:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429870848 00000100:00100000:3.0:1788361714.006726:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429870720:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.006739:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872256 00000100:00100000:2.0:1788361714.006741:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871488 00000100:00100000:0.0:1788361714.006744:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872256 00000100:00100000:2.0:1788361714.006747:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871488 00000100:00100000:3.0:1788361714.006762:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871360 00000100:00100000:3.0:1788361714.006768:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871360 00000100:00100000:2.0:1788361714.006772:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872000 00000100:00100000:2.0:1788361714.006777:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872000 00000100:00100000:0.0:1788361714.006782:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1788361714.006791:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429872128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006794:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872512 00000100:00100000:2.0:1788361714.006798:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872512 00000100:00100000:3.0:1788361714.006810:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871104 00000100:00100000:3.0:1788361714.006816:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871104 00000100:00100000:2.0:1788361714.006844:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201 00000100:00100000:0.0:1788361714.006853:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429872128:12345-0@lo:400:kworker.0 Request processed in 63us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361714.006856:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429870848:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361714.006859:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871872 00000100:00100000:3.0:1788361714.006864:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871872 00000100:00100000:0.0:1788361714.006866:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:3.0:1788361714.006883:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872384 00000100:00100000:3.0:1788361714.006887:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872384 00000100:00100000:0.0:1788361714.006889:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000004:00000024:2.0:1788361714.006897:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1788361714.006900:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429871744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.006907:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1788361714.006916:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429871360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.006952:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429870848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361714.006960:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201 00000100:00100000:3.0:1788361714.006977:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429871360:12345-0@lo:400:kworker.0 Request processed in 61us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361714.006982:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4202 00000100:00100000:3.0:1788361714.006990:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1788361714.006995:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3652:x1875230429871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.007007:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429870976 00000100:00100000:3.0:1788361714.007012:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429870976 00010000:00000080:2.0:1788361714.007016:0:23939:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10eaa5500 x1875230429871488/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:20/0 lens 224/224 e 0 to 0 dl 1788361725 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361714.007028:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429871232 00000100:00100000:3.0:1788361714.007034:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1788361714.007035:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429871232 00000100:00100000:3.0:1788361714.007044:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429871104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.007056:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3652:x1875230429871488:12345-0@lo:400:kworker.0 Request processed in 63us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361714.007066:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4202 00000100:00100000:1.0:1788361714.007070:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1788361714.007082:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429871872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.007087:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4203 00000100:00100000:3.0:1788361714.007094:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429871104:12345-0@lo:400:kworker.0 Request processed in 52us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361714.007100:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429872000:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788361714.007103:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d11054b480 x1875230429871872/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:20/0 lens 224/224 e 0 to 0 dl 1788361725 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361714.007106:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1788361714.007125:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1788361714.007134:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429872384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.007149:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429872000:12345-0@lo:400:kworker.0 Request processed in 52us (568us total) trans 0 rc 0/0 00010000:00000080:3.0:1788361714.007152:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d110548380 x1875230429872384/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:20/0 lens 224/224 e 0 to 0 dl 1788361725 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361714.007162:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4203 00000100:00100000:1.0:1788361714.007162:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429871872:12345-0@lo:400:kworker.0 Request processed in 81us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361714.007179:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1788361714.007184:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4204 00000100:00100000:2.0:1788361714.007194:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3652:x1875230429872512:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361714.007202:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429872384:12345-0@lo:400:kworker.0 Request processed in 68us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361714.007206:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000004:00000024:2.0:1788361714.007212:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444868096 avail 1298628608 00000100:00100000:1.0:1788361714.007219:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429870976:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788361714.007228:0:23939:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10eaa4e00 x1875230429872512/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:20/0 lens 224/368 e 0 to 0 dl 1788361725 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361714.007229:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00010000:00000080:1.0:1788361714.007238:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10eaa4a80 x1875230429870976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:20/0 lens 224/224 e 0 to 0 dl 1788361725 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361714.007251:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1788361714.007259:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429871232:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788361714.007275:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d00223b480 x1875230429871232/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:20/0 lens 224/224 e 0 to 0 dl 1788361725 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361714.007278:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3652:x1875230429872512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361714.007286:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429870976:12345-0@lo:400:kworker.0 Request processed in 70us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361714.007297:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4204 00000100:00100000:1.0:1788361714.007304:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:3.0:1788361714.007328:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429871232:12345-0@lo:400:kworker.0 Request processed in 69us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361714.007335:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1788361714.007347:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:1.0:1788361714.007357:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429872256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.007404:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429870976:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.007416:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429871744:12345-0@lo:400:kworker.0 Request processed in 517us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361714.007426:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:0.0:1788361714.007455:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429872640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361714.008571:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429872256:12345-0@lo:400:kworker.0 Request processed in 1213us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361714.008582:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:3.0:1788361714.008590:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429871232:0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.008607:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968754 gen 2 00000100:00080000:1.0:1788361714.008610:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788361714.008613:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d1364fd500, transno 4294968754 00000100:00080000:1.0:1788361714.008617:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361714.008622:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361714.008623:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429871488:0@lo:400:kworker.0 00000100:00080000:1.0:1788361714.008625:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361714.008643:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429871744:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.008655:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429872000:0@lo:400:kworker.0 00000100:00100000:3.0:1788361714.008662:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 2 00000100:00100000:3.0:1788361714.008675:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429872256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.008679:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429872512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361714.008703:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429871360:0@lo:400:kworker.0 00000100:00100000:0.0:1788361714.008707:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361714.008713:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429872768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361714.008728:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429871872:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.008742:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429872384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361714.008757:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429870848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361714.008883:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361714.008930:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429871104:0@lo:400:kworker.0 00000100:00100000:1.0:1788361714.008949:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872640 00000100:00100000:0.0:1788361714.008949:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429871616:0@lo:400:kworker.0 00000100:00100000:1.0:1788361714.008956:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872640 00000100:00100000:0.0:1788361714.008959:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 2 00000100:00100000:0.0:1788361714.008969:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429872128:0@lo:400:kworker.0 00000100:00100000:1.0:1788361714.009088:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872768 00000100:00100000:1.0:1788361714.009093:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872768 00000100:00100000:3.0:1788361714.009111:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:3.0:1788361714.009124:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429872640:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361714.009124:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:1.0:1788361714.009137:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429872768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361714.009150:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788361714.009158:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361714.009198:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429872640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361714.009206:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:1.0:1788361714.009218:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429872768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361714.009227:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:3.0:1788361714.009246:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429872640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361714.009286:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429872768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788361714.774163:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361715.253934:0:93485:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788361715.290103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361715.290171:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038208 00000100:00100000:1.0:1788361715.290184:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038208 00000100:00080000:2.0:1788361715.290269:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361715.290286:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1320 00000100:00100000:1.0:1788361715.290302:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71984:x1875230407038208:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361715.290339:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361715.290371:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711084 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.290485:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3fd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.290511:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.290535:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361715.290627:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361715.290633:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361715.290687:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.290718:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe3fd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711084 expref: 15 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.290739:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711084 expref: 14 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.290765:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d0010ecf00) 00010000:00010000:1.0:1788361715.290769:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361715.290773:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea200, rc 0) 00010000:00000080:1.0:1788361715.290783:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10eaa7480 x1875230407038208/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:21/0 lens 576/688 e 0 to 0 dl 1788361726 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361715.290905:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71984:x1875230407038208:12345-192.168.204.35@tcp:101:touch.0 Request processed in 607us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361715.290914:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1320 00000100:00100000:2.0:1788361715.293487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361715.293641:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038336 00000100:00100000:0.0:1788361715.293658:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038336 00000100:00100000:0.0:1788361715.293759:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1321 00000100:00100000:0.0:1788361715.293774:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71984:x1875230407038336:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:0.0:1788361715.293819:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361715.293910:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3fde lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71108b expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294048:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294073:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294097:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294132:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294141:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294157:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294256:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe3ff3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294266:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe3ff3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294274:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe3ff3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361715.294329:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe3ff3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294372:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294380:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294387:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294400:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294408:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361715.294414:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294423:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294446:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:0.0:1788361715.294450:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361715.294462:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294471:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917a00/0x1b69fa8920fe3fe5 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294510:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294524:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294530:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294536:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361715.294540:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294547:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294556:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99d105584a00) 00010000:00010000:0.0:1788361715.294559:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361715.294562:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294569:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917200/0x1b69fa8920fe3fec lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294619:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe3fde lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71108b expref: 16 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294643:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe3ff3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71108b expref: 15 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.294651:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135300) 00010000:00010000:0.0:1788361715.294654:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361715.294670:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916200, rc 0) 00010000:00000080:0.0:1788361715.294681:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10eaa7b80 x1875230407038336/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:21/0 lens 576/584 e 0 to 0 dl 1788361726 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361715.294785:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:71984:x1875230407038336:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1015us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361715.294801:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1321 00000100:00100000:2.0:1788361715.299097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361715.299167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361715.299262:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038592 00000100:00100000:1.0:1788361715.299277:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038592 00000100:00100000:1.0:1788361715.299372:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 688 00000100:00100000:1.0:1788361715.299386:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2412:x1875230407038592:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361715.299409:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361715.299447:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916200/0x1b69fa8920fe3ff3 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71108b expref: 15 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361715.299466:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038464 00010000:00010000:1.0:1788361715.299473:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d13a135300) 00010000:00010000:1.0:1788361715.299479:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361715.299481:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038464 00000100:00080000:2.0:1788361715.299541:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361715.299578:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2412:x1875230407038592:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 191us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.299588:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1322 00000100:00100000:1.0:1788361715.299616:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 688 00000100:00100000:3.0:1788361715.299625:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10eaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:71984:x1875230407038464:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361715.299647:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361715.299673:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309600/0x1b69fa8920fe3ffa lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711092 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.299736:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe4001 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.299749:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe4001 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.299761:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe4001 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361715.299807:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788361715.299810:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788361715.299885:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309600/0x1b69fa8920fe3ffa lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711092 expref: 7 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.300085:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309e00/0x1b69fa8920fe4001 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711092 expref: 6 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.300096:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d004359900) 00010000:00010000:3.0:1788361715.300112:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788361715.300116:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309e00, rc 0) 00000100:00100000:3.0:1788361715.300180:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10eaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71984:x1875230407038464:12345-192.168.204.35@tcp:101:touch.0 Request processed in 577us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.300187:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1322 00000100:00100000:2.0:1788361715.304120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361715.304191:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038848 00000100:00100000:3.0:1788361715.304206:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038848 00000100:00100000:3.0:1788361715.304276:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1323 00000100:00100000:3.0:1788361715.304288:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:71984:x1875230407038848:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361715.304309:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361715.304330:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309600/0x1b69fa8920fe4008 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711099 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.304439:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.304454:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.304467:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.304487:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.304496:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.304504:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361715.304700:0:80345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80345:1875230429872896:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788361715.304783:0:80345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.304865:0:80345:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361715.305192:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429872896 00000100:00100000:0.0:1788361715.305204:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429872896 00000100:00100000:0.0:1788361715.305266:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4205 00000100:00100000:0.0:1788361715.305279:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:80345:x1875230429872896:12345-0@lo:1000:mdt00_005.0 00010000:00000080:0.0:1788361715.305337:0:23939:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d00223aa00 x1875230429872896/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:21/0 lens 328/4320 e 0 to 0 dl 1788361726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361715.305624:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:80345:x1875230429872896:12345-0@lo:1000:mdt00_005.0 Request processed in 349us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361715.305633:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4205 00000100:00100000:2.0:1788361715.305763:0:80345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80345:1875230429872896:0@lo:1000:mdt00_005.0 00000004:00080000:2.0:1788361715.306226:0:80345:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x223:0x0], index 1: 0 00010000:00010000:2.0:1788361715.306462:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe401d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306480:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe401d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306493:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe401d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306602:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306621:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 2/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306628:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306636:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361715.306642:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306651:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306667:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d004359900) 00010000:00010000:2.0:1788361715.306671:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361715.306676:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306682:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe400f lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361715.306697:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004431a3de reply state 000000009390d493 transno 77309411468 ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306707:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306713:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff99d004359800) 00010000:00010000:2.0:1788361715.306723:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361715.306727:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361715.306772:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309600/0x1b69fa8920fe4008 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711099 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306789:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe401d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711099 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361715.306796:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99d1214c3d00) 00010000:00010000:2.0:1788361715.306799:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361715.306802:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20600, rc 0) 00000100:00100000:2.0:1788361715.306897:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71984:x1875230407038848:12345-192.168.204.35@tcp:101:touch.0 Request processed in 2611us (2788us total) trans 77309411468 rc 0/0 00000100:00100000:2.0:1788361715.306906:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1323 00000100:00100000:2.0:1788361715.311015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361715.311095:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407039104 00000100:00100000:1.0:1788361715.311641:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407039104 00000100:00100000:1.0:1788361715.312118:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1324 00000100:00100000:1.0:1788361715.312132:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71984:x1875230407039104:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:1.0:1788361715.312201:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361715.312232:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe401d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711099 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.312251:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99d1214c3d00) 00010000:00010000:1.0:1788361715.312263:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361715.312318:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.312332:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.312344:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361715.312452:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007049a06b reply state 00000000ba1c19e5 transno 77309411469 ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.312465:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.312471:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99d112d1b100) 00010000:00010000:1.0:1788361715.312474:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361715.312477:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361715.312849:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71984:x1875230407039104:12345-192.168.204.35@tcp:36:touch.0 Request processed in 717us (1840us total) trans 77309411469 rc 0/0 00000100:00100000:1.0:1788361715.312859:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1324 00000100:00100000:2.0:1788361715.315159:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361715.315237:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407039232 00000100:00100000:3.0:1788361715.315246:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407039232 00000100:00100000:3.0:1788361715.315331:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1325 00000100:00100000:3.0:1788361715.315341:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71984:x1875230407039232:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361715.315364:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361715.315386:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe4032 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110a0 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.315436:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe4032 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110a0 expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.315450:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308400/0x1b69fa8920fe4032 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110a0 expref: 11 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.315467:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99d112d1b100) 00010000:00010000:3.0:1788361715.315470:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361715.315474:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308400, rc 0) 00000100:00100000:3.0:1788361715.315527:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71984:x1875230407039232:12345-192.168.204.35@tcp:101:touch.0 Request processed in 187us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.315534:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1325 00000100:00100000:2.0:1788361715.318333:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361715.318535:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407039360 00000100:00100000:3.0:1788361715.318544:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407039360 00000100:00080000:1.0:1788361715.318597:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361715.318624:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4925 00000100:00100000:3.0:1788361715.318644:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407039360:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:3.0:1788361715.318921:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407039360:12345-192.168.204.35@tcp:2:touch.0 Request processed in 279us (593us total) trans 4294968755 rc 0/0 00000100:00100000:3.0:1788361715.318930:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4925 00000100:00100000:2.0:1788361715.323716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361715.323813:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407039616 00000100:00100000:1.0:1788361715.323944:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407039616 00000100:00100000:1.0:1788361715.324009:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:1.0:1788361715.324020:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71984:x1875230407039616:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361715.324308:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71984:x1875230407039616:12345-192.168.204.35@tcp:35:touch.0 Request processed in 290us (600us total) trans 77309411470 rc 0/0 00000100:00100000:1.0:1788361715.324317:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:2.0:1788361715.335089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361715.335167:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407039744 00000100:00100000:3.0:1788361715.335177:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407039744 00000100:00100000:3.0:1788361715.335230:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1326 00000100:00100000:3.0:1788361715.335241:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:71985:x1875230407039744:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361715.335261:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361715.335282:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe4039 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110a7 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335349:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335363:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335373:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335388:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335396:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335403:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335466:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe404e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335475:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe404e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335483:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe404e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361715.335508:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe404e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335522:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335529:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335536:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335543:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335549:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361715.335554:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335562:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335574:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:3.0:1788361715.335583:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361715.335588:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335595:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4040 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335620:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335627:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335633:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335639:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361715.335642:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335648:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335657:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99d004359700) 00010000:00010000:3.0:1788361715.335660:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361715.335663:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335669:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308a00/0x1b69fa8920fe4047 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335700:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309200/0x1b69fa8920fe4039 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110a7 expref: 16 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335728:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe404e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110a7 expref: 15 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.335736:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d006cd7200) 00010000:00010000:3.0:1788361715.335738:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361715.335741:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309600, rc 0) 00010000:00000080:3.0:1788361715.335749:0:66901:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a0b100 x1875230407039744/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:21/0 lens 576/584 e 0 to 0 dl 1788361726 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361715.335815:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:71985:x1875230407039744:12345-192.168.204.35@tcp:101:touch.0 Request processed in 576us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.335844:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1326 00000100:00100000:3.0:1788361715.338329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361715.338379:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407039872 00000100:00100000:1.0:1788361715.338387:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407039872 00000100:00100000:1.0:1788361715.338435:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1327 00000100:00100000:1.0:1788361715.338444:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71985:x1875230407039872:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361715.338465:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361715.338485:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4055 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110ae expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.338537:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe405c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.338548:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe405c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.338558:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe405c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361715.338614:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788361715.338618:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788361715.338651:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4055 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ae expref: 14 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.338664:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebe00/0x1b69fa8920fe405c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ae expref: 13 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.338682:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1ba00) 00010000:00010000:1.0:1788361715.338684:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788361715.338687:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ebe00, rc 0) 00000100:00100000:1.0:1788361715.338730:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71985:x1875230407039872:12345-192.168.204.35@tcp:101:touch.0 Request processed in 287us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361715.338737:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1327 00000100:00100000:0.0:1788361715.338998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361715.339067:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407040000 00000100:00100000:0.0:1788361715.339071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407040000 00000100:00100000:0.0:1788361715.339114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 689 00000100:00100000:0.0:1788361715.339120:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1178ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2410:x1875230407040000:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361715.339130:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361715.339146:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe404e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110a7 expref: 15 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361715.339156:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d006cd7200) 00010000:00010000:0.0:1788361715.339159:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361715.339187:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1178ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2410:x1875230407040000:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361715.339194:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 689 00000100:00100000:0.0:1788361715.345622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361715.345658:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407040256 00000100:00100000:3.0:1788361715.345668:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407040256 00000100:00100000:3.0:1788361715.345743:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1328 00000100:00100000:3.0:1788361715.345754:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:71985:x1875230407040256:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361715.345775:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361715.345797:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe4063 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110b5 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.345942:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.345957:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.345981:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.345998:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346005:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346013:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361715.346333:0:66126:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x224:0x0], index 1: 0 00010000:00010000:3.0:1788361715.346488:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe4078 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346497:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe4078 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346505:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe4078 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346539:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346548:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346554:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346561:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346574:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361715.346578:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346585:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346598:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1ba00) 00010000:00010000:3.0:1788361715.346614:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361715.346619:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346626:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308a00/0x1b69fa8920fe406a lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361715.346640:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004df066a7 reply state 000000003a69e75f transno 77309411471 ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346651:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346658:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff99d004359700) 00010000:00010000:3.0:1788361715.346660:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361715.346662:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361715.346688:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe4063 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110b5 expref: 16 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346703:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe4078 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110b5 expref: 15 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.346723:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99d004359500) 00010000:00010000:3.0:1788361715.346725:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361715.346727:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:3.0:1788361715.346792:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:71985:x1875230407040256:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1040us (1189us total) trans 77309411471 rc 0/0 00000100:00100000:3.0:1788361715.346801:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1328 00000100:00100000:2.0:1788361715.352527:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361715.352570:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407040512 00000100:00100000:1.0:1788361715.352580:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407040512 00000100:00100000:1.0:1788361715.352645:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1329 00000100:00100000:1.0:1788361715.352657:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:71985:x1875230407040512:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:1.0:1788361715.352711:0:66901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361715.352783:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309400/0x1b69fa8920fe4078 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110b5 expref: 16 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.352797:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99d004359500) 00010000:00010000:1.0:1788361715.352806:0:66901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361715.352901:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.352911:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.352918:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361715.353004:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd18feff reply state 00000000ef7a7fe5 transno 77309411472 ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.353022:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361715.353026:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99d112d1b800) 00010000:00010000:1.0:1788361715.353027:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361715.353029:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361715.353104:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:71985:x1875230407040512:12345-192.168.204.35@tcp:36:touch.0 Request processed in 450us (582us total) trans 77309411472 rc 0/0 00000100:00100000:1.0:1788361715.353108:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1329 00000100:00100000:0.0:1788361715.355001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361715.355050:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407040640 00000100:00100000:3.0:1788361715.355059:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407040640 00000100:00100000:3.0:1788361715.355106:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1330 00000100:00100000:3.0:1788361715.355115:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:71985:x1875230407040640:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361715.355131:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361715.355144:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe408d lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110bc expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.355190:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe408d lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110bc expref: 18 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.355205:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309200/0x1b69fa8920fe408d lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110bc expref: 18 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361715.355223:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99d112d1b800) 00010000:00010000:3.0:1788361715.355226:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361715.355229:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309200, rc 0) 00000100:00100000:3.0:1788361715.355269:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:71985:x1875230407040640:12345-192.168.204.35@tcp:101:touch.0 Request processed in 154us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.355290:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1330 00000100:00100000:1.0:1788361715.357411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361715.357538:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407040768 00000100:00100000:2.0:1788361715.357547:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407040768 00000100:00100000:2.0:1788361715.357790:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4926 00000100:00100000:2.0:1788361715.357801:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407040768:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361715.358034:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407040768:12345-192.168.204.35@tcp:2:touch.0 Request processed in 234us (629us total) trans 4294968756 rc 0/0 00000100:00100000:2.0:1788361715.358042:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4926 00000100:00100000:2.0:1788361715.360408:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361715.360466:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041024 00000100:00100000:0.0:1788361715.360475:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041024 00000100:00100000:0.0:1788361715.360587:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:0.0:1788361715.360598:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:71985:x1875230407041024:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:0.0:1788361715.360972:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:71985:x1875230407041024:12345-192.168.204.35@tcp:35:touch.0 Request processed in 376us (568us total) trans 77309411473 rc 0/0 00000100:00100000:0.0:1788361715.360980:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:1.0:1788361715.542333:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361715.542359:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429873024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361715.542429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361715.542527:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873024 00000100:00100000:2.0:1788361715.542536:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873024 00000100:00100000:2.0:1788361715.542593:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1788361715.542612:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429873024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361715.542636:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361715.542692:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429873024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361715.542699:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1788361715.542852:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429873024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361715.543084:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429873152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361715.543119:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361715.543163:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873152 00000100:00100000:1.0:1788361715.543168:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873152 00000100:00100000:1.0:1788361715.543208:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1788361715.543215:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429873152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361715.543227:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361715.543285:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429873152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361715.543293:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1788361715.543323:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429873152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788361715.798104:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361716.103744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361716.103798:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361716.103805:0:92301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041152 00000100:00100000:0.0:1788361716.103887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361716.103900:0:92301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041152 00000100:00100000:0.0:1788361716.103941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361716.103992:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041280 00000100:00100000:0.0:1788361716.103999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361716.104010:0:92301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:3.0:1788361716.104017:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041280 00000100:00100000:1.0:1788361716.104027:0:92301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407041152:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361716.104042:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041536 00000100:00100000:0.0:1788361716.104048:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041536 00000100:00100000:2.0:1788361716.104070:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041664 00000100:00100000:2.0:1788361716.104077:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041664 00000100:00100000:1.0:1788361716.104140:0:92301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407041152:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 117us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361716.104140:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1912 00000100:00100000:0.0:1788361716.104152:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407041536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361716.104158:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1913 00000100:00100000:2.0:1788361716.104172:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407041664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361716.104178:0:92301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:3.0:1788361716.104190:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041408 00000100:00100000:3.0:1788361716.104197:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041408 00000100:00100000:0.0:1788361716.104234:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407041536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361716.104250:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407041664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 63us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.104255:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 927 00000100:00100000:0.0:1788361716.104273:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1912 00000100:00100000:3.0:1788361716.104278:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2411:x1875230407041280:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361716.104290:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1913 00000100:00080000:0.0:1788361716.104309:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00000080:3.0:1788361716.104335:0:66126:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d107788000 x1875230407041280/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:22/0 lens 224/224 e 0 to 0 dl 1788361727 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361716.104373:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 928 00000100:00100000:0.0:1788361716.104391:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:2411:x1875230407041408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361716.104443:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:2411:x1875230407041408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361716.104457:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 928 00000100:00100000:3.0:1788361716.104478:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d107788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2411:x1875230407041280:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 153us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.104491:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 927 00000020:01000004:1.0:1788361716.226065:0:93583:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788361716.226153:0:93583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226172:0:93583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226186:0:93583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226194:0:93583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226222:0:93583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361716.226229:0:93583:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788361716.226267:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361716.226273:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361716.226281:0:93583:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361716.226317:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d116c06800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788361716.226373:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361716.226382:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226391:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361716.226396:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226417:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361716.226439:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361716.226446:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361716.226450:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788361716.226453:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788361716.226491:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226499:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361716.226527:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226535:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe3d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3d99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.226550:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361716.226553:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361716.226555:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361716.226598:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429873280:0@lo:39:umount.0 00000100:00100000:1.0:1788361716.226693:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361716.226889:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361716.226920:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429873408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361716.226995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361716.227363:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873280 00000100:00100000:3.0:1788361716.227375:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873280 00000100:00100000:1.0:1788361716.227451:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873408 00000100:00100000:1.0:1788361716.227458:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873408 00000100:00100000:1.0:1788361716.227532:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1788361716.227549:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429873408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361716.227555:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:3.0:1788361716.227568:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429873280:12345-0@lo:39:umount.0 00010000:00010000:1.0:1788361716.227569:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361716.227608:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917e00/0x1b69fa8920fe3d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3d92 expref: 24 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361716.227616:0:66128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3a04 00000100:00080000:3.0:1788361716.227642:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d002ffe800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361716.227643:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:3.0:1788361716.227688:0:66128:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d00a24dc00 x1875230429873280/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:22/0 lens 224/224 e 0 to 0 dl 1788361727 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361716.227720:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3651:x1875230429873408:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361716.227732:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1788361716.227753:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429873408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361716.227804:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875230429873280:12345-0@lo:39:umount.0 Request processed in 237us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.227814:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00080000:1.0:1788361716.228004:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d116c06800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361716.228023:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429873280:0@lo:39:umount.0 00010000:00010000:2.0:1788361716.228114:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361716.228187:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361716.228191:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361716.228196:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361716.228312:0:66128:0:(genops.c:906:class_export_put()) final put ffff99d002ffc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788361716.228377:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002ffc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361716.228480:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002ffe800 for lustre-MDT0000 00010000:00010000:1.0:1788361716.229131:0:93583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229141:0:93583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229146:0:93583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229150:0:93583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229165:0:93583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361716.229170:0:93583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229174:0:93583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229187:0:93583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229193:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361716.229193:0:93583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229214:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229218:0:93583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361716.229235:0:93583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229243:0:93583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229282:0:93583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229287:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308000 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:1.0:1788361716.229292:0:93583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361716.229296:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229325:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361716.229333:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229337:0:93583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788361716.229342:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361716.229348:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788361716.229350:0:93583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229361:0:93583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229368:0:93583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.229387:0:93583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229394:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229403:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361716.229408:0:93583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788361716.229419:0:93583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788361716.229428:0:93583:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788361716.229434:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229444:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004308000/0x1b69fa8920fe3da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3da7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229463:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788361716.229467:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361716.229470:0:93583:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1788361716.229474:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d11785e200 already unused, calling callback (ffffffffc1218c20) 00000020:01000000:1.0:1788361716.229478:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 10000000:00010000:2.0:1788361716.229479:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788361716.229488:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788361716.229497:0:93583:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788361716.229508:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361716.229521:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361716.229531:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361716.229533:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788361716.229534:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788361716.229556:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229562:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361716.229577:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229597:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d11785e200/0x1b69fa8920fe3908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe390f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229620:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361716.229625:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229632:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361716.229634:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229640:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361716.229653:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.229656:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788361716.229659:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788361716.229663:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788361716.229665:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788361716.229667:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229678:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.229694:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031a00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:2.0:1788361716.229695:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361716.229705:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361716.229705:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229758:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe38d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe38de expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.229760:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229775:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788361716.229775:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.229781:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361716.229783:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361716.229793:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361716.229796:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361716.229798:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788361716.229804:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788361716.229814:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429873664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361716.229867:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.229876:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361716.229898:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.229905:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe37f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe3805 expref: -99 pid: 92291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.229922:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361716.229925:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361716.229927:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361716.229979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361716.230040:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361716.230059:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361716.230075:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429873792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361716.230082:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429873920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361716.230100:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873664 00000100:00100000:3.0:1788361716.230109:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873664 00000100:00100000:2.0:1788361716.230122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361716.230158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361716.230177:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873792 00000100:00100000:3.0:1788361716.230183:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873792 00000100:00100000:0.0:1788361716.230199:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361716.230208:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429873536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361716.230215:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873920 00000100:00100000:3.0:1788361716.230219:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873920 00000100:00100000:0.0:1788361716.230242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361716.230260:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429873536 00000100:00100000:2.0:1788361716.230269:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429873536 00000100:00100000:0.0:1788361716.230290:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1788361716.230307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429873664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361716.230322:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361716.230330:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1788361716.230340:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00010000:00010000:0.0:1788361716.230343:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100031800/0x1b69fa8920fe390f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3908 expref: 26 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361716.230346:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429873792:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361716.230359:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3650:x1875230429873536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361716.230360:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361716.230373:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361716.230373:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361716.230402:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe3da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3da0 expref: 25 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.230403:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785fc00/0x1b69fa8920fe38de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe38d7 expref: 25 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361716.230419:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429873664:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (433us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361716.230429:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361716.230438:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361716.230440:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1788361716.230476:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1788361716.230483:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429873536:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.230491:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1788361716.230491:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429873920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361716.230504:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3652:x1875230429873792:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (374us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361716.230514:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361716.230523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00010000:00010000:0.0:1788361716.230540:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100030000/0x1b69fa8920fe3805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe37f7 expref: 21 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.230563:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361716.230624:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429873920:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.230625:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429873792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361716.230650:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1788361716.230656:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429873664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361716.230699:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429873536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361716.230711:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13651fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429873920:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788361716.231526:0:93583:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1788361716.232260:0:92292:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00010000:00010000:1.0:1788361716.232287:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232299:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232308:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232315:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361716.232321:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232331:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232352:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d105584300) 00010000:00010000:1.0:1788361716.232356:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361716.232361:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232374:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe3f83 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361716.232385:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:1.0:1788361716.232391:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232393:0:93583:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d116c05000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788361716.232396:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232402:0:93583:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d141651800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788361716.232403:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232408:0:93583:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d141653800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788361716.232408:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361716.232411:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232416:0:93583:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d11e637000 f1e400d1-472b-42d1-b5e7-e80dc701272a 192.168.204.35@tcp 10 (0 0 4) 0 0 0 0: 0000000000000000 120259084300 stale:0 00010000:00010000:1.0:1788361716.232417:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232421:0:93583:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d11e636800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084298 stale:0 00010000:00010000:1.0:1788361716.232425:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d105584300) 00000020:00080000:2.0:1788361716.232426:0:93583:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99d1349b0000) has exports, disconnecting them 00010000:00010000:1.0:1788361716.232427:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361716.232430:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232431:0:93583:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d116c05000), last request at 1788361714 00010000:00010000:1.0:1788361716.232435:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe3fbb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361716.232439:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe39f6 00000100:00080000:2.0:1788361716.232448:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d116c01000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361716.232481:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d116c05000): rc 0 00000020:00000080:2.0:1788361716.232483:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d116c05000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788361716.232497:0:93583:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d141651800), last request at 1788361703 00000020:00000080:2.0:1788361716.232500:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe39fd 00010000:00010000:0.0:1788361716.232507:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361716.232509:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d141657000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361716.232533:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d141651800): rc 0 00000020:00000080:2.0:1788361716.232537:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d141651800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788361716.232538:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c05000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1788361716.232553:0:93583:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d141653800), last request at 1788361714 00000020:00000080:2.0:1788361716.232568:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe39ef 00000100:00080000:2.0:1788361716.232580:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d141656800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361716.232609:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d141653800): rc 0 00010000:00010000:1.0:1788361716.232612:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361716.232618:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d141653800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788361716.232623:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141651800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1788361716.232635:0:93583:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.35@tcp (ffff99d11e637000), last request at 1788361716 00010000:00010000:0.0:1788361716.232639:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361716.232659:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3859 00000020:00010000:2.0:1788361716.232674:0:93583:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d11e637000: total 2 00000100:00080000:2.0:1788361716.232678:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d141657800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788361716.232692:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d116c01000 for lustre-MDT0000 00000020:00010000:1.0:1788361716.232700:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d11e637000: total 1 00000020:00000080:3.0:1788361716.232704:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141653800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1788361716.232759:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d11e637000, canceled 0 locks, left on hash table 4. 00000020:00080000:2.0:1788361716.232769:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d11e637000): rc 0 00000020:00080000:2.0:1788361716.232775:0:93583:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d11e636800), last request at 1788361698 00000020:00000080:3.0:1788361716.232782:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141657000 for lustre-MDT0000 00000020:00000080:2.0:1788361716.232782:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3852 00000020:00010000:2.0:1788361716.232796:0:93583:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d11e636800: total 0 00000020:00000080:3.0:1788361716.232799:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141656800 for lustre-MDT0000 00000100:00080000:2.0:1788361716.232803:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d136ca5000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361716.232807:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe3f4b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711061 expref: 5 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361716.232819:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d11e636800): rc 0 00000004:00000080:2.0:1788361716.232853:0:93583:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa088334bae0 00010000:00010000:1.0:1788361716.232881:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe3f0c lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71104c expref: 4 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361716.232889:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788361716.232894:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788361716.232900:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21000/0x1b69fa8920fe3ef0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711045 expref: 3 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232919:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe3fd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711084 expref: 2 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361716.232935:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d11e637000, canceled 4 locks, left on hash table 0. 00000020:00010000:0.0:1788361716.232946:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d11e636800: total 0 00010000:00010000:0.0:1788361716.233019:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d11e636800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361716.233063:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe3a20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3a19 expref: 2 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361716.233103:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d11e636800, canceled 1 locks, left on hash table 0. 00000100:00080000:2.0:1788361716.253812:0:93583:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788361716.253869:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d1171e2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788361716.254692:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429874048:0@lo:39:umount.0 00000100:00100000:3.0:1788361716.254895:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361716.255009:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874048 00000100:00100000:3.0:1788361716.255021:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874048 00000100:00100000:3.0:1788361716.255091:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4206 00000100:00100000:3.0:1788361716.255103:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429874048:12345-0@lo:39:umount.0 00000100:00080000:2.0:1788361716.255108:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788361716.255116:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 3 00000004:00080000:2.0:1788361716.255132:0:93583:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1788361716.255146:0:23938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3898 00000100:00080000:3.0:1788361716.255160:0:23938:0:(import.c:65:import_set_state_nolock()) ffff99d006aa9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361716.255187:0:23938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411473 00000100:00100000:3.0:1788361716.255356:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3649:x1875230429874048:12345-0@lo:39:umount.0 Request processed in 255us (462us total) trans 77309411474 rc 0/0 00000100:00100000:3.0:1788361716.255364:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4206 00010000:00010000:3.0:1788361716.255402:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361716.255439:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1171e2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788361716.255446:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429874048:0@lo:39:umount.0 00000100:00080000:2.0:1788361716.257322:0:93583:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788361716.257354:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d006c8f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788361716.257381:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788361716.257385:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 3 00000004:00080000:2.0:1788361716.257407:0:93583:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361716.257419:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429874176:0@lo:9:umount.0 00000100:00100000:3.0:1788361716.257494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361716.257572:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874176 00000100:00100000:3.0:1788361716.257579:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874176 00000100:00100000:3.0:1788361716.257655:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927 00000100:00100000:3.0:1788361716.257662:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429874176:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361716.257698:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe38a6 00000100:00080000:3.0:1788361716.257706:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99d001c6a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361716.257764:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968751 00000100:00100000:3.0:1788361716.257951:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429874176:12345-0@lo:9:umount.0 Request processed in 288us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.257958:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927 00000100:00080000:3.0:1788361716.257991:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788361716.258006:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361716.258034:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d006c8f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361716.258044:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361716.258046:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361716.258049:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429874176:0@lo:9:umount.0 00000100:00080000:2.0:1788361716.259524:0:93583:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788361716.259551:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d11729c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788361716.259664:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429874304:0@lo:9:umount.0 00000020:00080000:2.0:1788361716.259667:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d1349b0000) has no exports 00000100:00100000:3.0:1788361716.259749:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361716.259859:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874304 00000100:00100000:3.0:1788361716.259868:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874304 00000100:00100000:3.0:1788361716.259929:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:3.0:1788361716.259941:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429874304:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361716.259972:0:26171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe38c2 00000100:00080000:3.0:1788361716.259982:0:26171:0:(import.c:65:import_set_state_nolock()) ffff99d002de9800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788361716.260024:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788361716.260034:0:26171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968756 00000100:00100000:3.0:1788361716.260181:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3649:x1875230429874304:12345-0@lo:9:umount.0 Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.260189:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00000100:00080000:3.0:1788361716.260213:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361716.260361:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d11729c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788361716.260377:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788361716.260380:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361716.260383:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429874304:0@lo:9:umount.0 00000020:00080000:2.0:1788361716.260456:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99d1349b0000) has no exports 00000020:00000080:1.0:1788361716.332502:0:6511:0:(genops.c:906:class_export_put()) final put ffff99d11e637000/f1e400d1-472b-42d1-b5e7-e80dc701272a 00010000:00010000:1.0:1788361716.332611:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361716.332615:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361716.332618:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361716.332627:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e637000/f1e400d1-472b-42d1-b5e7-e80dc701272a for lustre-MDT0000 00000020:00000080:3.0:1788361716.332717:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d141657800 for lustre-MDT0000 00000020:00000080:0.0:1788361716.398845:0:6512:0:(genops.c:906:class_export_put()) final put ffff99d11e636800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1788361716.398872:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361716.398876:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361716.398879:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361716.398941:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e636800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361716.399005:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136ca5000 for lustre-MDT0000 00000020:00000080:2.0:1788361716.415473:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe386e 00000020:00000080:2.0:1788361716.415489:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d140d5f000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788361716.415564:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788361716.415576:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361716.415596:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788361716.415601:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d104013380) has no exports 00000020:00000080:1.0:1788361716.415777:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d140d5f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788361716.415966:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3867 00000020:00000080:2.0:1788361716.415973:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d136443000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361716.416013:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136443000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361716.416040:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361716.416048:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788361716.416051:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d104f3e800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788361716.416053:0:93583:0:(genops.c:865:class_export_destroy()) destroying export ffff99d104f3e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788361716.416061:0:93583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788361716.416203:0:93583:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d120e09cc0 - data ffff99d120b20d80/ffff99d139f19400 00000020:01000000:2.0:1788361716.416344:0:93583:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d120e09d80 - data ffff99d12cbcca20/ffff99d106950400 00000100:00080000:3.0:1788361716.453024:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788361716.453033:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788361716.453045:0:93583:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d136b5b480 x1875230429874048/t77309411474(77309411474) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361726 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361716.453070:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788361716.454651:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361716.454657:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 4 00000004:00080000:3.0:1788361716.454886:0:93583:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361716.454889:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788361716.455120:0:92309:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361716.455128:0:92309:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:1.0:1788361716.455141:0:92309:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:3.0:1788361716.455976:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361716.455980:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 4 00000004:00080000:3.0:1788361716.456028:0:93583:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361716.456030:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361716.456247:0:92311:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361716.456252:0:92311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:2.0:1788361716.456261:0:92311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:3.0:1788361716.457412:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3828 00000020:00000080:3.0:1788361716.457424:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d1171e0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361716.457562:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361716.458456:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe383d 00000020:00000080:3.0:1788361716.458463:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d00541c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788361716.458481:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788361716.458487:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361716.458504:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361716.458509:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99d137c019c0) has no exports 00000020:00000080:1.0:1788361716.458515:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788361716.458776:0:93583:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788361716.458784:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe38bb 00000020:00000080:3.0:1788361716.458789:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d141655800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788361716.458944:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788361716.458949:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361716.458958:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361716.458961:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d0042e3380) has no exports 00000020:00000080:3.0:1788361716.458967:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe38b4 00000020:00000080:3.0:1788361716.458972:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d11729f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361716.459020:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d141655800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788361716.459416:0:93583:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788361716.459421:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361716.459424:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 5 00000004:00080000:3.0:1788361716.459430:0:93583:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361716.459433:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361716.459469:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11729f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361716.459547:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361716.459555:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361716.459562:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe389f 00000020:00000080:3.0:1788361716.459578:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d00541d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361716.459610:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11729c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361716.459617:0:29104:0:(genops.c:906:class_export_put()) final put ffff99d00541e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361716.459626:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788361716.459632:0:29104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361716.459776:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788361716.459781:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361716.459787:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361716.459789:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99d104010000) has no exports 00000020:00000080:3.0:1788361716.459794:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3891 00000020:00000080:3.0:1788361716.459799:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d006c8b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361716.459844:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1788361716.460329:0:93583:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788361716.460332:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361716.460335:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 5 00000004:00080000:3.0:1788361716.460339:0:93583:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361716.460341:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361716.460378:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006c8b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361716.460469:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361716.460477:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788361716.460489:0:93583:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788361716.460494:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3883 00000020:00000080:3.0:1788361716.460499:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d00541f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361716.460522:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006c8f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361716.460528:0:29104:0:(genops.c:906:class_export_put()) final put ffff99d00541d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361716.460531:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788361716.460535:0:29104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361716.460657:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788361716.460661:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361716.460668:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361716.460671:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99d001c619c0) has no exports 00000020:00000080:3.0:1788361716.460675:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe387c 00000020:00000080:3.0:1788361716.460679:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d1171e0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361716.460703:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788361716.461625:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788361716.463514:0:93583:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788361716.463521:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788361716.463525:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788361716.463530:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361716.463593:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361716.463617:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361716.463649:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361716.463655:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361716.463660:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d1171e5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361716.463664:0:93583:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788361716.463672:0:93583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361716.463755:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d1171e2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788361716.463762:0:29104:0:(genops.c:906:class_export_put()) final put ffff99d00541b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361716.463764:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00541b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788361716.463768:0:29104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361716.463986:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3844 00000020:00000080:2.0:1788361716.463993:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d005419800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788361716.464000:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788361716.464004:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361716.464009:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788361716.464013:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99d1349b19c0) has no exports 00000020:00000080:2.0:1788361716.464037:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361716.464042:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788361716.464046:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe384b 00000020:00000080:2.0:1788361716.464050:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d005418000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788361716.464057:0:93583:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d0057c2000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788361716.464060:0:93583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d0057c2000 3 00000020:01000004:2.0:1788361716.464063:0:93583:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d0057c2000 from lustre-MDT0000 00000020:00000080:1.0:1788361716.464114:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005419800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788361716.464119:0:29104:0:(genops.c:906:class_export_put()) final put ffff99d005418800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788361716.464120:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005418800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788361716.464125:0:29104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788361716.464158:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d005418000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361716.464193:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361716.464199:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788361716.464202:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d1171e7800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788361716.464204:0:93583:0:(genops.c:865:class_export_destroy()) destroying export ffff99d1171e7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788361716.464210:0:93583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788361716.464242:0:93583:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788361716.464246:0:93583:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788361716.464249:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788361716.464252:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361716.464255:0:93583:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788361716.464263:0:93583:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d136e1b800 3956ab41-635b-456b-967f-6c1073c5d2df 192.168.204.35@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361716.464269:0:93583:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d11e632800 c8a6f36d-efb9-41cf-af98-5917323f2b0d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361716.464273:0:93583:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff99d104014d40) has exports, disconnecting them 00000020:00080000:2.0:1788361716.464284:0:93583:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.35@tcp (ffff99d136e1b800), last request at 1788361700 00000020:00000080:2.0:1788361716.464304:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe39cc 00000020:00010000:2.0:1788361716.464309:0:93583:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d136e1b800: total 0 00000100:00080000:2.0:1788361716.464312:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d136e1f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361716.464334:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d136e1b800): rc 0 00000020:00080000:2.0:1788361716.464338:0:93583:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d11e632800), last request at 1788361698 00000020:00000080:2.0:1788361716.464378:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe37e9 00000020:00010000:2.0:1788361716.464381:0:93583:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d11e632800: total 0 00000100:00080000:2.0:1788361716.464384:0:93583:0:(import.c:65:import_set_state_nolock()) ffff99d11e630800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788361716.464392:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d11e632800): rc 0 00000020:00080000:2.0:1788361716.464396:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99d104014d40) has no exports 00000020:00010000:2.0:1788361716.464403:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d136e1b800: total 0 00010000:00010000:2.0:1788361716.464428:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d136e1b800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788361716.464457:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aac600/0x1b69fa8920fe39e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fb2 expref: 5 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464475:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe3e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71101b expref: 4 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464487:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe3e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711014 expref: 3 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464497:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d117aad800/0x1b69fa8920fe39d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae710fa4 expref: 2 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464514:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d136e1b800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788361716.464532:0:8455:0:(genops.c:906:class_export_put()) final put ffff99d136e1b800/3956ab41-635b-456b-967f-6c1073c5d2df 00000020:00010000:2.0:1788361716.464539:0:8455:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d11e632800: total 1 00010000:00010000:2.0:1788361716.464542:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361716.464559:0:8455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d11e632800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788361716.464596:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916800/0x1b69fa8920fe3db5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3dae expref: 14 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464608:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00207ca00/0x1b69fa8920fe392b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3924 expref: 13 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464621:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785f200/0x1b69fa8920fe39a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe39a2 expref: 12 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464631:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308800/0x1b69fa8920fe3dc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3dbc expref: 11 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464641:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309000/0x1b69fa8920fe3dd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3dca expref: 10 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464651:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d100030800/0x1b69fa8920fe3947 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3940 expref: 9 pid: 92299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464663:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012ea400/0x1b69fa8920fe3ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3dd8 expref: 8 pid: 92296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464678:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00207d400/0x1b69fa8920fe3955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe394e expref: 7 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464687:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00207c800/0x1b69fa8920fe39b7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe39b0 expref: 6 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464699:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe3dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3df4 expref: 5 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464709:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916c00/0x1b69fa8920fe3ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3de6 expref: 4 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464728:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb200/0x1b69fa8920fe3e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3e02 expref: 3 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464741:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d11785fe00/0x1b69fa8920fe397f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe3978 expref: 2 pid: 92297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361716.464751:0:8455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d11e632800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788361716.464766:0:8455:0:(genops.c:906:class_export_put()) final put ffff99d11e632800/c8a6f36d-efb9-41cf-af98-5917323f2b0d 00010000:00010000:2.0:1788361716.464771:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361716.464774:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361716.464776:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361716.464871:0:92297:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d139870c00:92297] 1 exiting: rc = 0 00000100:00100000:2.0:1788361716.464971:0:92296:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d00566ce00:92296] 0 exiting: rc = 1 00010000:00010000:1.0:1788361716.465065:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361716.465106:0:92299:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d102a86000:92299] 2 exiting: rc = 0 00000100:00100000:1.0:1788361716.465111:0:92301:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99d136ee2600:92301] 3 exiting: rc = 0 00000020:00000080:1.0:1788361716.465223:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136e1b800/3956ab41-635b-456b-967f-6c1073c5d2df for MGS 00000020:00000080:1.0:1788361716.465256:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d11e632800/c8a6f36d-efb9-41cf-af98-5917323f2b0d for MGS 00000020:00000080:1.0:1788361716.465271:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136e1f800 for MGS 00000020:00000080:1.0:1788361716.465276:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d11e630800 for MGS 00000100:00100000:2.0:1788361716.465364:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465388:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465400:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465463:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465473:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465481:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465491:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465499:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465516:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465535:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465591:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465603:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465615:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465625:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465637:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465657:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465668:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465718:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465738:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465749:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465765:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465780:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465787:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465793:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465799:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465804:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465810:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465814:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465937:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.465949:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466003:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466010:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466020:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466030:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466040:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466047:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466065:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466073:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466130:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466140:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466151:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466159:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466165:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466171:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466179:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466188:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466201:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466215:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466222:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466227:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466233:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466238:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466243:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466257:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466263:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466269:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466275:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466283:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466288:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466293:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466298:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466302:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466308:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361716.466313:0:93583:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788361716.467440:0:93583:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d1046e2660 - data ffff99d117518438/ffff99d12cfc6400 00000020:01000000:2.0:1788361716.467934:0:93583:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d120e09540 - data ffff99d0018ce288/ffff99d00319d000 00000020:00000080:2.0:1788361716.468405:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe37e2 00000020:00000080:2.0:1788361716.468413:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d0021fb000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788361716.468424:0:93583:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d0057c2000 from MGS, refs=2 00000020:01000004:2.0:1788361716.468428:0:93583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d0057c2000 2 00000020:01000004:2.0:1788361716.468431:0:93583:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d0057c2000 from MGS 00000020:00000080:2.0:1788361716.468451:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361716.468458:0:93583:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788361716.468461:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d137f12800/MGS 00000020:00000080:2.0:1788361716.468463:0:93583:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f12800/MGS for MGS 00000020:01000000:2.0:1788361716.468469:0:93583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788361716.468531:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788361716.468536:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361716.468545:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361716.468551:0:93583:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d116c04000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361716.468557:0:93583:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99d1040119c0) has exports, disconnecting them 00000020:00080000:2.0:1788361716.468561:0:93583:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d116c04000), last request at 1788361698 00000020:00000080:2.0:1788361716.468565:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe38fa 00000020:00080000:2.0:1788361716.468575:0:93583:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d116c04000): rc 0 00000020:00000080:2.0:1788361716.468579:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d116c04000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788361716.468614:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0021fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361716.469470:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c04000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788361716.469908:0:93583:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788361716.469918:0:93583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361716.469922:0:93583:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361716.469933:0:93583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361716.469996:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d116c06800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361716.470198:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361716.470220:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788361716.470227:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d116c07800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788361716.470233:0:93583:0:(genops.c:865:class_export_destroy()) destroying export ffff99d116c07800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788361716.470248:0:93583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788361716.470405:0:93583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d0057c2000 1 00000020:00000080:3.0:1788361716.470412:0:93583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe37d4 00000020:00000080:3.0:1788361716.470424:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d137f14000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788361716.470442:0:93583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788361716.470447:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361716.470453:0:93583:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361716.470459:0:93583:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d137c04d40) has no exports 00000020:00000080:1.0:1788361716.470466:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137f14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361716.491512:0:93583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361716.491534:0:93583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788361716.491541:0:93583:0:(genops.c:906:class_export_put()) final put ffff99d0021fd000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361716.491547:0:93583:0:(genops.c:865:class_export_destroy()) destroying export ffff99d0021fd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788361716.491568:0:93583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788361716.491743:0:93583:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d105497800 00000020:02000400:3.0:1788361716.491845:0:93583:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788361716.821933:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361717.846091:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361718.104156:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361718.104166:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d001c6b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788361718.104228:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000020:00000080:1.0:1788361718.104293:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d001c6b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788361718.104351:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d001c6a000 for lustre-OST0000 00010000:00010000:2.0:1788361718.870444:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361719.126134:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429874816:0@lo:400:kworker.0 00000100:00100000:0.0:1788361719.126191:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429874688:0@lo:400:kworker.0 00000100:00100000:2.0:1788361719.126204:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361719.126217:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429874432:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.126403:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874816 00000100:00100000:1.0:1788361719.126411:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874816 00000100:00100000:0.0:1788361719.126457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361719.126495:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429875200:0@lo:400:kworker.0 00000100:00100000:0.0:1788361719.126520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361719.126545:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429875328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361719.126571:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874688 00000100:00100000:0.0:1788361719.126575:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874688 00000100:00100000:2.0:1788361719.126580:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361719.126609:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788361719.126618:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429874560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361719.126618:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788361719.126630:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3653:x1875230429874688:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361719.126641:0:66901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000400:00000100:3.0:1788361719.126642:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429874432 offset 0 length 224: 4 00000100:00100000:2.0:1788361719.126654:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361719.126678:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429875072:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.126852:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1788361719.126860:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429874816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361719.127126:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429874944:0@lo:400:kworker.0 00000100:00100000:2.0:1788361719.127152:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361719.127168:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429875456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361719.127191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361719.127217:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874944 00000100:00100000:2.0:1788361719.127220:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874944 00000100:00100000:2.0:1788361719.127243:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1788361719.127248:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875230429874944:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361719.127253:0:66127:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361719.127283:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875230429874944:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361719.127290:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1788361719.127309:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875328 00000100:00100000:2.0:1788361719.127313:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875328 00000100:00100000:2.0:1788361719.127338:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875456 00000100:00100000:2.0:1788361719.127341:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875456 00000100:00100000:2.0:1788361719.127360:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:2.0:1788361719.127366:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429875328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361719.127392:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429875328:12345-0@lo:400:kworker.0 Request processed in 27us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361719.127405:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:2.0:1788361719.127419:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1788361719.127427:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429875456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361719.127452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361719.127483:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875230429874816:12345-0@lo:400:kworker.0 Request processed in 623us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361719.127487:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429875584:0@lo:400:kworker.0 00000100:00100000:2.0:1788361719.127489:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429875456:12345-0@lo:400:kworker.0 Request processed in 60us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361719.127501:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1788361719.127504:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1788361719.127522:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875072 00000100:00100000:3.0:1788361719.127527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361719.127538:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875072 00000100:00100000:1.0:1788361719.127563:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875584 00000100:00080000:2.0:1788361719.127565:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788361719.127567:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875584 00000100:00080000:2.0:1788361719.127571:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788361719.127577:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788361719.127583:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788361719.127584:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00080000:3.0:1788361719.127589:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361719.127590:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2743 00000100:00080000:3.0:1788361719.127596:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361719.127596:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429875072:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361719.127601:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00080000:3.0:1788361719.127602:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361719.127628:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1788361719.127632:0:3650:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d0053d3b80 x1875230429875712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361719.127640:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1875230429875584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.127643:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429875072:12345-0@lo:400:kworker.0 Request processed in 47us (189us total) trans 0 rc 0/0 00000020:00080000:3.0:1788361719.127656:0:66126:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361719.127657:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1788361719.127669:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429874944:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.127682:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875200 00000100:00100000:1.0:1788361719.127687:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875200 00000100:00100000:2.0:1788361719.127693:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429875456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361719.127706:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1875230429875584:12345-0@lo:400:kworker.0 Request processed in 67us (180us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361719.127710:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874560 00000100:00100000:2.0:1788361719.127712:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875230429874816:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.127715:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874560 00000100:00100000:3.0:1788361719.127716:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1788361719.127733:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429875328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.127738:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207 00000100:00100000:1.0:1788361719.127745:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3653:x1875230429875200:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788361719.127752:0:8449:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788361719.127774:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429875712:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788361719.127795:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3653:x1875230429875200:12345-0@lo:400:kworker.0 Request processed in 48us (1273us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361719.127804:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207 00000100:00100000:2.0:1788361719.127809:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361719.127813:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4208 00000100:00100000:3.0:1788361719.127844:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1875230429874560:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788361719.127852:0:23939:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788361719.127855:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875712 00000100:00100000:1.0:1788361719.127860:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875712 00000100:00100000:2.0:1788361719.127888:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1788361719.127898:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429875712:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788361719.127899:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1875230429874560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (1241us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361719.127910:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4208 00010000:00020000:2.0:1788361719.127925:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:02020000:3.0:1788361719.127952:0:3650:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788361719.127957:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361719.127960:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1788361719.127964:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429875712:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (154us total) trans 0 rc -19/-19 00000100:02000400:3.0:1788361719.127967:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361719.127976:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361719.127980:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2743 00000100:00080000:3.0:1788361719.127985:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361719.128001:0:3650:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002239180 x1875230429875840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361719.128024:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3653:x1875230429874688:12345-0@lo:400:kworker.0 Request processed in 1392us (1564us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361719.128038:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429875840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788361719.128073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361719.128078:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429875072:0@lo:400:kworker.0 00000100:00080000:3.0:1788361719.128104:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361719.128108:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361719.128111:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1788361719.128114:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1788361719.128118:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429875712:0@lo:38:ptlrpcd_00_00.0 00000100:02000400:1.0:1788361719.128122:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788361719.128135:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361719.128139:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2743 00000100:00080000:1.0:1788361719.128144:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00080000:3.0:1788361719.128157:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361719.128161:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1788361719.128163:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d00a24fb80 x1875230429875968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:02000400:3.0:1788361719.128168:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361719.128172:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361719.128185:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2743 00000100:00080000:3.0:1788361719.128193:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361719.128208:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429875584:0@lo:400:kworker.0 00000100:00100000:3.0:1788361719.128214:0:3653:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d007353b80 x1875230429876096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361719.128228:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429874688:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.128235:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875840 00000100:00100000:1.0:1788361719.128240:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875840 00000100:00080000:3.0:1788361719.128245:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361719.128249:0:3653:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99d106904000 already not connected (conn 51, was 50): CONNECTING 00000100:00100000:3.0:1788361719.128254:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429875200:0@lo:400:kworker.0 00000100:00100000:1.0:1788361719.128262:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4209 00000100:00100000:1.0:1788361719.128267:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429875840:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788361719.128279:0:8449:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361719.128305:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429875840:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 37us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361719.128310:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429875968:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361719.128324:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4209 00000100:00100000:3.0:1788361719.128342:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361719.128363:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429876096:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788361719.128371:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429875968 00000100:00100000:1.0:1788361719.128376:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429875968 00000100:00100000:3.0:1788361719.128386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361719.128408:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788361719.128411:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00080000:3.0:1788361719.128415:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361719.128420:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1788361719.128422:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429875840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788361719.128431:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876096 00000100:00100000:2.0:1788361719.128437:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876096 00000100:00100000:0.0:1788361719.128446:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788361719.128452:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429875968:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788361719.128463:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361719.128496:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429875968:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 42us (155us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361719.128502:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788361719.128513:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1788361719.128517:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429876096:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788361719.128526:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361719.128563:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429876096:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (177us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361719.128569:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00080000:1.0:1788361719.128806:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361719.128810:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361719.128813:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429875968:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788361719.128834:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361719.128837:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361719.128840:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429876096:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788361719.894469:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361720.151548:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788361720.151571:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411474 is committed 00000020:00000080:3.0:1788361720.151576:0:75524:0:(genops.c:906:class_export_put()) final put ffff99d006aa8800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788361720.151614:0:75524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411473 is committed 00000020:00000080:1.0:1788361720.151695:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d006aa8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00010000:00010000:2.0:1788361720.151741:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151753:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151760:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788361720.151764:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d006aa9000 for lustre-MDT0001 00010000:00010000:2.0:1788361720.151767:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361720.151773:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151781:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151798:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff99d004359800) 00010000:00010000:2.0:1788361720.151802:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361720.151806:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151812:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004308e00/0x1b69fa8920fe4016 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151860:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151876:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151882:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151887:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ebc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361720.151891:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151897:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151905:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99d112d1b100) 00010000:00010000:2.0:1788361720.151908:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361720.151911:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151916:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012ebc00/0x1b69fa8920fe402b lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151929:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151935:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151941:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151946:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361720.151955:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151961:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151970:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff99d004359700) 00010000:00010000:2.0:1788361720.151972:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361720.151975:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151980:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d004309c00/0x1b69fa8920fe4071 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.151996:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.152001:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.152007:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.152012:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eba00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361720.152015:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.152021:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.152029:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99d112d1b800) 00010000:00010000:2.0:1788361720.152031:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361720.152040:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361720.152046:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d1012eba00/0x1b69fa8920fe4086 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361720.662366:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361720.662389:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429876224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361720.662460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361720.662466:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429876352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361720.662516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361720.662519:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876224 00000100:00100000:0.0:1788361720.662528:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876224 00000100:00100000:1.0:1788361720.662582:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876352 00000100:00100000:1.0:1788361720.662587:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876352 00000100:00100000:0.0:1788361720.662588:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:0.0:1788361720.662596:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429876224:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361720.662614:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1788361720.662620:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429876352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361720.662642:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00002000:00000024:0.0:1788361720.662642:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788361720.662680:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429876224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361720.662682:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429876352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361720.662688:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1788361720.662779:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429876224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361720.662813:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429876352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361720.662937:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00010000:00010000:1.0:1788361720.918027:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361721.175628:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361721.175637:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d002ded000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788361721.175670:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968756 is committed 00000020:00000080:0.0:1788361721.175733:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002ded000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788361721.175791:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002de9800 for lustre-OST0001 00000400:00000100:0.0:1788361721.225079:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407041792 offset 0 length 224: 4 00000100:00100000:0.0:1788361721.225298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361721.225330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361721.225393:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407041920 00000100:00100000:3.0:1788361721.225396:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042048 00000100:00100000:1.0:1788361721.225409:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407041920 00000100:00100000:3.0:1788361721.225410:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042048 00000100:00100000:0.0:1788361721.225434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361721.225472:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042176 00000100:00100000:0.0:1788361721.225477:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042176 00000100:00080000:2.0:1788361721.225498:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361721.225506:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361721.225511:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 931 00000100:00100000:3.0:1788361721.225524:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1338 00000100:00100000:1.0:1788361721.225536:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2410:x1875230407042048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361721.225546:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1916 00000100:00100000:3.0:1788361721.225547:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1875230407041920:12345-192.168.204.35@tcp:400:kworker.0 00000020:00080000:3.0:1788361721.225563:0:66126:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:0.0:1788361721.225565:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407042176:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361721.225669:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2410:x1875230407042048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361721.225692:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 931 00000100:00100000:3.0:1788361721.225976:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1875230407041920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 439us (676us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361721.225981:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407042176:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 420us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361721.225987:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1338 00000100:00100000:0.0:1788361721.225998:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1916 00000100:00100000:1.0:1788361721.226102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361721.226159:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042304 00000100:00100000:0.0:1788361721.226165:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042304 00000100:00100000:0.0:1788361721.226214:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1917 00000100:00100000:0.0:1788361721.226223:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407042304:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:3.0:1788361721.226237:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361721.226256:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407042304:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361721.226263:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1917 00000100:00100000:0.0:1788361721.227978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361721.228067:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042432 00000100:00100000:1.0:1788361721.228080:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042432 00000100:00100000:1.0:1788361721.228142:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1339 00000100:00100000:1.0:1788361721.228152:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407042432:12345-192.168.204.35@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788361721.228350:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361721.228417:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407042432:12345-192.168.204.35@tcp:38:ptlrpcd_00_01.0 Request processed in 266us (442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361721.228424:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1339 00010000:00010000:0.0:1788361721.942026:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361722.966054:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361723.989964:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361724.246119:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361724.246126:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361724.246130:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361724.246138:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2759 00000100:00080000:0.0:1788361724.246144:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361724.246151:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361724.246175:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1172a7480 x1875230429876608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361724.246218:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361724.246222:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361724.246223:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361724.246227:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2759 00000100:00080000:0.0:1788361724.246230:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361724.246233:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361724.246244:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1172a7800 x1875230429876864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361724.246260:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361724.246263:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361724.246265:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361724.246269:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2759 00000100:00080000:0.0:1788361724.246272:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361724.246276:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361724.246292:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429876608:0@lo:38:kworker.0 00000100:00100000:0.0:1788361724.246298:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1172a7b80 x1875230429877120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361724.246359:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361724.246362:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361724.246364:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361724.246370:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2759 00000100:00100000:1.0:1788361724.246371:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361724.246377:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361724.246383:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361724.246395:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1170dd880 x1875230429877504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361724.246440:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429876864:0@lo:38:kworker.0 00000100:00100000:1.0:1788361724.246462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361724.246491:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429877120:0@lo:38:kworker.0 00000100:00100000:3.0:1788361724.246495:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429876480:0@lo:400:kworker.0 00000100:00100000:2.0:1788361724.246520:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429877248:0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.246522:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1788361724.246533:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429876480 offset 0 length 224: 4 00000100:00100000:1.0:1788361724.246550:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429877504:0@lo:38:kworker.0 00000100:00100000:2.0:1788361724.246572:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361724.246575:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429877376:0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.246584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361724.246623:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429876736:0@lo:400:kworker.0 00000100:00100000:2.0:1788361724.246629:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429877248 00000100:00100000:2.0:1788361724.246637:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429877248 00000100:00100000:1.0:1788361724.246647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361724.246672:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361724.246679:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361724.246682:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429876992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.246712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361724.246714:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429877376 00000100:00100000:2.0:1788361724.246719:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429877376 00000100:00100000:3.0:1788361724.246734:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1788361724.246748:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429877248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.246756:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876608 00000100:00100000:1.0:1788361724.246762:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876608 00000100:00100000:1.0:1788361724.246785:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876864 00000100:00100000:1.0:1788361724.246788:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876864 00000100:00100000:1.0:1788361724.246799:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1788361724.246804:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429876608:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361724.246818:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429877248:12345-0@lo:400:kworker.0 Request processed in 74us (247us total) trans 0 rc 0/0 00010000:00020000:1.0:1788361724.246844:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361724.246856:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1788361724.246880:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429876608:12345-0@lo:38:kworker.0 Request processed in 74us (512us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361724.246887:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1788361724.246892:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1788361724.246898:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429877376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.246906:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429877504 00000100:00100000:1.0:1788361724.246911:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429877504 00000100:00100000:1.0:1788361724.246922:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876736 00000100:00100000:1.0:1788361724.246924:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876736 00000100:00100000:1.0:1788361724.246939:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429876992 00000100:00100000:1.0:1788361724.246941:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429876992 00000100:00100000:1.0:1788361724.246953:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1788361724.246958:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429876736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.246994:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429876736:12345-0@lo:400:kworker.0 Request processed in 36us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361724.247011:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1788361724.247023:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1788361724.247029:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429876992:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361724.247048:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361724.247054:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361724.247057:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361724.247057:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875230429876992:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361724.247066:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1788361724.247078:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1788361724.247081:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429876864:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361724.247098:0:66901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361724.247120:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429876864:12345-0@lo:38:kworker.0 Request processed in 37us (657us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361724.247127:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1788361724.247248:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429877376:12345-0@lo:400:kworker.0 Request processed in 354us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361724.247262:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:0.0:1788361724.247355:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1788361724.247360:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429877504:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361724.247364:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429877376:0@lo:400:kworker.0 00010000:00020000:0.0:1788361724.247372:0:66126:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361724.247400:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429877248:0@lo:400:kworker.0 00000100:00100000:3.0:1788361724.247409:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429877120 00000100:00100000:3.0:1788361724.247414:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429877120 00000100:00100000:1.0:1788361724.247453:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875230429876992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361724.247489:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429876736:0@lo:400:kworker.0 00000100:00100000:0.0:1788361724.247513:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429877504:12345-0@lo:38:kworker.0 Request processed in 150us (931us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361724.247522:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1788361724.247587:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4210 00000100:00080000:2.0:1788361724.247590:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788361724.247595:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429877120:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788361724.247599:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361724.247604:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429876608:0@lo:38:kworker.0 00010000:00020000:3.0:1788361724.247610:0:8448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788361724.247618:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361724.247623:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361724.247626:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429876864:0@lo:38:kworker.0 00000100:00080000:2.0:1788361724.247647:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788361724.247651:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429877120:12345-0@lo:38:kworker.0 Request processed in 55us (1128us total) trans 0 rc -19/-19 00000100:00080000:2.0:1788361724.247654:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361724.247661:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429877120:0@lo:38:kworker.0 00000100:00100000:3.0:1788361724.247666:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4210 00000100:00080000:2.0:1788361724.247686:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361724.247691:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361724.247694:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429877504:0@lo:38:kworker.0 00010000:00010000:1.0:1788361725.013994:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361725.782243:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361725.782263:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429877632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361725.782324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361725.782482:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361725.782494:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429877760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361725.782533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361725.782701:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429877632 00000100:00100000:2.0:1788361725.782710:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429877632 00000100:00100000:2.0:1788361725.782802:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429877760 00000100:00100000:2.0:1788361725.782806:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429877760 00000100:00100000:1.0:1788361725.782876:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:1.0:1788361725.782890:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429877632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788361725.782921:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361725.782968:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429877632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361725.782977:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:1.0:1788361725.782999:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:3.0:1788361725.783005:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429877632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361725.783007:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429877760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361725.783029:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361725.783186:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429877760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361725.783193:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:3.0:1788361725.783246:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429877760:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788361726.038128:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788361726.344045:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407042560 offset 0 length 224: 4 00000100:00100000:2.0:1788361726.344088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361726.344188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361726.344224:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361726.344263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361726.344306:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042944 00000100:00100000:3.0:1788361726.344316:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042944 00000100:00100000:3.0:1788361726.344382:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043072 00000100:00100000:3.0:1788361726.344397:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043072 00000100:00100000:0.0:1788361726.344402:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1920 00000100:00100000:0.0:1788361726.344419:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407042944:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361726.344430:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1921 00000100:00100000:3.0:1788361726.344441:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407043072:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361726.344495:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407042944:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361726.344503:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1920 00000100:00100000:3.0:1788361726.344748:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407043072:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 310us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361726.344756:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1921 00000100:00080000:3.0:1788361726.344792:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361726.344796:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361726.344914:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042816 00000100:00100000:1.0:1788361726.344919:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042816 00000100:00100000:1.0:1788361726.344956:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407042688 00000100:00100000:1.0:1788361726.344960:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407042688 00000100:00100000:1.0:1788361726.344979:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 934 00000100:00080000:0.0:1788361726.344979:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361726.344988:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2410:x1875230407042816:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361726.345013:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1343 00000100:00100000:0.0:1788361726.345021:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407042688:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:0.0:1788361726.345041:0:67579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361726.345046:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2410:x1875230407042816:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 57us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361726.345056:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 934 00000100:00100000:0.0:1788361726.345085:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407042688:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 62us (820us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361726.345093:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1343 00010000:00010000:2.0:1788361727.062103:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361728.090328:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361729.109950:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361729.366079:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361729.366086:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361729.366090:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361729.366098:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2764 00000100:00080000:3.0:1788361729.366107:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1788361729.366112:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788361729.366116:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361729.366130:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429877888:0@lo:400:kworker.0 00000100:00100000:3.0:1788361729.366145:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002239180 x1875230429878016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788361729.366183:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230429877888 offset 0 length 224: 4 00000100:00080000:3.0:1788361729.366189:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361729.366194:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361729.366196:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361729.366200:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2764 00000100:00080000:3.0:1788361729.366203:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361729.366207:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361729.366221:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d0053d3b80 x1875230429878272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361729.366246:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429878144:0@lo:400:kworker.0 00000100:00100000:2.0:1788361729.366252:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429878016:0@lo:38:kworker.0 00000100:00080000:3.0:1788361729.366279:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361729.366283:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361729.366286:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361729.366293:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2764 00000100:00100000:1.0:1788361729.366294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361729.366299:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361729.366306:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361729.366312:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361729.366341:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429878400:0@lo:400:kworker.0 00000100:00100000:3.0:1788361729.366345:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117281180 x1875230429878528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361729.366363:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878144 00000100:00100000:1.0:1788361729.366372:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878144 00000100:00100000:2.0:1788361729.366382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361729.366385:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788361729.366389:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361729.366394:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361729.366396:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788361729.366399:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429878656:0@lo:400:kworker.0 00000100:00080000:3.0:1788361729.366402:0:29104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2764 00000100:00080000:3.0:1788361729.366408:0:29104:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361729.366413:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361729.366428:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117282680 x1875230429878912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361729.366432:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878400 00000100:00100000:1.0:1788361729.366436:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878400 00000100:00080000:2.0:1788361729.366438:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361729.366446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361729.366470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361729.366474:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1788361729.366485:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429878144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361729.366493:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878656 00000100:00100000:3.0:1788361729.366498:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878656 00000100:00100000:2.0:1788361729.366524:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878016 00000100:00100000:2.0:1788361729.366530:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878016 00000100:00100000:3.0:1788361729.366542:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1788361729.366554:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429878656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361729.366554:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429878144:12345-0@lo:400:kworker.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361729.366562:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1788361729.366574:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429878400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361729.366578:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1788361729.366600:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429878656:12345-0@lo:400:kworker.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361729.366604:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1788361729.366612:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429878016:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361729.366617:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429878656:0@lo:400:kworker.0 00000100:00100000:2.0:1788361729.366628:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429878400:12345-0@lo:400:kworker.0 Request processed in 55us (247us total) trans 0 rc 0/0 00010000:00020000:1.0:1788361729.366628:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361729.366639:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1788361729.366660:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429878016:12345-0@lo:38:kworker.0 Request processed in 47us (194us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361729.366662:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429878784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361729.366675:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1788361729.366679:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429878400:0@lo:400:kworker.0 00000100:00100000:0.0:1788361729.366700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361729.366721:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361729.366726:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429878144:0@lo:400:kworker.0 00000100:00080000:2.0:1788361729.366743:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361729.366750:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361729.366755:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429878016:0@lo:38:kworker.0 00000100:00100000:0.0:1788361729.366759:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878784 00000100:00100000:2.0:1788361729.366764:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429878272:0@lo:38:kworker.0 00000100:00100000:0.0:1788361729.366764:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878784 00000100:00100000:3.0:1788361729.366788:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1788361729.366793:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361729.366818:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878272 00000100:00080000:1.0:1788361729.366842:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361729.366851:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878272 00000100:00100000:0.0:1788361729.366853:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1788361729.366865:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429878784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361729.366868:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429878528:0@lo:38:kworker.0 00000100:00100000:3.0:1788361729.366883:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1788361729.366890:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429878272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788361729.366903:0:80345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361729.366908:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361729.366942:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429878784:12345-0@lo:400:kworker.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361729.366948:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878528 00000100:00100000:0.0:1788361729.366952:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1788361729.366954:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429878912:0@lo:38:kworker.0 00000100:00100000:1.0:1788361729.366959:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878528 00000100:00100000:3.0:1788361729.366961:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429878272:12345-0@lo:38:kworker.0 Request processed in 69us (167us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361729.366970:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1788361729.366997:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4211 00000100:00100000:0.0:1788361729.366997:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429878784:0@lo:400:kworker.0 00000100:00100000:2.0:1788361729.367008:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361729.367008:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429878528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788361729.367023:0:23938:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361729.367052:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429878912 00000100:00100000:0.0:1788361729.367057:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429878912 00000100:00100000:1.0:1788361729.367060:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429878528:12345-0@lo:38:kworker.0 Request processed in 53us (151us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361729.367068:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4211 00000100:00100000:0.0:1788361729.367082:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788361729.367087:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429878912:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788361729.367098:0:66127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361729.367131:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429878912:12345-0@lo:38:kworker.0 Request processed in 43us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361729.367138:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00080000:3.0:1788361729.367398:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361729.367409:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361729.367412:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429878912:0@lo:38:kworker.0 00000100:00080000:3.0:1788361729.367430:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361729.367433:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361729.367437:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429878272:0@lo:38:kworker.0 00000100:00080000:3.0:1788361729.367454:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361729.367458:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361729.367460:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429878528:0@lo:38:kworker.0 00010000:00010000:2.0:1788361730.133966:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361730.902038:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429879040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361730.902061:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429879168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361730.902138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361730.902186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361730.902233:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879040 00000100:00100000:3.0:1788361730.902244:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879040 00000100:00100000:3.0:1788361730.902312:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879168 00000100:00100000:3.0:1788361730.902316:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879168 00000100:00100000:3.0:1788361730.902353:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1788361730.902364:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788361730.902366:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429879040:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788361730.902380:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429879168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788361730.902401:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788361730.902401:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361730.902465:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429879168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361730.902476:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788361730.902477:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429879040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361730.902490:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1788361730.902530:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429879168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361730.902558:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429879040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788361731.158465:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788361731.464429:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.204.35@tcp portal 26 match 1875230407043200 offset 0 length 224: 4 00000100:00100000:0.0:1788361731.464483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361731.464562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361731.464590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361731.464613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361731.464657:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043456 00000100:00100000:1.0:1788361731.464668:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043456 00000100:00100000:1.0:1788361731.464726:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043328 00000100:00100000:1.0:1788361731.464728:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043328 00000100:00100000:1.0:1788361731.464744:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 937 00000100:00100000:1.0:1788361731.464754:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2409:x1875230407043456:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361731.464852:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2409:x1875230407043456:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.464859:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 937 00000100:00100000:1.0:1788361731.464877:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1347 00000100:00100000:1.0:1788361731.464881:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230407043328:12345-192.168.204.35@tcp:38:kworker.0 00010000:00020000:1.0:1788361731.464906:0:66128:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361731.464941:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1875230407043328:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 58us (351us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361731.464948:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1347 00000100:00080000:1.0:1788361731.464978:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361731.465597:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043712 00000100:00100000:2.0:1788361731.465603:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043712 00000100:00100000:0.0:1788361731.465609:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043584 00000100:00100000:0.0:1788361731.465615:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043584 00000100:00100000:2.0:1788361731.465666:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1924 00000100:00100000:2.0:1788361731.465675:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407043712:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361731.465719:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407043712:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 44us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361731.465726:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1924 00000100:00080000:1.0:1788361731.465737:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361731.465741:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361731.465877:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4929 00000100:00100000:0.0:1788361731.465886:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2408:x1875230407043584:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:0.0:1788361731.465906:0:26162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3f75 00000100:00080000:0.0:1788361731.466558:0:26162:0:(import.c:65:import_set_state_nolock()) ffff99d007456000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361731.466731:0:26162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968751 00010000:00010000:2.0:1788361731.466999:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361731.467045:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+2:2408:x1875230407043584:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 1158us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361731.467054:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4929 00000020:01000004:1.0:1788361731.853758:0:94201:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361731.853766:0:94201:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788361731.853768:0:94201:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788361731.854008:0:94201:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d1042fb800 00000020:01000004:1.0:1788361731.854030:0:94201:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788361731.854049:0:94201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788361731.854074:0:94201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d104010000) 00000020:00000080:1.0:1788361731.854100:0:94201:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788361731.928327:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788361731.930001:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.934797:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.935071:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.935477:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.935763:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.936019:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.936427:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.936976:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.937184:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.937493:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.937678:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.937851:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.938051:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.938198:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.938367:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.938575:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.938855:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.939051:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.939513:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.939705:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.939876:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.940332:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.940527:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.940714:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788361731.940904:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.941087:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788361731.941306:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788361731.941545:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788361731.942348:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788361731.942606:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788361731.942887:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788361731.943199:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788361731.943867:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788361731.945273:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.948664:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788361731.949074:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788361731.950451:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788361731.950696:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788361731.951002:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.951225:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788361731.951434:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.951599:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.951781:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.952007:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.952174:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788361731.952331:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.953226:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.954191:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.954406:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.955362:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.955553:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.955802:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.955867:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.955887:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:2.0:1788361731.955903:0:94201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00080000:01000000:2.0:1788361731.956590:0:94201:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788361731.956894:0:94201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788361731.956900:0:94201:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361731.956910:0:94201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe409b 00000020:01000004:2.0:1788361731.956929:0:94201:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788361731.956942:0:94201:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788361731.956948:0:94201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d1042fb800 from MGS 00000020:01000004:2.0:1788361731.956951:0:94201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788361731.956961:0:94201:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d0042e19c0) 00000020:00000080:2.0:1788361731.956974:0:94201:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788361731.957034:0:94201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d1042fb800 from MGS, refs=2 00080000:01000000:2.0:1788361731.957039:0:94201:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361731.957043:0:94201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe40a9 00010000:00010000:2.0:1788361731.957210:0:94201:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788361731.960434:0:94201:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788361731.961447:0:94205:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788361731.961478:0:94201:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788361731.961525:0:94201:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361731.962034:0:94201:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788361731.962407:0:94201:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361731.962559:0:94201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788361731.962565:0:94201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788361731.963663:0:94201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788361731.963671:0:94201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788361731.964286:0:94201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788361731.964292:0:94201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361731.964793:0:94201:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361731.964815:0:94201:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788361731.964817:0:94201:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788361731.964820:0:94201:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1788361731.964842:0:94201:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788361731.964848:0:94201:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788361731.964852:0:94201:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788361731.964854:0:94201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788361731.964862:0:94201:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d136b59500 x1875230429874432/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361731.965276:0:94201:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d1172a5180 x1875230429876480/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361740 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361731.965293:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429874432:0@lo:400:kworker.0 00000100:00100000:3.0:1788361731.965313:0:94201:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d007353100 x1875230429877888/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361745 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788361731.965324:0:94201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788361731.965326:0:94201:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788361731.965328:0:94201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788361731.965331:0:94201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:0.0:1788361731.965367:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429877888:0@lo:400:kworker.0 00000100:00100000:0.0:1788361731.965391:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429876480:0@lo:400:kworker.0 10000000:01000000:3.0:1788361731.965426:0:94201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788361731.965443:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965452:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965458:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788361731.965480:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965490:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139917600/0x1b69fa8920fe39b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe39b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965507:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965522:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965527:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965538:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965544:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe3dae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3db5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965554:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965561:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965565:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965575:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965580:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c20c00/0x1b69fa8920fe3dbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3dc3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965591:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965598:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965604:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965616:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965621:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012ea800/0x1b69fa8920fe3dca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3dd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965644:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965651:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965658:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965671:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965679:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c20200/0x1b69fa8920fe3dd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965690:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965697:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965702:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965713:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965717:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012eae00/0x1b69fa8920fe3de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965731:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965739:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965745:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965759:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965766:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004308c00/0x1b69fa8920fe3df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3dfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965778:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965784:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965790:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965798:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965804:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe3e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965844:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965852:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965858:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965867:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965871:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207c400/0x1b69fa8920fe3924 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe392b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965887:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965894:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965909:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361731.965925:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965931:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207c600/0x1b69fa8920fe3940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3947 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965945:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965953:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965959:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361731.965968:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.965973:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d100030c00/0x1b69fa8920fe394e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe3955 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.965985:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.965992:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.965997:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361731.966004:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.966008:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207d200/0x1b69fa8920fe3978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe397f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.966018:0:94201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361731.966036:0:94201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.966042:0:94201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361731.966050:0:94201:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788361731.966056:0:94201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00207de00/0x1b69fa8920fe39a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x1b69fa8920fe39a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361731.966076:0:94201:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99d1054f2000 already not connected (conn 52, was 0): DISCONN 00000100:00080000:3.0:1788361731.966081:0:94201:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361731.966100:0:94201:0:(import.c:510:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 2738 00000100:00080000:3.0:1788361731.966109:0:94201:0:(import.c:624:import_select_connection()) MGC192.168.204.135@tcp: import ffff99d1054f2000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361731.966138:0:94201:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117281180 x1875230429879296/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361731.966161:0:94201:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788361731.966778:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429879296:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788361731.966888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361731.966926:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879296 00000100:00100000:0.0:1788361731.966939:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879296 00000100:00100000:0.0:1788361731.966975:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361731.966983:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875230429879296:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788361731.967006:0:94207:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo t0 exp 0000000000000000 cur 2771 last 0 00000020:00000080:0.0:1788361731.967024:0:94207:0:(genops.c:1406:class_connect()) connect: client c8a6f36d-efb9-41cf-af98-5917323f2b0d, cookie 0x1b69fa8920fe40b0 00000100:00080000:0.0:1788361731.967108:0:94207:0:(import.c:65:import_set_state_nolock()) ffff99d007452800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361731.967152:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:3649:x1875230429879296:12345-0@lo:250:mount.lustre.0 Request processed in 170us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361731.967157:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361731.967183:0:3649:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 29 00000100:00080000:2.0:1788361731.967191:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361731.967197:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361731.967201:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361731.967205:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d1054f2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361731.967207:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361731.967235:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361731.967249:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3649:1875230429879296:0@lo:250:mount.lustre.0 00000020:01000000:0.0:1788361731.967287:0:85876:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.135@tcp 10000000:01000000:0.0:1788361731.967305:0:85876:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788361731.967308:0:85876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788361731.967310:0:85876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361731.967311:0:85876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361731.967312:0:85876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361731.967313:0:85876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361731.967314:0:85876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361731.967315:0:85876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361731.967317:0:85876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361731.967319:0:85876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788361731.967351:0:85876:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788361731.967359:0:85876:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788361731.967361:0:85876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788361731.967363:0:85876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361731.967364:0:85876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361731.967365:0:85876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361731.967367:0:85876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361731.967368:0:85876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361731.967370:0:85876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:3.0:1788361731.967373:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429879424:0@lo:253:kworker.0 00000020:01000004:0.0:1788361731.967373:0:85876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361731.967375:0:85876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788361731.967407:0:85876:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788361731.967415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788361731.967417:0:85876:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788361731.967421:0:85876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788361731.967429:0:85876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788361731.967431:0:85876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361731.967433:0:85876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361731.967434:0:85876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361731.967436:0:85876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361731.967437:0:85876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361731.967439:0:85876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361731.967440:0:85876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788361731.967444:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429879552:0@lo:253:kworker.0 00000020:01000000:0.0:1788361731.967458:0:85876:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788361731.967485:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429879680:0@lo:253:kworker.0 00000100:00100000:2.0:1788361731.967502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361731.967524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361731.967536:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879424 00000100:00100000:3.0:1788361731.967541:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879424 00000100:00100000:2.0:1788361731.967558:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879552 00000100:00100000:0.0:1788361731.967564:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879680 00000100:00100000:2.0:1788361731.967565:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879552 00000100:00100000:3.0:1788361731.967570:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361731.967571:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879680 00000100:00100000:3.0:1788361731.967582:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3653:x1875230429879424:12345-0@lo:253:kworker.0 00000100:00100000:2.0:1788361731.967596:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 20000000:01000000:3.0:1788361731.967604:0:94208:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:1.0:1788361731.967648:0:94201:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788361731.967658:0:94201:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788361731.967689:0:94201:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788361731.967693:0:94201:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788361731.967786:0:94201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788361731.967805:0:94210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:1.0:1788361731.967805:0:94201:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788361731.967808:0:94201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361731.967811:0:94201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361731.967812:0:94201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361731.967813:0:94201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361731.967814:0:94201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361731.967815:0:94201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361731.967816:0:94201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361731.967817:0:94201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361731.967818:0:94201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361731.967819:0:94201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361731.967838:0:94201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788361731.967840:0:94201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361731.967841:0:94201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361731.967842:0:94201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361731.967843:0:94201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361731.967844:0:94201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361731.967845:0:94201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361731.967845:0:94201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361731.967846:0:94201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361731.967847:0:94201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361731.967847:0:94201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361731.967858:0:94201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788361731.967875:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429879808:0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361731.967888:0:94208:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 123 00000100:00100000:1.0:1788361731.967910:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361731.967940:0:94207:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788361731.967945:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10adb4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361731.967948:0:94207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788361731.967982:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3650:x1875230429879552:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788361731.968002:0:94209:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788361731.968180:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879808 00000100:00100000:0.0:1788361731.968183:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879808 00000100:00100000:1.0:1788361731.968248:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361731.968255:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3651:x1875230429879680:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788361731.968269:0:94211:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361731.968654:0:94212:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788361731.968657:0:94212:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788361731.968659:0:94212:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788361731.968661:0:94212:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788361731.968670:0:94212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:3.0:1788361731.968766:0:94208:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361731.968783:0:94208:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788361731.970354:0:94208:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361731.970365:0:94208:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788361731.970393:0:94210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361731.970398:0:94210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361731.970416:0:94210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361731.970428:0:94209:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788361731.970429:0:94210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361731.970439:0:94210:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000042164s 00010000:00010000:0.0:1788361731.970443:0:94210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970449:0:94210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970453:0:94210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970466:0:94210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970471:0:94210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361731.970474:0:94210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970479:0:94210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970490:0:94210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970495:0:94210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.970499:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916200/0x1b69fa8920fe40b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361731.970671:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3653:x1875230429879424:12345-0@lo:253:kworker.0 Request processed in 3090us (3253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361731.970681:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1788361731.970700:0:3653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788361731.970704:0:3653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361731.970705:0:3653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361731.970707:0:3653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361731.970709:0:3653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361731.970711:0:3653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361731.970712:0:3653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361731.970715:0:3653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361731.970716:0:3653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361731.970721:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361731.970722:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429879424:0@lo:253:kworker.0 00000100:00100000:3.0:1788361731.970732:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:94201:x1875230429879808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361731.970762:0:94208:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361731.970765:0:94208:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788361731.970767:0:94208:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788361731.970774:0:94208:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788361731.972663:0:94209:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361731.972675:0:94209:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788361731.972689:0:94211:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361731.972700:0:94210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361731.972705:0:94210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361731.972724:0:94210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972742:0:94210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361731.972752:0:94210:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000047387s 00010000:00010000:0.0:1788361731.972756:0:94210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972778:0:94210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972785:0:94210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972793:0:94210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972799:0:94210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361731.972803:0:94210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972811:0:94210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972841:0:94210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972849:0:94210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361731.972856:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe40be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361731.972897:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:94201:x1875230429879808:12345-0@lo:253:mount.lustre.0 Request processed in 2164us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361731.972907:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361731.973018:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429879808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361731.973029:0:94201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788361731.973032:0:94201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361731.973034:0:94201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361731.973035:0:94201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361731.973036:0:94201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361731.973037:0:94201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361731.973038:0:94201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361731.973039:0:94201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361731.973041:0:94201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361731.973042:0:94201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361731.973044:0:94201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788361731.973071:0:94201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d1042fb800 from lustre-MDT0000 10000000:01000000:1.0:1788361731.973099:0:94201:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788361731.973102:0:94201:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788361731.973110:0:94201:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d1042fb800 10000000:01000000:1.0:1788361731.973119:0:94201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788361731.973125:0:94201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99d1042fb800 10000000:01000000:1.0:1788361731.973127:0:94201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788361731.973130:0:94201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d1042fb800 from 1 10000000:01000000:1.0:1788361731.973133:0:94201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788361731.973159:0:94201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.973168:0:94201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.973195:0:94201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361731.973213:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429879936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361731.973243:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361731.973292:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10adb49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361731.973296:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429879936 00000100:00100000:2.0:1788361731.973303:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429879936 00000100:00100000:1.0:1788361731.973343:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:3650:x1875230429879552:12345-0@lo:253:kworker.0 Request processed in 5739us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361731.973352:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361731.973361:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:94201:x1875230429879936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361731.973373:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361731.973388:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c21000/0x1b69fa8920fe40cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe40c5 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361731.973399:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788361731.973401:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361731.973403:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361731.973404:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361731.973407:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:2.0:1788361731.973407:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c21000/0x1b69fa8920fe40cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe40c5 expref: 8 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361731.973410:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361731.973412:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361731.973415:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361731.973417:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788361731.973420:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429879552:0@lo:253:kworker.0 00010000:00010000:2.0:1788361731.973437:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c21000/0x1b69fa8920fe40cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe40c5 expref: 8 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361731.973445:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21000, rc 0) 00000100:00100000:2.0:1788361731.973488:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94201:x1875230429879936:12345-0@lo:101:mount.lustre.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361731.973543:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429879936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361731.973556:0:94201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe40cc expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.973565:0:94201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe40cc expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.973575:0:94201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788361731.973591:0:94201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe40cc expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.973599:0:94201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012ebc00/0x1b69fa8920fe40c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe40cc expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361731.973605:0:94201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361731.973608:0:94201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361731.973612:0:94201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d1042fb800 10000000:01000000:3.0:1788361731.973616:0:94201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788361731.973618:0:94201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788361731.973620:0:94201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361731.973634:0:94201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.973640:0:94201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.973646:0:94201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361731.973657:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429880064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361731.973681:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361731.973688:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d92840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361731.973735:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361731.973742:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361731.973761:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880064 00000100:00100000:1.0:1788361731.973766:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880064 00000100:00100000:1.0:1788361731.973792:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361731.973800:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:94201:x1875230429880064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361731.973807:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361731.973818:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe40d3 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.973850:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 8 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.973870:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 8 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.973877:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eba00, rc 0) 00000100:00100000:1.0:1788361731.975349:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94201:x1875230429880064:12345-0@lo:101:mount.lustre.0 Request processed in 1545us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.975357:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361731.975417:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429880064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361731.975436:0:94201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361731.975447:0:94201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361731.975522:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429880192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361731.975552:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361731.975577:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d92840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361731.975613:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880192 00000100:00100000:2.0:1788361731.975619:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880192 00000100:00100000:2.0:1788361731.975654:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361731.975660:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94201:x1875230429880192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361731.975794:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429880192:12345-0@lo:501:mount.lustre.0 Request processed in 133us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361731.975811:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429880192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361731.975817:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361731.975862:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429880320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361731.975894:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361731.975907:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d92840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361731.976064:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880320 00000100:00100000:1.0:1788361731.976068:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880320 00000100:00100000:1.0:1788361731.976088:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361731.976093:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429880320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361731.976170:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429880320:12345-0@lo:503:mount.lustre.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.976182:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361731.976200:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429880320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361731.976435:0:94213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94213:1875230429880448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361731.976461:0:94213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1788361731.976464:0:94211:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361731.976480:0:94211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788361731.976488:0:94210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361731.976494:0:94210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361731.976512:0:94210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361731.976514:0:94213:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d920c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788361731.976527:0:94210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361731.976537:0:94210:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000047387s 00010000:00010000:1.0:1788361731.976541:0:94210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.976548:0:94210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361731.976548:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880448 00000100:00100000:0.0:1788361731.976553:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880448 00010000:00010000:1.0:1788361731.976571:0:94210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.976580:0:94210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361731.976584:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361731.976592:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94213:x1875230429880448:12345-0@lo:502:llog_process_th.0 00010000:00010000:1.0:1788361731.976593:0:94210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361731.976600:0:94210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.976609:0:94210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.976621:0:94210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.976628:0:94210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361731.976635:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb400/0x1b69fa8920fe40e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361731.976724:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:3651:x1875230429879680:12345-0@lo:253:kworker.0 Request processed in 8470us (9202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361731.976729:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1788361731.976778:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788361731.976804:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788361731.976806:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361731.976807:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361731.976807:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361731.976809:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361731.976809:0:3651:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361731.976810:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361731.976811:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788361731.976813:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429879680:0@lo:253:kworker.0 00000100:00100000:2.0:1788361731.976969:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94213:x1875230429880448:12345-0@lo:502:llog_process_th.0 Request processed in 377us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361731.976974:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361731.977012:0:94213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94213:1875230429880448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361731.977027:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361731.977034:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361731.977036:0:94213:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361731.977042:0:94213:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788361731.977044:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361731.977054:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d001c60000) 00000020:00000080:3.0:1788361731.977121:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788361731.977126:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788361731.977191:0:94213:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788361731.977200:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe40ef 00000020:00000080:3.0:1788361731.977364:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361731.977367:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361731.977369:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361731.977371:0:94213:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361731.977373:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361731.977375:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361731.977376:0:94213:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788361731.977378:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361731.977383:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d001c619c0) 00000020:00000080:3.0:1788361731.977390:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788361731.977392:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788361731.977394:0:94213:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788361731.977396:0:94213:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788361731.977399:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788361731.977430:0:94213:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d1042fb800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788361731.977439:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d006a04d40) 00000020:00000080:3.0:1788361731.977445:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788361731.977479:0:94213:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788361731.977482:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe4104 00000020:00000080:3.0:1788361731.977562:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788361731.977566:0:94213:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788361731.977569:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b69fa8920fe410b 00080000:01000000:3.0:1788361731.977572:0:94213:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788361731.977574:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe4112 00010000:00010000:3.0:1788361732.014432:0:94213:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788361732.014574:0:94213:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116997 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:3.0:1788361732.014612:0:94213:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f1e400d1-472b-42d1-b5e7-e80dc701272a idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:3.0:1788361732.014632:0:94213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:3.0:1788361732.014730:0:94213:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788361732.014782:0:94213:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d117862900: xid 1875230407033344, transno 120259084293, client gen 24, slot idx 0 00000001:00080000:3.0:1788361732.014797:0:94213:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d1178620c0: xid 1875230429870336, transno 120259084297, client gen 22, slot idx 1 00000001:00080000:3.0:1788361732.014803:0:94213:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d1066a2000: xid 1875230429870592, transno 120259084298, client gen 22, slot idx 2 00000001:00080000:3.0:1788361732.014807:0:94213:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d1066a2600: xid 1875230429867008, transno 120259084294, client gen 22, slot idx 3 00000020:00000080:3.0:1788361732.015256:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d006a03380) 00000020:00000080:3.0:1788361732.015288:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788361732.015362:0:94213:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788361732.015371:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe412e 00000020:00000080:3.0:1788361732.016010:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361732.020142:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b69fa8920fe4135 00000020:00000080:3.0:1788361732.021387:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788361732.021400:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361732.021407:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.021409:0:94213:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788361732.021412:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361732.021415:0:94213:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788361732.021416:0:94213:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361732.021418:0:94213:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361732.021419:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361732.021422:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.021424:0:94213:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361732.021427:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361732.021432:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.021434:0:94213:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788361732.021438:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788361732.021487:0:94213:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788361732.021504:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361732.021507:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.021508:0:94213:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788361732.021510:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361732.021513:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.021515:0:94213:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788361732.021517:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361732.021529:0:94213:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:3.0:1788361732.021555:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361732.021572:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d006a00000) 00000020:00000080:3.0:1788361732.021592:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788361732.021597:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361732.021658:0:94213:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788361732.021663:0:94213:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788361732.021669:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe4143 00010000:00080000:3.0:1788361732.021699:0:94213:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d12c4e1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361732.024756:0:94213:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788361732.025494:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361732.025506:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788361732.025545:0:94213:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788361732.025569:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe414a 00000100:00080000:0.0:1788361732.025579:0:94213:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361732.025583:0:94213:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99d12c4e1000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361732.025612:0:94213:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d141098e00 x1875230429880576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361732.025633:0:94213:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788361732.025683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429880576:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788361732.025701:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361732.025707:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.025709:0:94213:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788361732.025713:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361732.025716:0:94213:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788361732.025718:0:94213:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361732.025720:0:94213:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361732.025721:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361732.025725:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.025726:0:94213:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361732.025729:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361732.025734:0:94213:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788361732.025737:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.025738:0:94213:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788361732.025746:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361732.025750:0:94213:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000100:00100000:2.0:1788361732.025760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788361732.025767:0:94213:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788361732.025770:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361732.025779:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d1053199c0) 00000020:00000080:0.0:1788361732.025803:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788361732.025809:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788361732.025849:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880576 00000100:00100000:2.0:1788361732.025856:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880576 00000100:00100000:2.0:1788361732.025890:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4212 00000100:00100000:2.0:1788361732.025897:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429880576:12345-0@lo:38:llog_process_th.0 00000004:00080000:0.0:1788361732.025914:0:94213:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788361732.025921:0:94213:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788361732.025927:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe4158 00010000:00080000:0.0:1788361732.025962:0:94213:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d005034000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00080000:2.0:1788361732.025991:0:23939:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2772 last 0 00000100:00080000:1.0:1788361732.025994:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361732.026000:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361732.026006:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361732.026013:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2769 00000100:00080000:1.0:1788361732.026018:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788361732.026024:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361732.026041:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d00a24ed80 x1875230429880832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1788361732.026044:0:23939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe415f 00000004:00100000:2.0:1788361732.026063:0:23939:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788361732.026085:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361732.026089:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361732.026091:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361732.026097:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2769 00000100:00080000:1.0:1788361732.026100:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1788361732.026107:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429880704:0@lo:400:kworker.0 00000100:00080000:1.0:1788361732.026107:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361732.026125:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d00a24df80 x1875230429881088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361732.026161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361732.026176:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361732.026180:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361732.026183:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788361732.026186:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788361732.026188:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2769 00000100:00080000:2.0:1788361732.026192:0:23939:0:(import.c:65:import_set_state_nolock()) ffff99d002ffb800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788361732.026193:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788361732.026200:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429881216:0@lo:400:kworker.0 00000100:00080000:1.0:1788361732.026202:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361732.026213:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361732.026224:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429880960:0@lo:400:kworker.0 00000100:00100000:1.0:1788361732.026227:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1012ad180 x1875230429881344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361732.026251:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.026256:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429880576:12345-0@lo:38:llog_process_th.0 Request processed in 355us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.026266:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4212 00000100:00080000:1.0:1788361732.026274:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361732.026290:0:85876:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788361732.026293:0:85876:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361732.026299:0:85876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2769 00000100:00100000:3.0:1788361732.026304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361732.026305:0:85876:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788361732.026308:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429881472:0@lo:400:kworker.0 00000100:00080000:1.0:1788361732.026314:0:85876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361732.026334:0:85876:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1172a7800 x1875230429881728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361732.026339:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881216 00000100:00100000:2.0:1788361732.026345:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881216 00000100:00100000:3.0:1788361732.026353:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429881600:0@lo:400:kworker.0 00000100:00100000:0.0:1788361732.026353:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361732.026392:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.026412:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880960 00000100:00100000:2.0:1788361732.026416:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880960 00000100:00100000:0.0:1788361732.026416:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881472 00000100:00100000:0.0:1788361732.026424:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881472 00000100:00100000:1.0:1788361732.026425:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880704 00000100:00100000:1.0:1788361732.026431:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880704 00000100:00100000:2.0:1788361732.026451:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1788361732.026461:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429881216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361732.026472:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1788361732.026476:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881600 00000100:00100000:1.0:1788361732.026479:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361732.026481:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881600 00000100:00100000:3.0:1788361732.026487:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429880960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361732.026493:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3652:x1875230429880704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361732.026511:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429881216:12345-0@lo:400:kworker.0 Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.026520:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1788361732.026520:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1788361732.026535:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361732.026557:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429880960:12345-0@lo:400:kworker.0 Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.026566:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1788361732.026573:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:3652:x1875230429880704:12345-0@lo:400:kworker.0 Request processed in 84us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.026579:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429881216:0@lo:400:kworker.0 00000100:00100000:1.0:1788361732.026587:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361732.026588:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429881472:12345-0@lo:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.026599:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1788361732.026615:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429880960:0@lo:400:kworker.0 00000100:00100000:2.0:1788361732.026616:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429881472:0@lo:400:kworker.0 00000100:00100000:0.0:1788361732.026621:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:0.0:1788361732.026633:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429881600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361732.026635:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361732.026641:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361732.026644:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429880704:0@lo:400:kworker.0 00000100:00080000:1.0:1788361732.026646:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361732.026663:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429881600:12345-0@lo:400:kworker.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361732.026678:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429880832:0@lo:38:kworker.0 00000100:00100000:3.0:1788361732.026680:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429881600:0@lo:400:kworker.0 00000100:00100000:0.0:1788361732.026692:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1788361732.026712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.026753:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429881088:0@lo:38:kworker.0 00010000:00010000:0.0:1788361732.026760:0:94213:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788361732.026782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.026810:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429881344:0@lo:38:kworker.0 00000100:00100000:1.0:1788361732.026859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.026872:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429881728:0@lo:38:kworker.0 00000100:00100000:1.0:1788361732.026885:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.026918:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361732.026926:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788361732.026932:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788361732.026937:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788361732.026939:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d12c4e1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788361732.026952:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429880576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361732.026975:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429880832 00000100:00100000:2.0:1788361732.026980:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429880832 00000100:00100000:1.0:1788361732.026986:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881344 00000100:00100000:1.0:1788361732.026999:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881344 00000100:00100000:2.0:1788361732.027004:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881088 00000100:00100000:2.0:1788361732.027009:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881088 00000100:00100000:1.0:1788361732.027030:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4213 00000100:00100000:2.0:1788361732.027031:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881728 00000100:00100000:2.0:1788361732.027036:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881728 00000100:00100000:1.0:1788361732.027037:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429881344:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361732.027062:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1788361732.027071:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1788361732.027072:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429880832:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788361732.027080:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429881088:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788361732.027089:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429881344:12345-0@lo:38:kworker.0 Request processed in 51us (229us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361732.027097:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4213 00000100:00100000:0.0:1788361732.027126:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875230429880832:12345-0@lo:38:kworker.0 Request processed in 53us (412us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788361732.027136:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429881088:12345-0@lo:38:kworker.0 Request processed in 55us (353us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361732.027136:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1788361732.027148:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429881728:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361732.027152:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1788361732.027161:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1788361732.027195:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429881728:12345-0@lo:38:kworker.0 Request processed in 46us (305us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361732.027204:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00080000:1.0:1788361732.027240:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788361732.027243:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788361732.027247:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361732.027252:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429880832:0@lo:38:kworker.0 00000100:00100000:0.0:1788361732.027253:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429881856:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788361732.027273:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361732.027288:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361732.027292:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429881088:0@lo:38:kworker.0 00000100:00100000:0.0:1788361732.027299:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361732.027309:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361732.027314:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361732.027317:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429881344:0@lo:38:kworker.0 00000100:00080000:1.0:1788361732.027330:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361732.027334:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361732.027338:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1172a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429881728:0@lo:38:kworker.0 00000100:00100000:2.0:1788361732.027394:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881856 00000100:00100000:2.0:1788361732.027401:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881856 00000100:00100000:2.0:1788361732.027436:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4214 00000100:00100000:2.0:1788361732.027447:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429881856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361732.027471:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361732.027516:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429881856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.027523:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4214 00000100:00100000:0.0:1788361732.027599:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429881856:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1788361732.027642:0:94213:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361732.027665:0:94213:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361732.027920:0:94213:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1788361732.028489:0:94213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361732.028519:0:94213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:2.0:1788361732.032586:0:94213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000040:00080000:2.0:1788361732.033111:0:94219:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:2.0:1788361732.033116:0:94219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788361732.033325:0:94219:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:2.0:1788361732.033344:0:94219:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788361732.033474:0:94219:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:2.0:1788361732.033477:0:94219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788361732.034107:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361732.034119:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788361732.034429:0:94213:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788361732.034454:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe4166 00000100:00080000:0.0:1788361732.034465:0:94213:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361732.034471:0:94213:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d005034000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361732.034511:0:94213:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d141098e00 x1875230429881984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361732.034544:0:94213:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788361732.034611:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361732.034616:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.034619:0:94213:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788361732.034622:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361732.034625:0:94213:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788361732.034627:0:94213:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361732.034628:0:94213:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361732.034636:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361732.034638:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.034640:0:94213:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361732.034643:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361732.034647:0:94213:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788361732.034650:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.034651:0:94213:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788361732.034653:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361732.034657:0:94213:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:0.0:1788361732.034678:0:94213:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788361732.034680:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361732.034691:0:94213:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99d10531b380) 00000020:00000080:0.0:1788361732.034707:0:94213:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788361732.034711:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788361732.034781:0:94213:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788361732.034787:0:94213:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788361732.034792:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b69fa8920fe4174 00010000:00080000:0.0:1788361732.034941:0:94213:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d117299000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788361732.035112:0:94213:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1788361732.035194:0:94213:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788361732.035211:0:94213:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788361732.035501:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429881984:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788361732.035573:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.035687:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429881984 00000100:00100000:2.0:1788361732.035695:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429881984 00000100:00100000:2.0:1788361732.035734:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4930 00000100:00100000:2.0:1788361732.035741:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3649:x1875230429881984:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788361732.035771:0:26160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2772 last 0 00000020:00000080:2.0:1788361732.035792:0:26160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe417b 00002000:00100000:2.0:1788361732.035806:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d002ffe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788361732.035810:0:26160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788361732.035837:0:26160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788361732.035896:0:26160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361732.035919:0:26160:0:(import.c:65:import_set_state_nolock()) ffff99d002ffc800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788361732.035952:0:94213:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000100:00100000:2.0:1788361732.035979:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429881984:12345-0@lo:8:llog_process_th.0 Request processed in 238us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.035987:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4930 00000100:00100000:0.0:1788361732.036091:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361732.036101:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788361732.036109:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361732.036115:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788361732.036118:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788361732.036146:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361732.036152:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429881984:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788361732.036209:0:94219:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788361732.036252:0:94219:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2772045428758ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788361732.036258:0:94219:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788361732.036495:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429882112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361732.036530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361732.036609:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882112 00000100:00100000:0.0:1788361732.036613:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882112 00000100:00100000:0.0:1788361732.036670:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1788361732.036678:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429882112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361732.036698:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788361732.036731:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361732.036794:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429882112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.036801:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:1.0:1788361732.036817:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429882112:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788361732.037041:0:94213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361732.037068:0:94213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:2.0:1788361732.037189:0:94213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000040:00080000:2.0:1788361732.037691:0:94221:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:2.0:1788361732.037696:0:94221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788361732.037814:0:94221:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:2.0:1788361732.037862:0:94221:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788361732.037942:0:94202:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1788361732.037997:0:94221:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:2.0:1788361732.038001:0:94221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788361732.038451:0:94213:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361732.038477:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788361732.038514:0:94213:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788361732.038538:0:94213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe4182 00000100:00080000:0.0:1788361732.038547:0:94213:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361732.038552:0:94213:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d117299000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788361732.038581:0:94213:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d141098e00 x1875230429882240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361732.038609:0:94213:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788361732.038666:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429882240:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1788361732.038676:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361732.038681:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.038683:0:94213:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788361732.038687:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361732.038692:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.038694:0:94213:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788361732.038699:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788361732.038701:0:94213:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788361732.038704:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361732.038708:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.038710:0:94213:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788361732.038712:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361732.038716:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.038718:0:94213:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788361732.038722:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788361732.038733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788361732.038736:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361732.038741:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.038742:0:94213:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000020:01000000:0.0:1788361732.038745:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361732.038748:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.038750:0:94213:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:0.0:1788361732.038753:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1788361732.038796:0:94213:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1788361732.038923:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882240 00000100:00100000:3.0:1788361732.038930:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882240 00000100:00100000:3.0:1788361732.038970:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:3.0:1788361732.038978:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875230429882240:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788361732.039004:0:26167:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2772 last 0 00000020:00000080:3.0:1788361732.039026:0:26167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b69fa8920fe4189 00002000:00100000:3.0:1788361732.039040:0:26167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d00541d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788361732.039044:0:26167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788361732.039048:0:26167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788361732.039105:0:26167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361732.039127:0:26167:0:(import.c:65:import_set_state_nolock()) ffff99d00541e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361732.039215:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3649:x1875230429882240:12345-0@lo:8:llog_process_th.0 Request processed in 236us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.039223:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00000100:00100000:1.0:1788361732.039272:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361732.039291:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788361732.039298:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361732.039303:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788361732.039305:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d117299000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361732.039356:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361732.039362:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429882240:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788361732.039448:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429882368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361732.039489:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788361732.039553:0:94221:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788361732.039600:0:94221:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2772048776151ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788361732.039608:0:94221:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788361732.039630:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882368 00000100:00100000:1.0:1788361732.039635:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882368 00000100:00100000:0.0:1788361732.039647:0:94213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94213:1875230429882496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361732.039693:0:94213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361732.039719:0:94213:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.039910:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882496 00000100:00100000:3.0:1788361732.039915:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882496 00000100:00100000:3.0:1788361732.039952:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361732.039960:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94213:x1875230429882496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.040048:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94213:x1875230429882496:12345-0@lo:502:llog_process_th.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.040055:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361732.040162:0:94213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94213:1875230429882496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361732.040178:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000020:01000000:0.0:1788361732.040187:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788361732.040188:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429882368:12345-0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788361732.040195:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.040198:0:94213:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:0.0:1788361732.040203:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361732.040208:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.040210:0:94213:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00002000:00000024:1.0:1788361732.040211:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000020:00000080:0.0:1788361732.040214:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1788361732.040226:0:94213:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1788361732.040255:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429882368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361732.040263:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1788361732.040327:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429882368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361732.040752:0:94213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94213:1875230429882624:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788361732.040768:0:94223:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d1042fb800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361732.040773:0:94223:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d1042fb800 4 00000100:00100000:0.0:1788361732.040790:0:94213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361732.040818:0:94213:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0540 going to sleep for 11 seconds 00000100:00080000:2.0:1788361732.040850:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361732.040906:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882624 00000100:00100000:3.0:1788361732.040912:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882624 00000100:00100000:3.0:1788361732.040946:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361732.040953:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94213:x1875230429882624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.041029:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94213:x1875230429882624:12345-0@lo:502:llog_process_th.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.041042:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361732.041239:0:94213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94213:1875230429882624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361732.041261:0:94213:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000004:00080000:1.0:1788361732.041262:0:94202:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:00000080:0.0:1788361732.041266:0:94213:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361732.041268:0:94213:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788361732.041275:0:94213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1788361732.041440:0:94201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:3.0:1788361732.041481:0:94201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788361732.041504:0:94201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.041517:0:94201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361732.041525:0:94201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d1042fb800 from 1 10000000:01000000:3.0:1788361732.041529:0:94201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361732.041553:0:94201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.041561:0:94201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.041569:0:94201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361732.041581:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429882752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361732.041608:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361732.041635:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361732.041660:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882752 00000100:00100000:0.0:1788361732.041671:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882752 00000100:00100000:0.0:1788361732.041708:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361732.041715:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:94201:x1875230429882752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361732.041725:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361732.041738:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4190 expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.041759:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.041769:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.041777:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916e00, rc 0) 00000100:00100000:0.0:1788361732.041841:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429882752:12345-0@lo:101:mount.lustre.0 Request processed in 108us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.041848:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361732.041992:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429882752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361732.042006:0:94201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.042015:0:94201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361732.042602:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429882880:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788361732.042654:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.042689:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.043772:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429882880 00000100:00100000:3.0:1788361732.043786:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429882880 00000100:00100000:3.0:1788361732.043866:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361732.043880:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429882880:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788361732.043906:0:94207:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788361732.043937:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788361732.043941:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788361732.043945:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788361732.043947:0:94207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 126 00000100:00100000:3.0:1788361732.044353:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429882880:12345-0@lo:256:mount.lustre.0 Request processed in 476us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.044363:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361732.044490:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429882880:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788361732.045375:0:94201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361732.045392:0:94201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.045402:0:94201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361732.045411:0:94201:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d1042fb800 from 1 10000000:01000000:1.0:1788361732.045413:0:94201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361732.045442:0:94201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.045448:0:94201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.045454:0:94201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361732.045480:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361732.045516:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.045603:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361732.045632:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883008 00000100:00100000:2.0:1788361732.045638:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883008 00000100:00100000:2.0:1788361732.045676:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361732.045684:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+9:94201:x1875230429883008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361732.045697:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361732.045718:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe41a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe419e expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.045742:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe41a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe419e expref: 10 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.045754:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe41a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe419e expref: 10 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.045764:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21400, rc 0) 00000100:00100000:2.0:1788361732.045802:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94201:x1875230429883008:12345-0@lo:101:mount.lustre.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.045809:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361732.045874:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361732.045888:0:94201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41a5 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.045896:0:94201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe41a5 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361732.045954:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361732.045979:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.046009:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361732.046106:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883136 00000100:00100000:2.0:1788361732.046111:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883136 00000100:00100000:2.0:1788361732.046175:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361732.046183:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94201:x1875230429883136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361732.046332:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94201:x1875230429883136:12345-0@lo:501:mount.lustre.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.046339:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361732.046390:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361732.046417:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361732.046457:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.046994:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a1369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.047056:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883264 00000100:00100000:3.0:1788361732.047063:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883264 00000100:00100000:3.0:1788361732.047098:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361732.047108:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94201:x1875230429883264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361732.047215:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94201:x1875230429883264:12345-0@lo:503:mount.lustre.0 Request processed in 108us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.047225:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361732.047242:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361732.047851:0:94224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94224:1875230429883392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.047967:0:94224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361732.047999:0:94224:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10ad90240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361732.048096:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883392 00000100:00100000:0.0:1788361732.048102:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883392 00000100:00100000:0.0:1788361732.048145:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361732.048156:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94224:x1875230429883392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361732.049015:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94224:x1875230429883392:12345-0@lo:502:llog_process_th.0 Request processed in 861us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.049025:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361732.049054:0:94224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94224:1875230429883392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361732.049083:0:94224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361732.049093:0:94224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.049096:0:94224:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788361732.049102:0:94224:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d1042fb800 00000020:00000080:3.0:1788361732.049105:0:94224:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361732.049115:0:94224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361732.049118:0:94224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.049120:0:94224:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788361732.049122:0:94224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361732.049124:0:94224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.049125:0:94224:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788361732.049137:0:94224:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d1042fb800 00000020:00000080:3.0:1788361732.049139:0:94224:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788361732.049219:0:94224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94224:1875230429883520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.049263:0:94224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361732.049316:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883520 00000100:00100000:3.0:1788361732.049318:0:94224:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10ad90240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361732.049322:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883520 00000100:00100000:0.0:1788361732.049369:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361732.049377:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94224:x1875230429883520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361732.049458:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94224:x1875230429883520:12345-0@lo:502:llog_process_th.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.049467:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361732.049489:0:94224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94224:1875230429883520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361732.049510:0:94224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361732.049515:0:94224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361732.049517:0:94224:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788361732.049521:0:94224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788361732.049859:0:94201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788361732.049889:0:94201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361732.049911:0:94201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41a5 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.049923:0:94201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41a5 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361732.049987:0:94201:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361732.049991:0:94201:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d1042fb800 10000000:01000000:1.0:1788361732.049994:0:94201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d1042fb800 10000000:01000000:1.0:1788361732.049998:0:94201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361732.050004:0:94201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d1042fb800 from 1 10000000:01000000:1.0:1788361732.050006:0:94201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361732.050032:0:94201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.050041:0:94201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.050103:0:94201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361732.050116:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361732.050143:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.050166:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.050389:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883648 00000100:00100000:3.0:1788361732.050394:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883648 00000100:00100000:3.0:1788361732.050434:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361732.050443:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:94201:x1875230429883648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361732.050455:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361732.050473:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe41ac expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.050499:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 11 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.050510:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 11 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.050519:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309400, rc 0) 00000100:00100000:3.0:1788361732.050562:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429883648:12345-0@lo:101:mount.lustre.0 Request processed in 122us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.050569:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361732.050877:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361732.050891:0:94201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.050900:0:94201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361732.050950:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361732.050976:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.051010:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.051018:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883776 00000100:00100000:3.0:1788361732.051030:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883776 00000100:00100000:3.0:1788361732.051066:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361732.051073:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429883776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361732.051195:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429883776:12345-0@lo:501:mount.lustre.0 Request processed in 122us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.051203:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361732.051239:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361732.051266:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361732.051314:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.051332:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361732.051444:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429883904 00000100:00100000:0.0:1788361732.051449:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429883904 00000100:00100000:0.0:1788361732.051484:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361732.051492:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429883904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361732.051581:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429883904:12345-0@lo:503:mount.lustre.0 Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.051589:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361732.051597:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429883904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361732.053217:0:94226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94226:1875230429884032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361732.053301:0:94226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.053344:0:94226:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.053399:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884032 00000100:00100000:3.0:1788361732.053405:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884032 00000100:00100000:3.0:1788361732.053489:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361732.053498:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94226:x1875230429884032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.053622:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94226:x1875230429884032:12345-0@lo:502:llog_process_th.0 Request processed in 125us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.053630:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788361732.053682:0:94226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94226:1875230429884032:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788361732.053729:0:94226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788361732.053741:0:94226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99d0042e0000) 00000020:00000080:2.0:1788361732.053770:0:94226:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788361732.054025:0:94226:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d1042fb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788361732.054045:0:94226:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d1042fb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788361732.054049:0:94226:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d1042fb800 4 00010000:00080000:2.0:1788361732.054094:0:94226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d10f55a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788361732.056133:0:94226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788361732.056257:0:94226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788361732.056315:0:94226:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788361732.056329:0:94226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b69fa8920fe41c1 00000100:00080000:2.0:1788361732.056340:0:94226:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361732.056346:0:94226:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d10f55a000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788361732.056389:0:94226:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d00a24ed80 x1875230429884160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361732.056413:0:94226:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788361732.056451:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429884160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361732.056525:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361732.056590:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884160 00000100:00100000:3.0:1788361732.056598:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884160 00000100:00100000:3.0:1788361732.056650:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1788361732.056658:0:94226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94226:1875230429884288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.056663:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429884160:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361732.056720:0:94226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361732.056732:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875230429884160:12345-0@lo:38:llog_process_th.0 Request processed in 70us (206us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361732.056740:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1788361732.056747:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884288 00000100:00100000:0.0:1788361732.056754:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884288 00000100:00100000:2.0:1788361732.056758:0:94226:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.056783:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361732.056793:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f55a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361732.056799:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361732.056803:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361732.056805:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429884160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361732.056817:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94226:x1875230429884288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361732.057065:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94226:x1875230429884288:12345-0@lo:502:llog_process_th.0 Request processed in 252us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361732.057073:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361732.057138:0:94226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94226:1875230429884288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361732.057186:0:94226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94226:1875230429884416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361732.057225:0:94226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.057260:0:94226:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361732.057554:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884416 00000100:00100000:3.0:1788361732.057559:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884416 00000100:00100000:3.0:1788361732.057598:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361732.057607:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94226:x1875230429884416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361732.057705:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94226:x1875230429884416:12345-0@lo:502:llog_process_th.0 Request processed in 100us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361732.057713:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361732.058200:0:94226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94226:1875230429884416:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788361732.058227:0:94226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1788361732.058343:0:94201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:3.0:1788361732.058374:0:94201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361732.058395:0:94201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361732.058408:0:94201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361732.058482:0:94201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788361732.058486:0:94201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361732.058487:0:94201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361732.058489:0:94201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361732.058490:0:94201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361732.058492:0:94201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361732.058494:0:94201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361732.058496:0:94201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361732.058498:0:94201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361732.058500:0:94201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361732.058505:0:94201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788361732.058508:0:94201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361732.058509:0:94201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361732.058511:0:94201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361732.058513:0:94201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361732.058515:0:94201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361732.058516:0:94201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361732.058517:0:94201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361732.058524:0:94201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361732.058525:0:94201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361732.058526:0:94201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361732.058545:0:94201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361732.058560:0:94201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429884544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361732.058668:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361732.058709:0:94201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10af8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361732.058719:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884544 00000100:00100000:1.0:1788361732.058725:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884544 00000100:00100000:1.0:1788361732.058768:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361732.058780:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429884544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361732.058804:0:94211:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788361732.058819:0:94211:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361732.061128:0:94211:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361732.061207:0:94211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788361732.061322:0:94210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361732.061327:0:94210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361732.061350:0:94210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.061368:0:94210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 11 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.061389:0:94210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.061428:0:94210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 11 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.061442:0:94210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 11 pid: 94208 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361732.061457:0:94210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429884672:0@lo:104: 00000100:00100000:0.0:1788361732.061614:0:94210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361732.061664:0:94210:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361732.061723:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884672 00000100:00100000:1.0:1788361732.061730:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884672 00000100:00100000:1.0:1788361732.061782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788361732.061792:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:94210:x1875230429884672:12345-0@lo:104: 00010000:00010000:1.0:1788361732.061807:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.062049:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361732.062057:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:94210:x1875230429884672:12345-0@lo:104: Request processed in 267us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361732.062075:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:1.0:1788361732.062101:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361732.062107:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.062115:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309a00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361732.062119:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.062127:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361732.062134:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361732.062141:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361732.062179:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.062186:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788361732.062225:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361732.062240:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429884800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361732.062242:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.062253:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe4190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4197 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361732.062270:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361732.062273:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361732.062282:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361732.062295:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361732.062345:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:94201:x1875230429884544:12345-0@lo:253:mount.lustre.0 Request processed in 3569us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.062349:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884800 00000100:00100000:2.0:1788361732.062354:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884800 00000100:00100000:1.0:1788361732.062364:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788361732.062382:0:9529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 11 pid: 94208 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361732.062418:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1788361732.062426:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3653:x1875230429884800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361732.062436:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361732.062448:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 11 pid: 94208 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062458:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 11 pid: 94208 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062475:0:9529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062483:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361732.062496:0:9529:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001169673s 00010000:00010000:2.0:1788361732.062501:0:9529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062508:0:9529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062516:0:9529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062523:0:9529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062528:0:9529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361732.062532:0:9529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062539:0:9529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062548:0:9529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361732.062564:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361732.062591:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:3653:x1875230429884800:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361732.062598:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1788361732.062636:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429884800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361732.062870:0:94201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:94201:1875230429884544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361732.062884:0:94201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361732.062889:0:94201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361732.062891:0:94201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361732.062893:0:94201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361732.062894:0:94201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361732.062903:0:94201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361732.062905:0:94201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361732.062907:0:94201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361732.062909:0:94201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361732.062912:0:94201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361732.062913:0:94201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788361732.062931:0:94201:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788361732.062964:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe4197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe4190 expref: 10 pid: 94208 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361732.062979:0:94210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d141098e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429884672:0@lo:104: 00010000:00010000:0.0:1788361732.062994:0:94210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.063005:0:94210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.063014:0:94210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361732.063021:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916200/0x1b69fa8920fe41c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788361732.075325:0:94201:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411366 00000040:01000000:3.0:1788361732.075688:0:94201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788361732.075719:0:94232:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411366 00000020:00080000:0.0:1788361732.075731:0:94232:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411366 00000040:01000000:0.0:1788361732.076191:0:94233:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788361732.076592:0:94233:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788361732.077754:0:94201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788361732.078234:0:94234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94234:1875230429884928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361732.078350:0:94234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.078395:0:94234:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361732.078668:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429884928 00000100:00100000:1.0:1788361732.078676:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429884928 00000100:00100000:1.0:1788361732.078730:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4215 00000100:00100000:1.0:1788361732.078741:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94234:x1875230429884928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788361732.078819:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94234:x1875230429884928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361732.078852:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4215 00000100:00100000:2.0:1788361732.078879:0:94234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94234:1875230429884928:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788361732.078906:0:94234:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788361732.078927:0:94234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94234:1875230429885056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361732.078949:0:94234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.078965:0:94234:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4a80 going to sleep for 11 seconds 00000040:00080000:0.0:1788361732.078965:0:94233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1788361732.078985:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885056 00000100:00100000:1.0:1788361732.078991:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885056 00000100:00100000:1.0:1788361732.079035:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4216 00000004:00080000:0.0:1788361732.079043:0:94233:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788361732.079045:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94234:x1875230429885056:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788361732.079126:0:94201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788361732.079166:0:94201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361732.079170:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94234:x1875230429885056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361732.079177:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4216 00000100:00100000:2.0:1788361732.079191:0:94234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94234:1875230429885056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361732.079238:0:94234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94234:1875230429885184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788361732.079263:0:94234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361732.079301:0:94234:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361732.079373:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885184 00000100:00100000:1.0:1788361732.079377:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885184 00000100:00100000:1.0:1788361732.079403:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4217 00000100:00100000:1.0:1788361732.079408:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94234:x1875230429885184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788361732.079457:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94234:x1875230429885184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361732.079463:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4217 00000100:00100000:2.0:1788361732.079505:0:94234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94234:1875230429885184:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788361732.079543:0:94234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788361732.079908:0:94201:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788361732.079915:0:94201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788361732.079949:0:94201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361732.084839:0:94201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788361732.085428:0:94201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788361732.085463:0:94201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788361732.085538:0:94234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1788361732.085579:0:94201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788361732.085603:0:94234:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788361732.085609:0:94234:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1788361732.086133:0:94201:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00010000:00080000:3.0:1788361732.088215:0:94201:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084298 00010000:00080000:1.0:1788361732.089742:0:94235:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94235 00010000:02000000:1.0:1788361732.089755:0:94235:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788361732.089759:0:94235:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788361732.089762:0:94235:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788361732.089839:0:94201:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788361732.089859:0:94201:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788361732.089882:0:94201:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788361732.089902:0:94201:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788361732.090989:0:94201:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788361732.091402:0:94201:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788361732.183129:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361733.206515:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788361733.462009:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361733.462017:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d1042fb800 from 127 10000000:01000000:3.0:1788361733.462023:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361733.462393:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.462407:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.462418:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361733.462449:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.462535:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361733.462581:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.462596:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885312 00000100:00100000:1.0:1788361733.462606:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885312 00000100:00100000:1.0:1788361733.462656:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788361733.462664:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+10:6520:x1875230429885312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.462677:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361733.462691:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe41cf expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.462714:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 11 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.462725:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 11 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.462735:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eac00, rc 0) 00000100:00100000:1.0:1788361733.462789:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429885312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.462797:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361733.463023:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.463040:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.463050:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.463101:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.463133:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.463158:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.463174:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885440 00000100:00100000:3.0:1788361733.463180:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885440 00000100:00100000:3.0:1788361733.463212:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361733.463221:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429885440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361733.463238:0:94209:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361733.463271:0:94209:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361733.463275:0:94209:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:3.0:1788361733.463368:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429885440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.463377:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361733.463407:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788361733.463454:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361733.463461:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.463470:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.463478:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361733.463481:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 58 10000000:01000000:1.0:1788361733.463488:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361733.463503:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.463511:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.463520:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.463533:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.463557:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.463579:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10adb4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.463646:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885568 00000100:00100000:3.0:1788361733.463651:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885568 00000100:00100000:3.0:1788361733.463686:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361733.463696:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+11:6520:x1875230429885568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361733.463704:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361733.463715:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe41dd expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.463730:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 12 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.463739:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 12 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.463745:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309600, rc 0) 00000100:00100000:3.0:1788361733.463781:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429885568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.463787:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361733.463838:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.463851:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.463859:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.463910:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.463933:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.463950:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10adb4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.464129:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885696 00000100:00100000:3.0:1788361733.464134:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885696 00000100:00100000:3.0:1788361733.464173:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788361733.464181:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429885696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.464333:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429885696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.464341:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361733.464371:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.464402:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.464441:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.464465:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.464624:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885824 00000100:00100000:3.0:1788361733.464629:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885824 00000100:00100000:3.0:1788361733.464666:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361733.464673:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429885824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.464777:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429885824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.464785:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361733.464805:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361733.466438:0:94383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1788361733.466630:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1788361733.466661:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361733.466672:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.466683:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361733.466695:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361733.466697:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 124 10000000:01000000:3.0:1788361733.466700:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361733.466734:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.466743:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.466755:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361733.466778:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.466853:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.466882:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429885952 00000100:00100000:0.0:1788361733.466889:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429885952 00000100:00100000:0.0:1788361733.466927:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788361733.466936:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+12:6520:x1875230429885952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.466948:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361733.466966:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe41eb expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.466988:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 13 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361733.467001:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788361733.467002:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 13 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.467015:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917a00, rc 0) 00000100:00100000:0.0:1788361733.467054:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429885952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.467061:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361733.467130:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429885952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361733.467144:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.467161:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361733.467208:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.467241:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.467461:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886080 00000100:00100000:1.0:1788361733.467466:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886080 00000100:00100000:3.0:1788361733.467472:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.467499:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361733.467507:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429886080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788361733.467523:0:94207:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788361733.467543:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788361733.467547:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788361733.467550:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788361733.467553:0:94207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788361733.467555:0:94207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:1.0:1788361733.467659:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429886080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.467667:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361733.467672:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361733.467755:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361733.467761:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.467769:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361733.467777:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788361733.467780:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1788361733.467782:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788361733.467798:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.467806:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.467815:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361733.467850:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.467903:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.467934:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886208 00000100:00100000:3.0:1788361733.467938:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.467939:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886208 00000100:00100000:1.0:1788361733.467980:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361733.467987:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+13:6520:x1875230429886208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.467994:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361733.468004:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe41f9 expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.468019:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 14 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.468027:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 14 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.468033:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb000, rc 0) 00000100:00100000:1.0:1788361733.468062:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429886208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.468068:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361733.469202:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361733.469221:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.469232:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361733.469311:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.469350:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361733.469637:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004905a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.470275:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886336 00000100:00100000:0.0:1788361733.470284:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886336 00000100:00100000:0.0:1788361733.470327:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361733.470336:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429886336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.470505:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429886336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.470513:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361733.470552:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.470595:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.471611:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.471656:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1398c7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.471657:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886464 00000100:00100000:0.0:1788361733.471664:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886464 00000100:00100000:0.0:1788361733.471711:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788361733.471719:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429886464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.471942:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.472674:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429886464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 954us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.472683:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:1.0:1788361733.473002:0:94384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:0.0:1788361733.473073:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:0.0:1788361733.473107:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788361733.473118:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.473131:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361733.473141:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788361733.473144:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99d002df9000 from 1 10000000:01000000:0.0:1788361733.473146:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361733.473180:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.473187:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.473196:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.473441:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.473480:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.473516:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.473550:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886592 00000100:00100000:1.0:1788361733.473557:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886592 00000100:00100000:1.0:1788361733.473589:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361733.473597:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+14:6520:x1875230429886592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.473608:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361733.473620:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012eae00/0x1b69fa8920fe420e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4207 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.473642:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012eae00/0x1b69fa8920fe420e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4207 expref: 15 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.473652:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012eae00/0x1b69fa8920fe420e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4207 expref: 15 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.473661:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eae00, rc 0) 00000100:00100000:1.0:1788361733.473703:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429886592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.473710:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361733.474098:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.474113:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe420e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.474123:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe420e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361733.474139:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788361733.474154:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe420e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.474161:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917c00/0x1b69fa8920fe4207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe420e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361733.474169:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361733.474171:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d002df9000 from 7 10000000:01000000:0.0:1788361733.474174:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361733.474191:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.474199:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.474207:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.474221:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.474260:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.474287:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.474297:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886720 00000100:00100000:1.0:1788361733.474301:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886720 00000100:00100000:1.0:1788361733.474326:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788361733.474333:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429886720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.474341:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361733.474356:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe421c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4215 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.474370:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe421c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4215 expref: 16 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.474380:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe421c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4215 expref: 16 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.474387:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea800, rc 0) 00000100:00100000:1.0:1788361733.474420:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429886720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.474427:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361733.474431:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.474440:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe421c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.474449:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe421c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.474497:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.474533:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.474556:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.474589:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886848 00000100:00100000:1.0:1788361733.474593:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886848 00000100:00100000:1.0:1788361733.474617:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361733.474625:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429886848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.474787:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429886848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.474793:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788361733.474864:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.474893:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.474930:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.474964:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.475028:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429886976 00000100:00100000:1.0:1788361733.475032:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429886976 00000100:00100000:1.0:1788361733.475056:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361733.475062:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429886976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.475146:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429886976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.475154:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361733.475177:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429886976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361733.476006:0:94385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361733.476068:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361733.476099:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361733.476108:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe421c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.476117:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe421c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.476126:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361733.476129:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 58 10000000:01000000:1.0:1788361733.476132:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361733.476156:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.476164:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.476175:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.476191:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.476230:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.476280:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7af3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.476280:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887104 00000100:00100000:0.0:1788361733.476285:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887104 00000100:00100000:0.0:1788361733.476315:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361733.476323:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429887104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.476413:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361733.476427:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4223 expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.476447:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 17 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.476457:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 17 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.476464:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916e00, rc 0) 00000100:00100000:0.0:1788361733.476503:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429887104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.476509:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361733.476543:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.476555:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.476563:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.476606:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.476635:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361733.476678:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887232 00000100:00100000:1.0:1788361733.476681:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7af3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.476684:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887232 00000100:00100000:1.0:1788361733.477187:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361733.477208:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429887232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.477339:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429887232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.477346:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788361733.477872:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.477904:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.477936:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.477961:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887360 00000100:00100000:3.0:1788361733.477965:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0049056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.477968:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887360 00000100:00100000:1.0:1788361733.478000:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361733.478008:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429887360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.478090:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429887360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.478096:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361733.478151:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361733.479023:0:94386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1788361733.479095:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1788361733.479119:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361733.479128:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.479138:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.479148:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788361733.479150:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788361733.479153:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788361733.479177:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.479196:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.479206:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.479222:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.479271:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.479302:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7af480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.480094:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887488 00000100:00100000:3.0:1788361733.480100:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887488 00000100:00100000:3.0:1788361733.480145:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361733.480153:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429887488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361733.480167:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361733.480181:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4231 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.480211:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 18 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.480221:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 18 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.480232:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308e00, rc 0) 00000100:00100000:3.0:1788361733.480288:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429887488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.480296:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788361733.480323:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.480351:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.480361:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.480424:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.480453:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.480492:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.480578:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887616 00000100:00100000:1.0:1788361733.480583:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887616 00000100:00100000:1.0:1788361733.480611:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361733.480619:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429887616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.480747:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429887616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.480754:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788361733.480784:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.480812:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.480889:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.480914:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.480978:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887744 00000100:00100000:3.0:1788361733.480982:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887744 00000100:00100000:3.0:1788361733.481039:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361733.481047:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429887744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.482590:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429887744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1537us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.482602:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361733.482617:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361733.484090:0:94387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788361733.484209:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788361733.484237:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788361733.484259:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.484272:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361733.484284:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361733.484287:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d0021f9800 from 7 10000000:01000000:0.0:1788361733.484290:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361733.484340:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.484349:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.484361:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.484383:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.484436:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.484486:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429887872 00000100:00100000:0.0:1788361733.484487:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.484493:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429887872 00000100:00100000:1.0:1788361733.484538:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788361733.484547:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429887872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.484560:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361733.484573:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea000/0x1b69fa8920fe4246 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe423f expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.484609:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea000/0x1b69fa8920fe4246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe423f expref: 19 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.484620:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea000/0x1b69fa8920fe4246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe423f expref: 19 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.484629:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea000, rc 0) 00000100:00100000:1.0:1788361733.484680:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429887872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.484687:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788361733.485147:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429887872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.485163:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4246 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.485173:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4246 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.485225:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.485269:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.485301:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.485382:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888000 00000100:00100000:1.0:1788361733.485387:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888000 00000100:00100000:1.0:1788361733.485417:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361733.485424:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429888000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.485545:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429888000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.485554:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361733.485566:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.485597:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.485641:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.485664:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.485804:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888128 00000100:00100000:1.0:1788361733.485809:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888128 00000100:00100000:1.0:1788361733.485861:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361733.485870:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429888128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.485962:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429888128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.485969:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788361733.486133:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361733.487495:0:94388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361733.487597:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361733.487623:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361733.487640:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4246 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.487652:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4246 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.487660:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361733.487662:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 58 10000000:01000000:1.0:1788361733.487665:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361733.487693:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.487700:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.487710:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.487727:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.487769:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.487806:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.487868:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888256 00000100:00100000:0.0:1788361733.487875:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888256 00000100:00100000:0.0:1788361733.487913:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361733.487921:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429888256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.487933:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361733.487946:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe424d expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.487969:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 20 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.487980:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 20 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.487989:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917600, rc 0) 00000100:00100000:0.0:1788361733.488035:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429888256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.488041:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361733.488158:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.488172:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.488181:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.488233:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.488282:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.488360:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.488498:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888384 00000100:00100000:0.0:1788361733.488503:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888384 00000100:00100000:0.0:1788361733.488562:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788361733.488570:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429888384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.488685:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429888384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.488693:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788361733.488768:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.488805:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.488945:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.488994:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.489022:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888512 00000100:00100000:1.0:1788361733.489026:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888512 00000100:00100000:1.0:1788361733.489081:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788361733.489088:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429888512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.489161:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429888512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.489167:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361733.489224:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361733.490117:0:94389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1788361733.490247:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1788361733.490279:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361733.490288:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.490298:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.490307:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788361733.490309:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788361733.490312:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361733.490338:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.490346:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.490355:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.490373:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.490414:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.490448:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.490483:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888640 00000100:00100000:3.0:1788361733.490489:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888640 00000100:00100000:3.0:1788361733.490531:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361733.490540:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429888640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361733.490550:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361733.490794:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe425b expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.490817:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 21 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.490890:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 21 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361733.490906:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309000, rc 0) 00000100:00100000:3.0:1788361733.490985:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429888640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 446us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.490993:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788361733.491054:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.491068:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.491076:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.491126:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.491153:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.491185:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.491207:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888768 00000100:00100000:0.0:1788361733.491214:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888768 00000100:00100000:0.0:1788361733.491245:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361733.491263:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429888768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.491357:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429888768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.491363:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788361733.491375:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.491403:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.491439:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.491458:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.491468:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429888896 00000100:00100000:0.0:1788361733.491472:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429888896 00000100:00100000:0.0:1788361733.491500:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361733.491505:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429888896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.492657:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429888896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1148us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.492667:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788361733.492698:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429888896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361733.493937:0:94390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788361733.494153:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788361733.494174:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361733.494183:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.494194:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361733.494258:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361733.494262:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d137d28000 from 7 10000000:01000000:0.0:1788361733.494265:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361733.494407:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.494414:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.494421:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.494436:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.494479:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.494515:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.494536:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889024 00000100:00100000:1.0:1788361733.494543:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889024 00000100:00100000:1.0:1788361733.494595:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361733.494605:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429889024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.494618:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361733.494632:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139db4e00/0x1b69fa8920fe4270 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4269 expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.494666:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139db4e00/0x1b69fa8920fe4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4269 expref: 22 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.494681:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139db4e00/0x1b69fa8920fe4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4269 expref: 22 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.494689:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4e00, rc 0) 00000100:00100000:1.0:1788361733.494733:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429889024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.494741:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361733.494751:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.494766:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.494775:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.494896:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.494942:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.494969:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.494980:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889152 00000100:00100000:1.0:1788361733.494985:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889152 00000100:00100000:1.0:1788361733.495017:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361733.495024:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429889152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.495131:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429889152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.495139:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361733.495171:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.495202:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361733.495321:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361733.495346:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361733.495428:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889280 00000100:00100000:1.0:1788361733.495433:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889280 00000100:00100000:1.0:1788361733.495461:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788361733.495469:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429889280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.495548:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429889280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.495556:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361733.495561:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361733.496431:0:94391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788361733.496502:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788361733.496534:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361733.496548:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.496558:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.496567:0:6520:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788361733.496570:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99d1349b4d40 from 1 10000000:01000000:1.0:1788361733.496573:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788361733.496597:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.496605:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.496615:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.496631:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.496665:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.496700:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104d72180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361733.496706:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889408 00000100:00100000:0.0:1788361733.496713:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889408 00000100:00100000:0.0:1788361733.496749:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361733.496758:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429889408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361733.496767:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361733.496782:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d139916600/0x1b69fa8920fe427e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4277 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.496802:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d139916600/0x1b69fa8920fe427e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4277 expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.496813:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d139916600/0x1b69fa8920fe427e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4277 expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361733.496845:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916600, rc 0) 00000100:00100000:1.0:1788361733.496919:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.496934:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe427e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.496943:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe427e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361733.496950:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429889408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.496961:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 10000000:01000000:1.0:1788361733.496964:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361733.496971:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe427e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.496985:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db4600/0x1b69fa8920fe4277 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe427e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361733.496994:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788361733.496996:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:1.0:1788361733.496998:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788361733.497016:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.497023:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.497031:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.497044:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.497074:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361733.497314:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889536 00000100:00100000:2.0:1788361733.497320:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889536 00000100:00100000:1.0:1788361733.497323:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104d72180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361733.497354:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788361733.497363:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429889536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361733.497371:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361733.497380:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4285 expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361733.497396:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361733.497405:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361733.497412:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20000, rc 0) 00000100:00100000:2.0:1788361733.497451:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429889536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361733.497457:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788361733.498123:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361733.498141:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361733.498150:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361733.498206:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361733.498235:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361733.498279:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104d72180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361733.498349:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889664 00000100:00100000:3.0:1788361733.498354:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889664 00000100:00100000:3.0:1788361733.498414:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788361733.498422:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429889664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361733.498501:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429889664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (264us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361733.498509:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788361733.498542:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429889664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788361733.498575:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788361733.498582:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361733.498591:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788361734.129218:0:94485:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788361734.230988:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788361734.628600:0:94537:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788361734.628869:0:94537:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788361735.082284:0:94587:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788361735.082492:0:94587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788361735.253994:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361736.021988:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361736.022086:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429889792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361736.022176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361736.022287:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889792 00000100:00100000:3.0:1788361736.022294:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889792 00000100:00100000:3.0:1788361736.022401:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1788361736.022413:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429889792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361736.022442:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361736.022490:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429889792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361736.022497:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00080000:2.0:1788361736.022526:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361736.022565:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429889792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361736.022853:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361736.022936:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429889920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361736.022966:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361736.023117:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429889920 00000100:00100000:1.0:1788361736.023122:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429889920 00000100:00100000:1.0:1788361736.023217:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1788361736.023226:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429889920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361736.023245:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361736.023298:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429889920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361736.023305:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:0.0:1788361736.023386:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429889920:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788361736.023617:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788361736.279627:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361736.455712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361736.455785:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044096 00000100:00100000:1.0:1788361736.455795:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044096 00000100:00100000:1.0:1788361736.455900:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 940 00000100:00100000:1.0:1788361736.455912:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2411:x1875230407044096:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:2.0:1788361736.455987:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361736.455998:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2411:x1875230407044096:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361736.456006:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 940 00000100:00100000:3.0:1788361736.456060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361736.456181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361736.456222:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361736.456255:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044224 00000100:00100000:3.0:1788361736.456260:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044224 00000100:00100000:3.0:1788361736.456310:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4932 00000100:00100000:3.0:1788361736.456319:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2408:x1875230407044224:12345-192.168.204.35@tcp:9:kworker.0 00000100:00080000:0.0:1788361736.456323:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788361736.456349:0:8535:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe3741 00000100:00080000:3.0:1788361736.456358:0:8535:0:(import.c:65:import_set_state_nolock()) ffff99d136447800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361736.456411:0:8535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968756 00010000:00010000:0.0:1788361736.456424:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361736.456538:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+2:2408:x1875230407044224:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 221us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361736.456550:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4932 00000100:00100000:2.0:1788361736.456581:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043968 00000100:00100000:2.0:1788361736.456587:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043968 00000100:00100000:1.0:1788361736.456620:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407043840 00000100:00100000:1.0:1788361736.456625:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407043840 00000100:00100000:1.0:1788361736.456649:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788361736.456654:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2408:x1875230407043840:12345-192.168.204.35@tcp:250:kworker.0 00010000:00080000:1.0:1788361736.456676:0:94209:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp t0 exp 0000000000000000 cur 2776 last 0 00000100:00100000:2.0:1788361736.456691:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1352 00000100:00100000:2.0:1788361736.456697:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1875230407043968:12345-192.168.204.35@tcp:38:kworker.0 00000020:00000080:1.0:1788361736.456705:0:94209:0:(genops.c:1406:class_connect()) connect: client 3956ab41-635b-456b-967f-6c1073c5d2df, cookie 0x1b69fa8920fe4293 00010000:00080000:2.0:1788361736.456714:0:67579:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'f1e400d1-472b-42d1-b5e7-e80dc701272a' at ffff99d116c04000, cookie 0x1b69fa8920fe4120 00010000:00080000:2.0:1788361736.456720:0:67579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp recovering/t120259084299 exp ffff99d116c04000 cur 2776 last 1788361732 00010000:02000400:2.0:1788361736.456726:0:67579:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788361736.456730:0:67579:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788361736.456747:0:67579:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788361736.456916:0:94209:0:(import.c:65:import_set_state_nolock()) ffff99d0074c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361736.456959:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+5:2408:x1875230407043840:12345-192.168.204.35@tcp:250:kworker.0 Request processed in 303us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361736.456968:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00080000:2.0:1788361736.457138:0:67579:0:(import.c:65:import_set_state_nolock()) ffff99d10f55e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361736.457227:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407043968:12345-192.168.204.35@tcp:38:kworker.0 Request processed in 528us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361736.457235:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1352 00000100:00100000:0.0:1788361736.465379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361736.465443:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407037568 00000100:00100000:2.0:1788361736.465459:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407037568 00000100:00100000:2.0:1788361736.465523:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1353 00000100:00100000:2.0:1788361736.465535:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407037568:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00080000:2.0:1788361736.465570:0:66127:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084299, current: 120259084299, replaying 00000100:00100000:2.0:1788361736.465590:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407037568:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 58us (218us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361736.465597:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1353 00010000:00080000:1.0:1788361736.465628:0:94235:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788361737.046045:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429890048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361737.046137:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361737.046303:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890048 00000100:00100000:2.0:1788361737.046311:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890048 00000100:00100000:2.0:1788361737.046422:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4218 00000100:00100000:2.0:1788361737.046433:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429890048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361737.046467:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361737.046520:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429890048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361737.046528:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4218 00000100:00100000:3.0:1788361737.046607:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429890048:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788361737.047556:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788361737.047567:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000020:00000080:0.0:1788361737.047570:0:8432:0:(genops.c:906:class_export_put()) final put ffff99d007455000/f1e400d1-472b-42d1-b5e7-e80dc701272a 00000020:00000080:2.0:1788361737.048077:0:85876:0:(genops.c:865:class_export_destroy()) destroying export ffff99d007455000/f1e400d1-472b-42d1-b5e7-e80dc701272a for lustre-OST0000 00000020:00000080:2.0:1788361737.048131:0:85876:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d007456000 for lustre-OST0000 00010000:00010000:0.0:1788361737.302284:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361737.558224:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361737.558232:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361737.558235:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361737.558248:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d13fd14800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361737.558276:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117280a80 x1875230429890304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361737.558304:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361737.558308:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361737.558310:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361737.558316:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99d002dff000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361737.558326:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117282300 x1875230429890560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361737.558349:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361737.558353:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361737.558369:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361737.558375:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99d106904000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361737.558390:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117282a00 x1875230429890816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361737.558413:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361737.558416:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361737.558418:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361737.558421:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99d10f770000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361737.558431:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117281180 x1875230429891200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361737.558655:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429890176:0@lo:400:kworker.0 00000100:00100000:0.0:1788361737.558719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.558753:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429891072:0@lo:400:kworker.0 00000100:00100000:0.0:1788361737.558776:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.558801:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361737.558806:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429890432:0@lo:400:kworker.0 00000100:00100000:0.0:1788361737.558858:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.558896:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890432 00000100:00100000:0.0:1788361737.558903:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890432 00000100:00100000:0.0:1788361737.558949:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1788361737.558959:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429890432:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361737.559000:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788361737.559005:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361737.559007:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d10f55a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788361737.559020:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429890432:12345-0@lo:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.559028:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00080000:3.0:1788361737.559059:0:29104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d10f55a000 using connection 192.168.204.135@tcp/0@lo 00000100:00080000:0.0:1788361737.559060:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361737.559080:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d117281500 x1875230429891584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361737.559094:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429890432:0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.559112:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429891328:0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.559152:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361737.559275:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890176 00000100:00100000:1.0:1788361737.559280:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890176 00000100:00100000:0.0:1788361737.560092:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429890688:0@lo:400:kworker.0 00000100:00100000:0.0:1788361737.560122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.560150:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429891456:0@lo:400:kworker.0 00000100:00100000:0.0:1788361737.560308:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890688 00000100:00100000:0.0:1788361737.560312:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890688 00000100:00100000:0.0:1788361737.560352:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1788361737.560359:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429890688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361737.560395:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429890688:12345-0@lo:400:kworker.0 Request processed in 37us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.560402:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00080000:0.0:1788361737.560418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788361737.560466:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429890304:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.560491:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.560509:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429890560:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.560530:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.560546:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429890816:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.560568:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.560585:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429891200:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.560604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.560619:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429891584:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.560644:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.560667:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890304 00000100:00100000:0.0:1788361737.560671:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890304 00000100:00100000:0.0:1788361737.560685:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890560 00000100:00100000:0.0:1788361737.560687:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890560 00000100:00100000:0.0:1788361737.560694:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891200 00000100:00100000:0.0:1788361737.560696:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891200 00000100:00100000:0.0:1788361737.560703:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891584 00000100:00100000:0.0:1788361737.560705:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891584 00000100:00100000:0.0:1788361737.560723:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1788361737.560727:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429890304:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361737.560751:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:0.0:1788361737.560782:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe429a 00000004:00100000:0.0:1788361737.560796:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361737.560939:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d104f3a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361737.560979:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429890304:12345-0@lo:38:kworker.0 Request processed in 250us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.560985:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1788361737.560998:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788361737.561005:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429890560:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361737.561017:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:0.0:1788361737.561038:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b69fa8920fe42a1 00000004:00100000:0.0:1788361737.561044:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361737.561059:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d104f3c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361737.561085:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875230429890560:12345-0@lo:38:kworker.0 Request processed in 82us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.561092:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788361737.561104:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1788361737.561108:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429891200:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361737.561120:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:0.0:1788361737.561141:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1b69fa8920fe42a8 00000004:00100000:0.0:1788361737.561147:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361737.561158:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d104f3d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361737.563152:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875230429891200:12345-0@lo:38:kworker.0 Request processed in 2034us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.563199:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1788361737.563238:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:0.0:1788361737.563244:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875230429891584:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361737.563274:0:66901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:0.0:1788361737.563310:0:66901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b69fa8920fe42af 00000004:00100000:0.0:1788361737.563326:0:66901:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361737.563353:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d136ca5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361737.563396:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875230429891584:12345-0@lo:38:kworker.0 Request processed in 151us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.563403:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1788361737.563997:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891072 00000100:00100000:3.0:1788361737.564006:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891072 00000100:00100000:3.0:1788361737.564066:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891328 00000100:00100000:3.0:1788361737.564070:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891328 00000100:00100000:3.0:1788361737.564112:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1788361737.564120:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429891072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564198:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429891072:12345-0@lo:400:kworker.0 Request processed in 79us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.564216:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1788361737.564230:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1788361737.564236:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429891328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564273:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429891328:12345-0@lo:400:kworker.0 Request processed in 38us (5122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.564279:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00080000:3.0:1788361737.564297:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361737.564340:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429891072:0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361737.564445:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429890688:0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564455:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361737.564470:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429890944:0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361737.564528:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891456 00000100:00100000:3.0:1788361737.564532:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891456 00000100:00100000:3.0:1788361737.564573:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890944 00000100:00100000:3.0:1788361737.564576:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890944 00000100:00100000:3.0:1788361737.564596:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1788361737.564602:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429891456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564635:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1875230429891456:12345-0@lo:400:kworker.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.564641:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1788361737.564654:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1788361737.564661:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429890944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361737.564688:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429890816 00000100:00100000:3.0:1788361737.564690:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429890944:12345-0@lo:400:kworker.0 Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361737.564695:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429890816 00000100:00100000:3.0:1788361737.564704:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1788361737.564729:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4219 00000100:00100000:1.0:1788361737.564737:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1875230429890816:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788361737.564739:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788361737.564752:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429890176:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788361737.564764:0:23938:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d116c07800, cookie 0x1b69fa8920fe4119 00010000:00080000:1.0:1788361737.564772:0:23938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084296 exp ffff99d116c07800 cur 2777 last 1788361732 00000004:00100000:1.0:1788361737.564787:0:23938:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788361737.564790:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429890176:12345-0@lo:400:kworker.0 Request processed in 40us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.564797:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788361737.564816:0:23938:0:(import.c:65:import_set_state_nolock()) ffff99d0074c7000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788361737.564820:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361737.564853:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429890176:0@lo:400:kworker.0 00000100:00100000:3.0:1788361737.564875:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429891328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361737.564894:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429890816:12345-0@lo:38:kworker.0 Request processed in 156us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.564895:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429890944:0@lo:400:kworker.0 00000100:00100000:1.0:1788361737.564907:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4219 00000100:00100000:3.0:1788361737.564914:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429891456:0@lo:400:kworker.0 00010000:00080000:1.0:1788361737.564935:0:94235:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788361737.564941:0:94235:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 120259084299 00000020:00080000:1.0:1788361737.564946:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361737.564950:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00010000:00080000:1.0:1788361737.564955:0:94235:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084299) 00000020:00080000:1.0:1788361737.564957:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788361737.564969:0:94235:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407037568 t120259084299 from 192.168.204.35@tcp req@ffff99d00335c700 x1875230407037568/t0(120259084299) o36->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:42/0 lens 528/0 e 0 to 0 dl 1788361747 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788361737.565691:0:94235:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 674us 00010000:00080000:0.0:1788361737.565768:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d117280a80 x1875230429890304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361737.565785:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00080000:0.0:1788361737.566738:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d117280a80 x1875230429890304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361762 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361737.566750:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788361737.566755:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788361737.566760:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788361737.566766:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429890304:0@lo:38:kworker.0 00010000:00080000:0.0:1788361737.566788:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d117282300 x1875230429890560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361737.566800:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:0.0:1788361737.567742:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d117282300 x1875230429890560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361762 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361737.567765:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788361737.567769:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d002dff000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788361737.567773:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788361737.567779:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875230429890560:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.567800:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084298 gen 3 00000004:00080000:0.0:1788361737.567805:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084298 00000004:00080000:0.0:1788361737.567844:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084297 committed transno 120259084298 00000004:00080000:0.0:1788361737.567856:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084298 committed transno 120259084298 00000100:00080000:0.0:1788361737.567869:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1788361737.567877:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788361737.567882:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788361737.567884:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084298 gen 3 00000100:00080000:0.0:1788361737.567887:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d106904000 from lustre-MDT0000_UUID committed 120259084298 last 0 00000100:00080000:0.0:1788361737.567891:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788361737.569014:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429890816:0@lo:38:kworker.0 00010000:00080000:3.0:1788361737.569042:0:94601:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00080000:0.0:1788361737.569045:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d117281180 x1875230429891200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788361737.569050:0:94601:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1788361737.569058:0:94601:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788361737.569065:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00010000:00010000:3.0:1788361737.570732:0:94601:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe3a20 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788361737.570755:0:94601:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:0.0:1788361737.572623:0:3649:0:(import.c:1334:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d117281180 x1875230429891200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361762 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361737.572638:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788361737.572644:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f770000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788361737.572648:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788361737.572655:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875230429891200:0@lo:38:kworker.0 00010000:00080000:0.0:1788361737.572696:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d117281500 x1875230429891584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361737.572713:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:0.0:1788361737.572721:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788361737.572726:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788361737.572729:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d10f55a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788361737.572733:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875230429891584:0@lo:38:kworker.0 00000100:00100000:0.0:1788361737.572777:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429891712:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788361737.572861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361737.573145:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891712 00000100:00100000:2.0:1788361737.573153:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891712 00000100:00100000:2.0:1788361737.573230:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4220 00000100:00100000:2.0:1788361737.573240:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429891712:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788361737.573265:0:8449:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d00335f480 x1875230429891712/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:43/0 lens 328/0 e 0 to 0 dl 1788361748 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361737.573275:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875230429891712:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 39us (415us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361737.573282:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4220 00010000:00010000:3.0:1788361737.579961:0:94235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.579982:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580008:0:94235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580022:0:94235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580030:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580037:0:94235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580450:0:94235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580459:0:94235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580466:0:94235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580474:0:94235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361737.580478:0:94235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580487:0:94235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580501:0:94235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d004359100) 00010000:00010000:3.0:1788361737.580505:0:94235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361737.580510:0:94235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580523:0:94235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308200/0x1b69fa8920fe42b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361737.580540:0:94235:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b79a97fe reply state 00000000ab47e546 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580552:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.580560:0:94235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004359200) 00010000:00010000:3.0:1788361737.580563:0:94235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361737.580566:0:94235:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788361737.580676:0:94235:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788361737.580699:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361737.580702:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000020:00080000:3.0:1788361737.580708:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788361737.580710:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000001:00080000:0.0:1788361737.582512:0:94202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084299 is committed 00010000:00010000:1.0:1788361737.582585:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.582604:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.582612:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.582618:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361737.582622:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.582631:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.582649:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d004359200) 00010000:00010000:1.0:1788361737.582652:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361737.582656:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.582661:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe42bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361737.586091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361737.586140:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407038080 00000100:00100000:1.0:1788361737.586151:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407038080 00000100:00100000:1.0:1788361737.586231:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1358 00000100:00100000:1.0:1788361737.586242:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407038080:12345-192.168.204.35@tcp:36:rm.0 00010000:00080000:1.0:1788361737.586263:0:66128:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:1.0:1788361737.586287:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407038080:12345-192.168.204.35@tcp:36:rm.0 Request processed in 47us (208us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361737.586295:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1358 00000020:00080000:2.0:1788361737.586304:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361737.586311:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:2.0:1788361737.586316:0:94235:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:2.0:1788361737.586330:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361737.586341:0:94235:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407038080 t120259084300 from 192.168.204.35@tcp req@ffff99d00335c000 x1875230407038080/t0(120259084300) o36->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:43/0 lens 512/0 e 0 to 0 dl 1788361748 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361737.586429:0:94235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586444:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586459:0:94235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586472:0:94235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586478:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586484:0:94235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586580:0:94235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586588:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586595:0:94235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586878:0:94235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586896:0:94235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586903:0:94235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586910:0:94235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361737.586914:0:94235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586922:0:94235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586934:0:94235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:2.0:1788361737.586937:0:94235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361737.586941:0:94235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586948:0:94235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe42d2 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586969:0:94235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586975:0:94235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.586981:0:94235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.587198:0:94235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361737.587209:0:94235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.587216:0:94235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.587225:0:94235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1db00) 00010000:00010000:2.0:1788361737.587227:0:94235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361737.587230:0:94235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.587236:0:94235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe42c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361737.587248:0:94235:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1e7d085 reply state 000000005ea3e3cc transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.587258:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.587264:0:94235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d009c1d000) 00010000:00010000:2.0:1788361737.587266:0:94235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361737.587269:0:94235:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788361737.587388:0:94235:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788361737.587408:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361737.587411:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:2.0:1788361737.587414:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361737.587416:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000100:00100000:2.0:1788361737.590407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361737.590494:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044480 00000100:00100000:3.0:1788361737.590505:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044480 00000100:00100000:3.0:1788361737.590555:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 943 00000100:00100000:3.0:1788361737.590564:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2408:x1875230407044480:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788361737.590589:0:66127:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d134a6d500 x1875230407044480/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:43/0 lens 224/0 e 0 to 0 dl 1788361748 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361737.590613:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2408:x1875230407044480:12345-192.168.204.35@tcp:400:ldlm_lock_repla.0 Request processed in 51us (217us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361737.590619:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 943 00000020:00080000:2.0:1788361737.590962:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361737.590966:0:94235:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:2.0:1788361737.590982:0:94235:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788361737.590985:0:94235:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788361737.590991:0:94235:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361737.590993:0:94235:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361737.591001:0:94235:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff99d00335f480 x1875230429891712/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:43/0 lens 328/0 e 0 to 0 dl 1788361748 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361737.591018:0:94235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361737.591047:0:94235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20200/0x1b69fa8920fe42d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe3a19 expref: -99 pid: 94235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.591073:0:94235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20200/0x1b69fa8920fe42d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe3a19 expref: 7 pid: 94235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.591086:0:94235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20200/0x1b69fa8920fe42d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe3a19 expref: 7 pid: 94235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.591093:0:94235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20200, rc 0) 00010000:00080000:2.0:1788361737.591157:0:94235:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788361737.591180:0:94235:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1788361737.591250:0:3649:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d117aac400/0x1b69fa8920fe3a19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe42d9 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361737.591261:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1788361737.591290:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429891712:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1788361737.591312:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429891840:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1788361737.591349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361737.591513:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891840 00000100:00100000:2.0:1788361737.591518:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891840 00000100:00100000:2.0:1788361737.591553:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4221 00000100:00100000:2.0:1788361737.591561:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875230429891840:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1788361737.591572:0:23938:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d0038dc700 x1875230429891840/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:43/0 lens 224/0 e 0 to 0 dl 1788361748 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361737.591715:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875230429891840:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 154us (365us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361737.591722:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4221 00010000:00080000:3.0:1788361737.592256:0:94235:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788361737.592381:0:94235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:0.0:1788361737.595407:0:94202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788361737.595418:0:94202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00080000:0.0:1788361737.595437:0:94202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00010000:00010000:2.0:1788361737.595502:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.595517:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.595524:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.595530:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361737.595534:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.595542:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.595559:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361737.595563:0:94235:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1788361737.595566:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21800/0x1b69fa8920fe42cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788361737.595617:0:94235:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788361737.595634:0:94235:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.35@tcp: req@ffff99d134a6d500 x1875230407044480/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:43/0 lens 224/0 e 0 to 0 dl 1788361748 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788361737.595761:0:94235:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d0038dc700 x1875230429891840/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:43/0 lens 224/0 e 0 to 0 dl 1788361748 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788361737.595919:0:94235:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1788361737.596998:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788361737.597010:0:3649:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99d0038de680 x1875230429891840/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361753 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361737.597020:0:3649:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d0038de680 x1875230429891840/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361753 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361737.597027:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d106904000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788361737.597050:0:3649:0:(import.c:1749:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1788361737.597057:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1ed344c): req@ffff99d00a24f800 x1875230429874560/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361735 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361737.597079:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429891840:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1788361737.597262:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429891968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361737.597329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361737.597404:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429891968 00000100:00100000:2.0:1788361737.597411:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429891968 00000100:00100000:2.0:1788361737.597463:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222 00000100:00100000:2.0:1788361737.597474:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429891968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788361737.597504:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:2.0:1788361737.597548:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429891968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361737.597556:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222 00000100:00100000:1.0:1788361737.597562:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429891968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361737.597622:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361737.597689:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429874560 00000100:00100000:0.0:1788361737.597695:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429874560 00000100:00100000:0.0:1788361737.597730:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4223 00000100:00100000:0.0:1788361737.597739:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429874560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788361737.597754:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:0.0:1788361737.597801:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429874560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.597808:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4223 00000100:00100000:1.0:1788361737.597973:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429874560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361737.604586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361737.604945:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044352 00000100:00100000:1.0:1788361737.604956:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044352 00000100:00100000:1.0:1788361737.605040:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1359 00000100:00100000:1.0:1788361737.605051:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72303:x1875230407044352:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361737.605084:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:1.0:1788361737.605274:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72303:x1875230407044352:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 224us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361737.605282:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1359 00000100:00100000:0.0:1788361737.609160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361737.609264:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044608 00000100:00100000:2.0:1788361737.609375:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044608 00000100:00100000:2.0:1788361737.609460:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1360 00000100:00100000:2.0:1788361737.609470:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:72303:x1875230407044608:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361737.609518:0:80345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361737.609590:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:72303:x1875230407044608:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 122us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361737.609597:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1360 00000100:00100000:1.0:1788361737.612925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361737.612979:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044736 00000100:00100000:0.0:1788361737.613006:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044736 00000100:00100000:0.0:1788361737.613052:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4933 00000100:00100000:0.0:1788361737.613062:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2408:x1875230407044736:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:0.0:1788361737.613099:0:26164:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:0.0:1788361737.613136:0:26164:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe42e0 00002000:00100000:0.0:1788361737.613149:0:26164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1e400d1-472b-42d1-b5e7-e80dc701272a/ffff99d13fd9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361737.613160:0:26164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788361737.613255:0:26164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788361737.613286:0:26164:0:(import.c:65:import_set_state_nolock()) ffff99d13fd9e800 : changing import state from RECOVER to FULL 00000004:00000080:3.0:1788361737.613303:0:94235:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa0888713e10 00100000:10000000:3.0:1788361737.613313:0:94235:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1788361737.613350:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407044736:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 287us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.613358:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4933 00000004:00080000:1.0:1788361737.614158:0:94222:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:1.0:1788361737.614206:0:94222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94222:1875230429892096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361737.614254:0:94222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361737.614348:0:94222:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104d72b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361737.614475:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892096 00000100:00100000:0.0:1788361737.614481:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892096 00000100:00100000:0.0:1788361737.614523:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:0.0:1788361737.614532:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:94222:x1875230429892096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788361737.614558:0:26169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -95 00002000:02000040:0.0:1788361737.614563:0:26169:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1921) 00000004:00080000:2.0:1788361737.615054:0:94220:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:3.0:1788361737.615075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361737.615080:0:94220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94220:1875230429892224:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788361737.615100:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044864 00000100:00100000:3.0:1788361737.615104:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044864 00000100:00100000:2.0:1788361737.615112:0:94220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361737.615127:0:94220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361737.615141:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1568 00000100:00100000:3.0:1788361737.615148:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72303:x1875230407044864:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788361737.615161:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361737.615223:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72303:x1875230407044864:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.615231:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1568 00000100:00080000:3.0:1788361737.615250:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361737.615555:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892224 00000100:00100000:1.0:1788361737.615560:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892224 00000100:00100000:1.0:1788361737.617386:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:1.0:1788361737.617413:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:94220:x1875230429892224:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788361737.617456:0:26165:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -94 00002000:02000040:1.0:1788361737.617461:0:26165:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1921) 00000100:00100000:3.0:1788361737.618119:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361737.618195:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407044992 00000100:00100000:2.0:1788361737.618204:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407044992 00000100:00100000:2.0:1788361737.618272:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4936 00000100:00100000:2.0:1788361737.618278:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2408:x1875230407044992:12345-192.168.204.35@tcp:8:lfs.0 00010000:00080000:2.0:1788361737.618306:0:26160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:2.0:1788361737.618336:0:26160:0:(genops.c:1406:class_connect()) connect: client f1e400d1-472b-42d1-b5e7-e80dc701272a, cookie 0x1b69fa8920fe42e7 00002000:00100000:2.0:1788361737.618347:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f1e400d1-472b-42d1-b5e7-e80dc701272a/ffff99d003827800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788361737.618359:0:26160:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788361737.618439:0:26160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788361737.618468:0:26160:0:(import.c:65:import_set_state_nolock()) ffff99d003821000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361737.618530:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407044992:12345-192.168.204.35@tcp:8:lfs.0 Request processed in 251us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361737.618538:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4936 00000100:00100000:2.0:1788361737.621321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361737.621445:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045120 00000100:00100000:3.0:1788361737.621453:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045120 00000100:00100000:3.0:1788361737.621547:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1569 00000100:00100000:3.0:1788361737.621556:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72303:x1875230407045120:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788361737.621577:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361737.621636:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72303:x1875230407045120:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 82us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.621643:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1569 00000001:00100000:3.0:1788361737.622077:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:3.0:1788361737.622084:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000020:00000080:3.0:1788361737.622087:0:9520:0:(genops.c:906:class_export_put()) final put ffff99d136445000/f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00100000:3.0:1788361737.622103:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361737.622117:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136445000/f1e400d1-472b-42d1-b5e7-e80dc701272a for lustre-OST0001 00000020:00000080:3.0:1788361737.622152:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d136447800 for lustre-OST0001 00000100:00080000:2.0:1788361737.622577:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788361737.623520:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.623529:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623546:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.623550:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.623556:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623590:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623600:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623608:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623673:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.623790:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.623795:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623804:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.623807:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.623811:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623849:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623857:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.623875:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624201:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361737.624210:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624219:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.624224:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624232:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624250:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624257:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a0ac359/0x1b69fa8920fe42ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624277:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.624280:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624287:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.624290:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624298:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624320:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624327:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.624329:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.624331:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.624396:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361737.624401:0:26169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099685d0c/0x1b69fa8920fe42f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.624463:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.624480:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.624489:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.624492:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.624496:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.624505:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.624513:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.624520:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624814:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.624820:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624847:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.624851:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624859:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624871:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.624885:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.624886:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.624888:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.625331:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361737.625337:0:26169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c756ddb/0x1b69fa8920fe42fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.625414:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.625419:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625427:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.625431:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.625436:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625444:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625452:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625459:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625565:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.625604:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.625609:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625625:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.625628:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.625632:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625641:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625649:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.625655:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625715:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361737.625720:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625737:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.625741:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625748:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625773:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625781:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000230ba0f8/0x1b69fa8920fe4303 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625794:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.625797:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625804:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.625806:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625813:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625841:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.625854:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.625856:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.625858:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626035:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361737.626040:0:26169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f47e38fe/0x1b69fa8920fe430a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.626104:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.626109:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626117:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.626120:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.626124:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626140:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626148:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626155:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626180:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.626190:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.626194:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626200:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.626203:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626210:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626219:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626226:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c691d0/0x1b69fa8920fe4311 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626244:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626245:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626247:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.626286:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.626291:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626298:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.626301:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.626305:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626313:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626321:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626328:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626339:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.626344:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.626348:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626364:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.626367:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626375:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626384:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626391:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040552794/0x1b69fa8920fe4318 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626402:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626404:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626406:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.626440:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.626445:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626452:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.626455:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.626459:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.626533:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626589:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626604:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626611:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626632:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.626671:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.626676:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626684:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.626687:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.626691:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626700:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626708:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626714:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626731:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361737.626736:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361737.626739:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626743:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.626745:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626750:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626766:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626775:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5d51f5b/0x1b69fa8920fe431f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626784:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.626786:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626790:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.626792:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626804:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626813:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626817:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000472e53a5/0x1b69fa8920fe4326 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626848:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626850:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626852:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.626892:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.626898:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626905:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.626908:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.626913:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626921:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626926:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626935:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626944:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.626950:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.626952:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626957:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.626960:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626965:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.626971:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626973:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626979:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe432d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.626988:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626989:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.626990:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.627021:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.627039:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627045:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.627047:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.627048:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.627050:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627286:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627296:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627303:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627354:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.627393:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.627402:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627405:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.627409:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627410:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.627414:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.627417:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.627418:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627420:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627427:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627429:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627440:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627441:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627448:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc82d920/0x1b69fa8920fe4334 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627449:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627462:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.627465:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627471:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ce00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.627480:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627488:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627498:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627506:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.627507:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.627534:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.627534:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361737.627538:0:26169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb58797/0x1b69fa8920fe433b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.627581:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.627584:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627589:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.627591:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.627594:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627599:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627604:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627616:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627628:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.627648:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.627653:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627660:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ca00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.627663:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.627664:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.627668:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627671:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627676:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.627678:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.627682:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627683:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627690:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3b5bc77/0x1b69fa8920fe4342 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627692:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627700:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627707:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627709:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.627710:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.627712:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.627719:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.627725:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.627728:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627742:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.627746:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.627767:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.627802:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627815:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627852:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a324c3ec/0x1b69fa8920fe4349 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627871:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.627873:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.627874:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.627916:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.627921:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627929:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.627931:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.627935:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627941:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627952:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627956:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.627967:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.627986:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.627992:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.627998:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458dc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.628002:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.628003:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.628007:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628010:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628015:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.628018:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.628021:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628022:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628029:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff359fd/0x1b69fa8920fe4350 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628031:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628039:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628042:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628044:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628045:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.628046:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628069:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.628106:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.628111:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628119:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.628122:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.628131:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.628136:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628153:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.628157:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628164:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628189:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628196:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa19092/0x1b69fa8920fe4357 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628209:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628210:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628212:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.628284:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628296:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628304:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628311:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628328:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.628367:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.628372:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628379:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.628387:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.628392:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628401:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628410:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.628410:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628415:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628418:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628423:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.628426:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628433:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628438:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361737.628443:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628450:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000026bcbfa/0x1b69fa8920fe435e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628471:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361737.628474:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628481:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.628484:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628491:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628501:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628508:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4365 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628519:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.628521:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.628523:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628539:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.628564:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.628569:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628577:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.628580:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.628585:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628594:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628603:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628616:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628661:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.628704:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.628709:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.628709:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628713:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628717:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1788361737.628720:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458de00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.628720:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.628724:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628725:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628734:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628743:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628744:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628752:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628755:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628762:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b82395/0x1b69fa8920fe436c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628774:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628776:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628777:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.628851:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.628880:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.628885:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.628888:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.628892:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458cc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.628893:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628896:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628904:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628905:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.628908:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.628912:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628914:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628927:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628932:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a13b0d77/0x1b69fa8920fe4373 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628935:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.628942:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.628945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628946:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.628948:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.628958:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361737.628973:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361737.628977:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.628984:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.628992:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.628994:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.628998:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.629000:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629007:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.629009:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361737.629011:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629013:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.629019:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c67bbd04/0x1b69fa8920fe437a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629022:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.629031:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.629033:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.629035:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.629040:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629047:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629181:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.629223:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.629229:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629237:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1788361737.629240:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.629240:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.629244:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629245:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629253:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.629254:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629256:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629263:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629264:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629270:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629275:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629282:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4381 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629295:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.629298:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629304:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361737.629310:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.629313:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629320:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629330:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629338:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe4388 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.629339:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.629344:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629349:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.629351:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.629351:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1788361737.629353:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.629354:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.629358:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629367:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629375:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629381:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629393:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.629409:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.629414:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629421:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458da00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.629424:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361737.629428:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.629431:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629432:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629440:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.629446:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.629447:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629451:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629454:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b5b2935/0x1b69fa8920fe438f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629460:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629466:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.629468:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.629470:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.629542:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.629549:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.629552:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629565:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.629602:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.629607:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629614:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.629617:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.629621:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629629:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629637:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629649:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629671:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361737.629709:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.629741:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361737.629744:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629751:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.629753:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629760:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629769:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629776:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bcbd16b/0x1b69fa8920fe4396 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629800:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.629804:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629810:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.629813:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629836:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629848:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629856:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7b31a6/0x1b69fa8920fe439d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.629868:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.629870:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.629871:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.629887:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.629908:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629916:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.629918:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.629921:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629927:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629932:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629936:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629948:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.629975:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.629978:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629987:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.629989:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.629991:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.629997:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630002:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630007:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630017:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361737.630035:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361737.630040:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630047:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492000 already unused, calling callback (ffffffffc0c1d300) 00002000:00010000:0.0:1788361737.630050:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788361737.630051:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630054:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630059:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630061:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.630064:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.630068:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630077:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630094:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630102:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630117:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361737.630125:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361737.630149:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630156:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041c21818/0x1b69fa8920fe43a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630182:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361737.630186:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630192:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101493a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.630196:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630203:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630213:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.630213:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.630221:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094315a15/0x1b69fa8920fe43b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.630234:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.630236:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.630243:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.630269:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630277:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101493400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.630280:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630288:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630300:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630308:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3373f21/0x1b69fa8920fe43ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630323:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.630330:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.630332:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361737.630372:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.630377:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630384:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.630387:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.630391:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630399:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630406:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630412:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630432:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361737.630467:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.630472:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630481:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.630483:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.630487:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630503:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630512:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630520:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630567:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361737.630605:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.630610:0:26169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630618:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.630620:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.630624:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630633:0:26169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630641:0:26169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.630661:0:26169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633375:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361737.633376:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788361737.633390:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633390:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.633406:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101493800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.633406:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.633412:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.633423:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633429:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633435:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.633442:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633444:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.633451:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ce0cd6e/0x1b69fa8920fe43b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633452:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a3cc3e/0x1b69fa8920fe43c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633483:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.633486:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633493:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101493e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.633496:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633503:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633513:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.633520:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.633527:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.633529:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.633540:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.633541:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.633543:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.633600:0:26169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361737.633608:0:26169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4fb32d/0x1b69fa8920fe43c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.633968:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788361737.634453:0:26169:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00002000:00010000:1.0:1788361737.634464:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.634476:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.634491:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.634495:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.634502:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361737.634592:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:94222:x1875230429892096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20056us (20334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361737.634603:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00100000:2.0:1788361737.634687:0:94222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94222:1875230429892096:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788361737.634691:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361737.634703:0:94222:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x781:0x0] from OST, last_created [0x2c0000401:0x781:0x0]last_used is [0x2c0000401:0x722:0x0] 00010000:00010000:1.0:1788361737.634703:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.634718:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.634744:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.634784:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.634790:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.634799:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.634803:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.634812:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.634844:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.634869:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069a97ad4/0x1b69fa8920fe43ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.634887:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.634890:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.634892:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.634967:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.634974:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361737.634978:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429892352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361737.634989:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.634995:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.635000:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635011:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361737.635018:0:94222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94222:1875230429892480:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788361737.635022:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635046:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361737.635055:0:94222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361737.635071:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361737.635083:0:94222:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d117862900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361737.635101:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892480 00000100:00100000:2.0:1788361737.635108:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892480 00002000:00010000:1.0:1788361737.635118:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.635125:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635221:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.635227:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.635231:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635241:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635249:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635257:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.635259:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.635267:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635277:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.635278:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.635285:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635289:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361737.635296:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.635298:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635318:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.635320:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635322:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.635342:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dec3ea8/0x1b69fa8920fe43d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635344:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635365:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635373:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000058c4c79/0x1b69fa8920fe43dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.635389:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.635392:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.635396:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.635399:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.635402:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.635403:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.635455:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.635460:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635467:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.635471:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.635475:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635485:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635498:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635505:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635520:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361737.635541:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361737.635545:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635553:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.635557:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361737.635564:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00010000:00010000:1.0:1788361737.635569:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361737.635577:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:94222:x1875230429892480:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788361737.635585:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635594:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007480f659/0x1b69fa8920fe43e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635610:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788361737.635615:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1922 00010000:00010000:1.0:1788361737.635617:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.635620:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.635671:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.635677:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635686:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.635689:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.635694:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635705:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635715:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635723:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635740:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.635800:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.635806:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635812:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.635815:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.635818:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635865:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635873:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635880:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635892:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788361737.635939:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.635943:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635951:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.635955:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.635960:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635969:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635977:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.635995:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636010:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788361737.636018:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361737.636022:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636029:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.636033:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636043:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636056:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636064:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d31826ca/0x1b69fa8920fe43ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636078:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361737.636082:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636099:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.636104:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636111:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636122:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361737.636123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361737.636190:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892352 00000100:00100000:3.0:1788361737.636195:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892352 00000100:00100000:3.0:1788361737.636227:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788361737.636236:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429892352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361737.636259:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 896 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361737.636300:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429892352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361737.636311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00010000:00010000:1.0:1788361737.636327:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daaf67a5/0x1b69fa8920fe43f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.636330:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.636339:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.636350:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.636354:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.636355:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636359:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361737.636364:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429892352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361737.636366:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.636369:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.636383:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.636391:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fbb0e6/0x1b69fa8920fe43f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.636417:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.636419:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.636422:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.636422:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.636429:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.636430:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.636440:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.636443:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.636447:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636456:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636471:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636479:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636499:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.636594:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.636599:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636608:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.636611:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.636615:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636617:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361737.636625:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636632:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636639:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.636646:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636648:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636659:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636673:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636681:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636702:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f288e61f/0x1b69fa8920fe43ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636717:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361737.636723:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361737.636729:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636750:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:3.0:1788361737.636753:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636763:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636775:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636783:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.636799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.636802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.636804:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.636814:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.636839:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636848:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.636851:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.636856:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636867:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636875:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636884:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636909:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.636957:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.636963:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636970:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.636978:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.636983:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.636992:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637001:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637009:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637020:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788361737.637070:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.637076:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637084:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.637087:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.637091:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637099:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637106:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637120:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637135:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788361737.637221:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361737.637226:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637234:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.637238:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637246:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637259:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637267:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a923bc/0x1b69fa8920fe440d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637285:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361737.637289:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637307:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.637310:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637318:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637329:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637336:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637351:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361737.637355:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637361:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.637365:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637373:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637383:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637398:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe441b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637417:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.637421:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.637423:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.637473:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1788361737.637479:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:94222:x1875230429892480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1903us (2421us total) trans 4294968757 rc 0/0 00010000:00010000:1.0:1788361737.637481:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361737.637495:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00010000:00010000:1.0:1788361737.637496:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.637501:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.637505:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637515:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637523:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361737.637541:0:94222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94222:1875230429892480:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788361737.637555:0:94222:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x781:0x0]-[0x2c0000401:0x7a1:0x0] 00010000:00010000:3.0:1788361737.637570:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.637600:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637659:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.637704:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.637709:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637717:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.637720:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.637724:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637732:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637740:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.637747:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.637854:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361737.637862:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.637870:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5a00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.637874:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.637890:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.637902:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.637902:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.637909:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.637920:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.637921:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.637924:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.637945:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.637949:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.637951:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.637952:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.637959:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.637967:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.637976:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.637978:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361737.637980:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.638049:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361737.638054:0:26165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049aec644/0x1b69fa8920fe4429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.638101:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.638106:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638114:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.638123:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.638128:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638147:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638156:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638163:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638189:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.638225:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.638229:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638237:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.638239:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.638242:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638250:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638257:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638270:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638281:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788361737.638317:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.638320:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361737.638323:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638331:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.638333:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.638337:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638345:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638352:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638358:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638361:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638377:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bee00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.638382:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638385:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361737.638396:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638418:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.638424:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.638426:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638431:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638444:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1788361737.638446:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361737.638448:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.638452:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638454:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638475:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.638478:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638481:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638492:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638496:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638508:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638516:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638517:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361737.638528:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c67945e/0x1b69fa8920fe4437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638541:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361737.638545:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.638549:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.638554:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638559:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf200 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.638561:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.638562:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.638565:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638571:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.638573:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638582:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.638582:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638590:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e13d04c/0x1b69fa8920fe443e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.638594:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638601:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.638602:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.638604:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.638605:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.638606:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.638608:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.638612:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.638668:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.638673:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638680:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.638682:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.638685:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638693:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638709:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638715:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638731:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.638819:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.638845:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.638851:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.638853:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.638861:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638862:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638883:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1788361737.638884:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638886:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.638891:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638915:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638918:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.638930:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638933:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038714eb0/0x1b69fa8920fe444c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.638936:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.638948:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.638957:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.638959:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.638963:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.638980:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.639015:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.639021:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639021:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.639028:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639033:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.639040:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.639043:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.639046:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639049:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639061:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639065:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639077:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639085:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639087:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639106:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c121f65/0x1b69fa8920fe4453 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639122:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.639124:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.639237:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.639265:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639273:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.639277:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639286:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639298:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639305:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2095731/0x1b69fa8920fe445a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639325:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.639328:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.639330:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.639333:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.639339:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639347:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.639356:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.639359:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639367:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639375:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639381:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639400:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.639438:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.639442:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639450:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.639452:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.639456:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639464:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361737.639465:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639472:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639475:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639482:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.639488:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639493:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639515:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639516:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.639531:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639539:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7a0f72/0x1b69fa8920fe4461 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639552:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.639555:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639562:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bea00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.639565:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639573:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639583:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639591:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e259ce/0x1b69fa8920fe4468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639618:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.639621:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.639623:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.639637:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.639644:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639652:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.639655:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.639659:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.639660:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639671:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639679:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639685:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639705:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.639719:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.639725:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.639733:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.639737:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.639743:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.639746:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639751:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.639760:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.639768:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4a36b6b/0x1b69fa8920fe446f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.639790:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.639792:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.639794:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.639898:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.639900:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.639904:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639914:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639921:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639928:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639943:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.639963:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.639969:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.639976:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfe00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.639980:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.639984:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788361737.639990:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.639992:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640010:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1788361737.640012:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640014:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.640022:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640026:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640038:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640046:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.640048:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.640051:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.640061:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640069:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640083:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361737.640090:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.640096:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640114:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be800 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.640118:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.640125:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.640132:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640184:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640198:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640205:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b807bfba/0x1b69fa8920fe447d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640224:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.640227:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.640232:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640237:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.640241:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.640244:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.640245:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640254:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640261:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640295:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.640311:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.640317:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640325:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfa00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.640329:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.640337:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788361737.640338:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640347:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640355:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640357:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.640364:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.640371:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640373:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ac1c782/0x1b69fa8920fe4484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640388:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640395:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.640397:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640399:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.640403:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.640409:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640424:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.640445:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.640451:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.640459:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.640466:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640477:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bec00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361737.640480:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1788361737.640483:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640494:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361737.640497:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640500:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640519:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640520:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640531:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0123eaf/0x1b69fa8920fe448b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.640545:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.640546:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.640548:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.640595:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640603:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640621:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361737.640658:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.640664:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640670:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361737.640672:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.640677:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361737.640677:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640686:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640691:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be000 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.640697:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640701:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640715:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640717:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640742:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640747:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640756:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d8dfc68/0x1b69fa8920fe4492 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640771:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.640774:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640781:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.640784:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640792:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640801:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.640808:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.640810:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.640897:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361737.640903:0:26165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009351349c/0x1b69fa8920fe4499 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361737.640953:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.640959:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640966:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.640969:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.640973:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640982:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640990:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.640997:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.641039:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361737.641045:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.641064:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715cc00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361737.641068:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.641075:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361737.641087:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.641087:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361737.641098:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.641100:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361737.641102:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361737.641125:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361737.641130:0:26165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a030f5d3/0x1b69fa8920fe44a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.641199:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361737.641255:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788361737.641261:0:26165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.641269:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1788361737.641271:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361737.641275:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.641284:0:26165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.641292:0:26165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.641299:0:26165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361737.641314:0:26165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361737.641333:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361737.641339:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.641347:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361737.641351:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.641371:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.641386:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.641394:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb55ead/0x1b69fa8920fe44a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361737.641418:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.641420:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361737.641423:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788361737.641974:0:26165:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00000100:00100000:1.0:1788361737.642067:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:94220:x1875230429892224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24665us (26950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361737.642083:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00000100:00100000:2.0:1788361737.642262:0:94220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94220:1875230429892224:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361737.642278:0:94220:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x781:0x0] from OST, last_created [0x280000401:0x781:0x0]last_used is [0x280000401:0x723:0x0] 00000100:00100000:2.0:1788361737.642357:0:94220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94220:1875230429892736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361737.642391:0:94220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361737.642423:0:94220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004ad4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361737.642608:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361737.642622:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429892608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361737.642652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361737.642714:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892736 00000100:00100000:1.0:1788361737.642720:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892736 00000100:00100000:2.0:1788361737.642925:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892608 00000100:00100000:2.0:1788361737.642929:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892608 00000100:00100000:2.0:1788361737.642966:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1788361737.642975:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429892608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361737.642994:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788361737.643031:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429892608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361737.643049:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1788361737.643081:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429892608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361737.643127:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00000100:00100000:1.0:1788361737.643146:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:94220:x1875230429892736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788361737.643188:0:8535:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00000100:00100000:1.0:1788361737.644692:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94220:x1875230429892736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1553us (2296us total) trans 4294968752 rc 0/0 00000100:00100000:1.0:1788361737.644701:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00000100:00100000:2.0:1788361737.644772:0:94220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94220:1875230429892736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361737.644783:0:94220:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x781:0x0]-[0x280000401:0x7a1:0x0] 00000001:00100000:2.0:1788361738.072082:0:75524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788361738.326625:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361738.440143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361738.440196:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045248 00000100:00100000:3.0:1788361738.440206:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045248 00000100:00100000:3.0:1788361738.440264:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788361738.440277:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+5:70890:x1875230407045248:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361738.440293:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361738.440314:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110c3 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.440341:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 6 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.440350:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 6 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.440363:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308200, rc 0) 00000100:00100000:3.0:1788361738.440408:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407045248:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 137us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361738.440414:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788361738.445911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361738.446006:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045376 00000100:00100000:2.0:1788361738.446018:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045376 00000100:00100000:2.0:1788361738.446069:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:2.0:1788361738.446078:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407045376:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361738.446101:0:94208:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788361738.446115:0:94208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361738.446118:0:94208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788361738.446120:0:94208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788361738.446122:0:94208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788361738.446125:0:94208:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:2.0:1788361738.448126:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407045376:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 2041us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361738.448141:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:0.0:1788361738.451491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361738.451529:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045504 00000100:00100000:3.0:1788361738.451539:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045504 00000100:00100000:3.0:1788361738.451591:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1788361738.451603:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+6:70890:x1875230407045504:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361738.451618:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361738.451634:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110ca expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.451661:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 7 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.451669:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 7 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.451675:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308600, rc 0) 00000100:00100000:3.0:1788361738.451716:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+7:70890:x1875230407045504:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361738.451722:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1788361738.455533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361738.455606:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045632 00000100:00100000:1.0:1788361738.455616:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045632 00000100:00100000:1.0:1788361738.455699:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:1.0:1788361738.455708:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+7:70890:x1875230407045632:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361738.455879:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407045632:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 170us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361738.455886:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788361738.458074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361738.458221:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045760 00000100:00100000:3.0:1788361738.458233:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045760 00000100:00100000:1.0:1788361738.458318:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:1.0:1788361738.458331:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407045760:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361738.458504:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407045760:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 174us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361738.458512:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788361738.462681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361738.462745:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407045888 00000100:00100000:3.0:1788361738.462757:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407045888 00000100:00100000:3.0:1788361738.462880:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788361738.462893:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407045888:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361738.462911:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361738.462929:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d004308000/0x1b69fa8920fe44bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110d1 expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.462960:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d004308000/0x1b69fa8920fe44bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d1 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.462972:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d004308000/0x1b69fa8920fe44bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d1 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361738.462982:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004308000, rc 0) 00000100:00100000:3.0:1788361738.463341:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407045888:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 449us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361738.463349:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788361738.467909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361738.468118:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046016 00000100:00100000:0.0:1788361738.468142:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046016 00000100:00100000:0.0:1788361738.468253:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:0.0:1788361738.468265:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407046016:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361738.468445:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407046016:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 182us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361738.468453:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:1.0:1788361738.469962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361738.470006:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046144 00000100:00100000:3.0:1788361738.470015:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046144 00000100:00100000:3.0:1788361738.470086:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:3.0:1788361738.470098:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407046144:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361738.470231:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407046144:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 133us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361738.470238:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:3.0:1788361738.473765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361738.473852:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046272 00000100:00100000:0.0:1788361738.473862:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046272 00000100:00100000:0.0:1788361738.473918:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:0.0:1788361738.473926:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407046272:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361738.473942:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361738.473959:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110d8 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361738.473985:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 10 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361738.473996:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 10 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361738.474006:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d101493800, rc 0) 00000100:00100000:0.0:1788361738.474054:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407046272:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 129us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361738.474061:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:3.0:1788361738.476766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361738.476887:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046400 00000100:00100000:0.0:1788361738.476896:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046400 00000100:00100000:0.0:1788361738.476936:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:0.0:1788361738.476944:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407046400:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361738.477042:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407046400:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 99us (284us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361738.477051:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00010000:00010000:0.0:1788361739.351350:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361740.297443:0:94783:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788361740.376459:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361741.049790:0:94831:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788361741.142046:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429892864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361741.142053:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429892992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361741.142179:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361741.142220:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892992 00000100:00100000:3.0:1788361741.142230:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892992 00000100:00100000:2.0:1788361741.142261:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361741.142282:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361741.142297:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429892864 00000100:00100000:2.0:1788361741.142311:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:2.0:1788361741.142322:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429892992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788361741.142350:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361741.142364:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429892864 00000100:00100000:3.0:1788361741.142412:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:2.0:1788361741.142417:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429892992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.142425:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429892864:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361741.142432:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00002000:00000024:3.0:1788361741.142446:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361741.142493:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429892864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.142501:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:2.0:1788361741.142540:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429892864:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788361741.142563:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361741.142720:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429892992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788361741.398207:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361741.703552:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361741.703609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361741.703642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361741.703675:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361741.703701:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361741.703765:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046656 00000100:00100000:3.0:1788361741.703783:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046784 00000100:00100000:1.0:1788361741.703788:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046656 00000100:00100000:3.0:1788361741.703790:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046784 00000100:00100000:0.0:1788361741.703886:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046528 00000100:00100000:0.0:1788361741.703891:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046528 00000100:00100000:1.0:1788361741.703907:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 944 00000100:00100000:1.0:1788361741.703921:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407046656:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361741.703938:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:0.0:1788361741.703948:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407046528:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361741.704011:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407046656:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 94us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361741.704019:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 944 00000100:00100000:1.0:1788361741.704044:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407046912 00000100:00100000:1.0:1788361741.704047:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407046912 00000100:00080000:2.0:1788361741.704130:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361741.704137:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361741.704140:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361741.704156:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047040 00000100:00100000:1.0:1788361741.704161:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047040 00000100:00100000:2.0:1788361741.704174:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1931 00000100:00100000:3.0:1788361741.704184:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 945 00000100:00100000:2.0:1788361741.704187:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407046912:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361741.704198:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2412:x1875230407046784:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361741.704205:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1932 00000100:00100000:1.0:1788361741.704216:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407047040:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361741.705907:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407046528:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1953us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361741.705920:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:2.0:1788361741.705927:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407046912:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1742us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361741.705937:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1931 00000100:00080000:0.0:1788361741.706001:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361741.706380:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2412:x1875230407047040:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2165us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361741.706386:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1932 00000100:00100000:3.0:1788361741.706542:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2412:x1875230407046784:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2346us (2896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.706550:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 945 00000100:00100000:2.0:1788361742.166141:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429893120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361742.166207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361742.166315:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893120 00000100:00100000:3.0:1788361742.166325:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893120 00000100:00100000:3.0:1788361742.166414:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224 00000100:00100000:3.0:1788361742.166424:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429893120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788361742.166458:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:3.0:1788361742.166518:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429893120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.166526:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224 00000100:00100000:0.0:1788361742.166610:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429893120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788361742.422455:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361742.442854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361742.442930:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047168 00000100:00100000:0.0:1788361742.442940:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047168 00000100:00100000:0.0:1788361742.443003:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1361 00000100:00100000:0.0:1788361742.443021:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72775:x1875230407047168:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788361742.443045:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361742.443069:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493400/0x1b69fa8920fe44ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110df expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.443144:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe44d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.443158:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.443170:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361742.443255:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788361742.443259:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361742.443297:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.443320:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493400/0x1b69fa8920fe44ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110df expref: 8 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.443451:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe44d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110df expref: 7 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.443460:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:0.0:1788361742.443463:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361742.443467:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d101493e00, rc 0) 00000100:00100000:0.0:1788361742.443534:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:72775:x1875230407047168:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 522us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361742.443544:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1361 00000100:00100000:2.0:1788361742.446091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361742.446164:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047296 00000100:00100000:1.0:1788361742.446174:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047296 00000100:00100000:1.0:1788361742.446236:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1362 00000100:00100000:1.0:1788361742.446248:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:72775:x1875230407047296:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788361742.446329:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:1.0:1788361742.446396:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:72775:x1875230407047296:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 150us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.446404:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1362 00000100:00100000:2.0:1788361742.447911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361742.447962:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047424 00000100:00100000:0.0:1788361742.447982:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047424 00000100:00100000:0.0:1788361742.448040:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1363 00000100:00100000:0.0:1788361742.448049:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:72775:x1875230407047424:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788361742.448086:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1788361742.451168:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:72775:x1875230407047424:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 3108us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361742.451181:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1363 00000100:00100000:2.0:1788361742.454125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361742.454434:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047552 00000100:00100000:3.0:1788361742.454445:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047552 00000100:00100000:3.0:1788361742.454537:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1574 00000100:00100000:3.0:1788361742.454547:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72775:x1875230407047552:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788361742.454573:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361742.454645:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:72775:x1875230407047552:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 93us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.454652:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1574 00000100:00100000:2.0:1788361742.456629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361742.456681:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047680 00000100:00100000:3.0:1788361742.456691:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047680 00000100:00100000:3.0:1788361742.456793:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1575 00000100:00100000:3.0:1788361742.456803:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:72775:x1875230407047680:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788361742.456850:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361742.456914:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:72775:x1875230407047680:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.456920:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1575 00000100:00100000:0.0:1788361742.467452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361742.467724:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047808 00000100:00100000:2.0:1788361742.467751:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047808 00000100:00100000:2.0:1788361742.467813:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1364 00000100:00100000:2.0:1788361742.467861:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:71676:x1875230407047808:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788361742.467884:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361742.467906:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe44d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110e6 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.467968:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.467983:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.467995:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468005:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468009:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468013:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468178:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe44ed lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468185:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe44ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468192:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe44ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361742.468229:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361742.468233:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361742.468266:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe44ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468280:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468286:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468293:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468298:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361742.468302:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468310:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468322:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361742.468325:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361742.468329:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468334:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe44df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468347:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468363:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468369:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468388:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361742.468392:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468398:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468406:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99d009c1d000) 00010000:00010000:2.0:1788361742.468409:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361742.468412:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468417:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20a00/0x1b69fa8920fe44e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468445:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe44d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110e6 expref: 9 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468457:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21e00/0x1b69fa8920fe44ed lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110e6 expref: 8 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.468463:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1db00) 00010000:00010000:2.0:1788361742.468466:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361742.468474:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21e00, rc 0) 00000100:00100000:2.0:1788361742.468536:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71676:x1875230407047808:12345-192.168.204.35@tcp:101:bash.0 Request processed in 714us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.468543:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1364 00000100:00100000:2.0:1788361742.471336:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361742.471558:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407047936 00000100:00100000:0.0:1788361742.471567:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407047936 00000100:00100000:0.0:1788361742.471625:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1365 00000100:00100000:0.0:1788361742.471634:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:71676:x1875230407047936:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788361742.471671:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361742.471690:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492800/0x1b69fa8920fe44f4 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110ed expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.472012:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.472026:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.472037:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.472056:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.472064:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361742.472070:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361742.472402:0:66901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66901:1875230429893248:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788361742.472460:0:66901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361742.472492:0:66901:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d136fd4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361742.472510:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893248 00000100:00100000:2.0:1788361742.472515:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893248 00000100:00100000:2.0:1788361742.472548:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225 00000100:00100000:2.0:1788361742.472555:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66901:x1875230429893248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788361742.472643:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66901:x1875230429893248:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.472649:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225 00000100:00100000:3.0:1788361742.472693:0:66901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66901:1875230429893248:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788361742.472739:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458da00/0x1b69fa8920fe4509 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472750:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458da00/0x1b69fa8920fe4509 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472760:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458da00/0x1b69fa8920fe4509 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361742.472784:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458da00/0x1b69fa8920fe4509 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472812:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472841:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472849:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472856:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472863:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361742.472867:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472876:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472890:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1db00) 00010000:00010000:3.0:1788361742.472894:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361742.472898:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472904:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe44fb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472933:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472939:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472951:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472957:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361742.472960:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472967:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472975:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99d119de6f00) 00010000:00010000:3.0:1788361742.472978:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361742.472981:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.472986:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492400/0x1b69fa8920fe4502 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.473026:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492800/0x1b69fa8920fe44f4 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ed expref: 10 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.473042:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458da00/0x1b69fa8920fe4509 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ed expref: 9 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.473047:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d004359100) 00010000:00010000:3.0:1788361742.473049:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361742.473050:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458da00, rc 0) 00000100:00100000:3.0:1788361742.473103:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71676:x1875230407047936:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1470us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.473119:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1365 00000100:00100000:3.0:1788361742.475040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361742.475101:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048064 00000100:00100000:2.0:1788361742.475110:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048064 00000100:00100000:2.0:1788361742.475163:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1366 00000100:00100000:2.0:1788361742.475172:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71676:x1875230407048064:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788361742.475187:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361742.475242:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe4510 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110f4 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.475308:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4517 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.475321:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4517 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.475341:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4517 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361742.475399:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1788361742.475402:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788361742.475439:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe4510 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110f4 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.475450:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4517 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110f4 expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.475455:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d004359900) 00010000:00010000:2.0:1788361742.475457:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788361742.475459:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20a00, rc 0) 00000100:00100000:2.0:1788361742.475505:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71676:x1875230407048064:12345-192.168.204.35@tcp:101:bash.0 Request processed in 334us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.475512:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1366 00000100:00100000:0.0:1788361742.478694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361742.478755:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048192 00000100:00100000:2.0:1788361742.478764:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048192 00000100:00100000:2.0:1788361742.478872:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 695 00000100:00100000:2.0:1788361742.478883:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1178ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407048192:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361742.478898:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361742.478922:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4517 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110f4 expref: 10 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.478949:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d004359900) 00010000:00010000:2.0:1788361742.478955:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361742.479220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361742.479400:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048320 00000100:00100000:1.0:1788361742.479406:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048320 00000100:00100000:2.0:1788361742.479441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1178ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407048192:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 559us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.479446:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1367 00000100:00100000:1.0:1788361742.479453:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71676:x1875230407048320:12345-192.168.204.35@tcp:101:bash.0 00000100:00100000:2.0:1788361742.479464:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 695 00010000:00010000:1.0:1788361742.479473:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361742.479499:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715d000/0x1b69fa8920fe451e lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7110fb expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479557:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479569:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479580:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479594:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479601:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479607:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479689:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c600/0x1b69fa8920fe4533 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479703:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c600/0x1b69fa8920fe4533 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.479709:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c600/0x1b69fa8920fe4533 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361742.479891:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788361742.479904:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361742.479989:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c600/0x1b69fa8920fe4533 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480004:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c600/0x1b69fa8920fe4533 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480013:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480020:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480027:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480034:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480041:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715da00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361742.480045:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480053:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480063:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99d004359900) 00010000:00010000:1.0:1788361742.480066:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361742.480070:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480088:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715da00/0x1b69fa8920fe4525 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480110:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480117:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480121:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480125:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361742.480126:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480130:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480136:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff99d0040d4f00) 00010000:00010000:1.0:1788361742.480137:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361742.480139:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480143:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c200/0x1b69fa8920fe452c lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480166:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715d000/0x1b69fa8920fe451e lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110fb expref: 11 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480174:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d13715c600/0x1b69fa8920fe4533 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110fb expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.480235:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99d112d1b100) 00010000:00010000:1.0:1788361742.480237:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361742.480240:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c600, rc 0) 00000100:00100000:1.0:1788361742.480296:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71676:x1875230407048320:12345-192.168.204.35@tcp:101:bash.0 Request processed in 845us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.480302:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1367 00000100:00100000:0.0:1788361742.483053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361742.483511:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048448 00000100:00100000:3.0:1788361742.483524:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048448 00000100:00100000:3.0:1788361742.483595:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4939 00000100:00100000:3.0:1788361742.483608:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407048448:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788361742.483631:0:26162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361742.483655:0:26162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe453a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711102 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361742.483683:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x223:0x0] initial LVB size: 0, mtime: 0x6a983bf2, atime: 0x6a983bf2, ctime: 0x6a983bf2, blocks: 0x0 00010000:00010000:3.0:1788361742.483708:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=2782s v=(0 0) 00010000:00010000:3.0:1788361742.483713:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361742.483723:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe453a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711102 expref: 6 pid: 26162 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.483746:0:26162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000609fe173/0x1b69fa8920fe453a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711102 expref: 6 pid: 26162 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.483761:0:26162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c800, rc 0) 00000100:00100000:3.0:1788361742.484235:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407048448:12345-192.168.204.35@tcp:101:bash.0 Request processed in 630us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.484244:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4939 00000100:00100000:2.0:1788361742.489275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361742.489925:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048576 00000100:00100000:1.0:1788361742.489936:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048576 00000100:00100000:1.0:1788361742.490015:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1368 00000100:00100000:1.0:1788361742.490027:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:71676:x1875230407048576:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788361742.490049:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361742.490071:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4541 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711109 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.490153:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.490165:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.490176:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.490188:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.490195:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.490220:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361742.490335:0:66126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038de300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66126:1875230429893376:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788361742.490394:0:66126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361742.490434:0:66126:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10f7af9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361742.490622:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893376 00000100:00100000:2.0:1788361742.490626:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893376 00000100:00100000:2.0:1788361742.490669:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226 00000100:00100000:2.0:1788361742.490676:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66126:x1875230429893376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788361742.490791:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66126:x1875230429893376:12345-0@lo:1000:mdt00_000.0 Request processed in 116us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.490796:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226 00000100:00100000:1.0:1788361742.493913:0:66126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038de300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66126:1875230429893376:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788361742.493990:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715de00/0x1b69fa8920fe4556 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494007:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715de00/0x1b69fa8920fe4556 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494019:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715de00/0x1b69fa8920fe4556 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361742.494047:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715de00/0x1b69fa8920fe4556 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494063:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494070:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494088:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494094:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494117:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361742.494122:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494130:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494142:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99d009c1db00) 00010000:00010000:1.0:1788361742.494145:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361742.494149:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494155:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c200/0x1b69fa8920fe4548 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494167:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494173:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494179:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494184:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715da00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361742.494187:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494194:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494213:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99d0040d4f00) 00010000:00010000:1.0:1788361742.494216:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361742.494219:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494226:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe454f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494271:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4541 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711109 expref: 11 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494287:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715de00/0x1b69fa8920fe4556 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711109 expref: 10 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361742.494294:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d0040d4d00) 00010000:00010000:1.0:1788361742.494297:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361742.494299:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715de00, rc 0) 00000100:00100000:1.0:1788361742.494361:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71676:x1875230407048576:12345-192.168.204.35@tcp:101:bash.0 Request processed in 4336us (5094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.494370:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1368 00000100:00100000:2.0:1788361742.497398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361742.497512:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048704 00000100:00100000:3.0:1788361742.497523:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048704 00000100:00100000:3.0:1788361742.497612:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1369 00000100:00100000:3.0:1788361742.497626:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:71676:x1875230407048704:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788361742.497651:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361742.497745:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458d400/0x1b69fa8920fe455d lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711110 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.497812:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4564 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.497845:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4564 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.497858:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4564 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361742.497912:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788361742.497917:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788361742.497957:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458d400/0x1b69fa8920fe455d lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711110 expref: 12 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.497975:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4564 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711110 expref: 11 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.497984:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1ba00) 00010000:00010000:3.0:1788361742.497987:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788361742.497990:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458cc00, rc 0) 00000100:00100000:3.0:1788361742.498056:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71676:x1875230407048704:12345-192.168.204.35@tcp:101:bash.0 Request processed in 433us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.498063:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1369 00000100:00100000:0.0:1788361742.501297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361742.501347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361742.501418:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048832 00000100:00100000:3.0:1788361742.501431:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048832 00000100:00100000:2.0:1788361742.501445:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407048960 00000100:00100000:2.0:1788361742.501451:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407048960 00000100:00100000:3.0:1788361742.501493:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 696 00000100:00100000:3.0:1788361742.501504:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2412:x1875230407048832:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361742.501520:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361742.501549:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1370 00010000:00010000:3.0:1788361742.501552:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4564 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711110 expref: 12 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361742.501562:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:71676:x1875230407048960:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788361742.501576:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1ba00) 00010000:00010000:2.0:1788361742.501582:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361742.501583:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361742.501602:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe456b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711117 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361742.501651:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2412:x1875230407048832:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.501659:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 696 00010000:00010000:2.0:1788361742.501681:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501696:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501707:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501723:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501738:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501745:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501865:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4580 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501875:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4580 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501882:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4580 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361742.501930:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1788361742.501936:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361742.501958:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4580 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501971:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4580 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501980:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501987:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 2/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.501994:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502011:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361742.502016:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502024:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502034:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99d112d1ba00) 00010000:00010000:2.0:1788361742.502037:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361742.502041:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502047:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20600/0x1b69fa8920fe4572 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502057:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502069:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502085:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502090:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361742.502092:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502098:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502117:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff99d009c1d000) 00010000:00010000:2.0:1788361742.502120:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361742.502123:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502129:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c21600/0x1b69fa8920fe4579 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502222:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20800/0x1b69fa8920fe456b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711117 expref: 12 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502239:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d137c20a00/0x1b69fa8920fe4580 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711117 expref: 11 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361742.502246:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99d112d1b800) 00010000:00010000:2.0:1788361742.502249:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361742.502251:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20a00, rc 0) 00000100:00100000:2.0:1788361742.502327:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:71676:x1875230407048960:12345-192.168.204.35@tcp:101:bash.0 Request processed in 769us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.502335:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1370 00000100:00100000:0.0:1788361742.504410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361742.504641:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049088 00000100:00100000:3.0:1788361742.504649:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049088 00000100:00100000:3.0:1788361742.504712:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4940 00000100:00100000:3.0:1788361742.504722:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407049088:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788361742.504740:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361742.504767:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4587 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71111e expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361742.504793:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x224:0x0] initial LVB size: 0, mtime: 0x6a983bf2, atime: 0x6a983bf2, ctime: 0x6a983bf2, blocks: 0x0 00010000:00010000:3.0:1788361742.504818:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x224:0x0].0x0 since=2782s v=(0 0) 00010000:00010000:3.0:1788361742.504864:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x224:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361742.504878:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4587 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71111e expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.504922:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c18ac90/0x1b69fa8920fe4587 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71111e expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361742.504937:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d400, rc 0) 00000100:00100000:3.0:1788361742.504986:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407049088:12345-192.168.204.35@tcp:101:bash.0 Request processed in 266us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.504994:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4940 00000100:00100000:0.0:1788361742.678091:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361742.678115:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429893504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361742.678193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361742.678242:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429893888:0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.678310:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429894016:0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.678322:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429893632:0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.678344:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429893760:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.678573:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361742.678596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361742.678615:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429894528:0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.678623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361742.678628:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893888 00000100:00100000:2.0:1788361742.678638:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893888 00000100:00100000:3.0:1788361742.678647:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429894144:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.678687:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361742.678694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361742.678700:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429894400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361742.678712:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894016 00000100:00100000:2.0:1788361742.678719:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894016 00000100:00100000:0.0:1788361742.678730:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429895040:0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.678737:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429894656:0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.678760:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894144 00000100:00100000:1.0:1788361742.678764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361742.678768:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894144 00000100:00100000:0.0:1788361742.678777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361742.678806:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429895168:0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.678852:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1788361742.678865:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1788361742.678880:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361742.678883:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429893888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.678886:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893632 00000100:00100000:0.0:1788361742.678892:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893632 00000100:00100000:2.0:1788361742.678895:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429894016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.678956:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894400 00000100:00100000:1.0:1788361742.678964:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894400 00000100:00100000:2.0:1788361742.678995:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429894016:12345-0@lo:400:kworker.0 Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.679004:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1788361742.679024:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1788361742.679032:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429894144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.679060:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429894144:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.679066:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1788361742.679107:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894528 00000100:00100000:2.0:1788361742.679112:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894528 00000100:00100000:0.0:1788361742.679393:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788361742.679403:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429893632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.679449:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429893632:12345-0@lo:400:kworker.0 Request processed in 48us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.679459:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:0.0:1788361742.679468:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788361742.679478:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429894400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361742.679507:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361742.679568:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429895168 00000100:00100000:2.0:1788361742.679568:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429895040 00000100:00100000:1.0:1788361742.679569:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429894400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.679576:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429895040 00000100:00100000:3.0:1788361742.679577:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429895168 00000100:00100000:1.0:1788361742.679593:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:2.0:1788361742.679627:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1788361742.679642:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361742.679650:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429894528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.679651:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1788361742.679667:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429895040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.679694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429894272:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.679725:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1788361742.679739:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429894528:12345-0@lo:400:kworker.0 Request processed in 101us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361742.679742:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429895168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.679743:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3652:x1875230429895040:12345-0@lo:400:kworker.0 Request processed in 78us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361742.679756:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1788361742.679768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361742.679774:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00080000:2.0:1788361742.679798:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361742.679807:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361742.679811:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361742.679813:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361742.679871:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893760 00000100:00100000:3.0:1788361742.679877:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361742.679878:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893760 00000100:00100000:2.0:1788361742.679908:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1788361742.679914:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429893760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.680141:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429894912:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680151:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429895168:12345-0@lo:400:kworker.0 Request processed in 411us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.680162:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429895296:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680164:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:0.0:1788361742.680183:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894656 00000100:00100000:0.0:1788361742.680188:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894656 00000100:00100000:2.0:1788361742.680191:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875230429893760:12345-0@lo:400:kworker.0 Request processed in 275us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.680210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361742.680218:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1788361742.680221:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:0.0:1788361742.680235:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429894656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.680249:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429894784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361742.680250:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894912 00000100:00100000:2.0:1788361742.680259:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894912 00000100:00100000:2.0:1788361742.680294:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1788361742.680299:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429894656:12345-0@lo:400:kworker.0 Request processed in 68us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361742.680315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361742.680316:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429894912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680316:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1788361742.680327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361742.680444:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429893632:0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.680505:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429894912:12345-0@lo:400:kworker.0 Request processed in 201us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.680510:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429894144:0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.680513:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875230429893760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.680522:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1788361742.680537:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429894656:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680544:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429893504 00000100:00100000:0.0:1788361742.680550:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429893504 00000100:00100000:2.0:1788361742.680554:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429895296 00000100:00100000:1.0:1788361742.680554:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429894912:0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.680564:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429895296 00000100:00100000:2.0:1788361742.680608:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1788361742.680610:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894272 00000100:00100000:0.0:1788361742.680615:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894272 00000100:00100000:2.0:1788361742.680620:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429895296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.680627:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875230429893888:12345-0@lo:400:kworker.0 Request processed in 1759us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.680637:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1788361742.680648:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429894016:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680657:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227 00000100:00100000:0.0:1788361742.680672:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3652:x1875230429893504:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361742.680690:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429894400:0@lo:13:osp-pre-1-0.0 00000004:00000024:0.0:1788361742.680693:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:3.0:1788361742.680700:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4228 00000100:00100000:1.0:1788361742.680714:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429895168:0@lo:400:kworker.0 00000100:00100000:3.0:1788361742.680716:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1875230429894272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680749:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3652:x1875230429893504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361742.680758:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227 00000100:00100000:2.0:1788361742.680793:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429895296:12345-0@lo:400:kworker.0 Request processed in 175us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361742.680794:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429894272:12345-0@lo:400:kworker.0 Request processed in 83us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361742.680795:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429894784 00000100:00100000:0.0:1788361742.680801:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429894784 00000100:00100000:3.0:1788361742.680816:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4228 00000100:00100000:2.0:1788361742.680816:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1788361742.680882:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429894528:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680891:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00080000:2.0:1788361742.680899:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361742.680910:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429894784:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361742.680916:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429895296:0@lo:400:kworker.0 00000100:00100000:1.0:1788361742.680919:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429895040:0@lo:400:kworker.0 00002000:00000024:0.0:1788361742.680925:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361742.680960:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875230429893888:0@lo:400:kworker.0 00000100:00100000:2.0:1788361742.680970:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429894272:0@lo:400:kworker.0 00000100:00100000:0.0:1788361742.680983:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429894784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361742.680995:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:1.0:1788361742.681027:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429893504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361742.681031:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429894784:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788361743.194709:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968752 is committed 00000001:00100000:2.0:1788361743.194759:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1e400d1-472b-42d1-b5e7-e80dc701272a 00000001:00080000:1.0:1788361743.195242:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968757 is committed 00010000:00010000:0.0:1788361743.446253:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361744.470497:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361745.495450:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361745.923745:0:95122:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe604b2870 20000000:00000080:0.0:1788361745.923761:0:95122:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99d11f2e7800 uarg=0000000000000000 00000040:00100000:0.0:1788361745.924428:0:95122:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:0.0:1788361745.924434:0:95122:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1788361745.924446:0:95122:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1788361745.925241:0:95123:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 42 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1788361745.925312:0:95123:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 42 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788361745.925320:0:95123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:3.0:1788361745.925458:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:3.0:1788361745.925476:0:95122:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788361745.925492:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:3.0:1788361745.925509:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:3.0:1788361745.925523:0:95122:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1788361745.926387:0:95124:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 43 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1788361745.926436:0:95124:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 43 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788361745.926450:0:95124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:3.0:1788361745.926673:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:3.0:1788361745.926686:0:95122:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788361745.926700:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:3.0:1788361745.926716:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:3.0:1788361745.926728:0:95122:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1788361745.928233:0:95125:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1788361745.928302:0:95125:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788361745.928317:0:95125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:3.0:1788361745.928651:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:3.0:1788361745.928677:0:95122:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788361745.928695:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:3.0:1788361745.928713:0:95122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:3.0:1788361745.928728:0:95122:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788361745.928752:0:95122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928772:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928783:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928790:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928796:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928802:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928808:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928815:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928847:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928855:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928874:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928882:0:95122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.928890:0:95122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.929451:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.929476:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 9 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.929492:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895424:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788361745.929602:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.929612:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.929620:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895552:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788361745.929652:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.929661:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 23 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.929684:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895680:0@lo:104: 00000100:00100000:3.0:1788361745.929724:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361745.929766:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.929775:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 23 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.929783:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895808:0@lo:104: 00000100:00100000:3.0:1788361745.929807:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361745.929886:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.929894:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 23 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.929902:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895936:0@lo:104: 00000100:00100000:3.0:1788361745.929925:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361745.929953:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429895680 00000100:00100000:0.0:1788361745.929961:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429895680 00010000:00010000:3.0:1788361745.930042:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.930051:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 23 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930059:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896064:0@lo:104: 00000100:00100000:1.0:1788361745.930065:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429895808 00000100:00100000:1.0:1788361745.930071:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429895808 00000100:00100000:3.0:1788361745.930086:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.930114:0:92924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788361745.930115:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.930130:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429895936 00000100:00100000:1.0:1788361745.930134:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429895936 00000100:00100000:1.0:1788361745.930146:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896064 00000100:00100000:1.0:1788361745.930148:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896064 00000100:00100000:1.0:1788361745.930162:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788361745.930173:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:95122:x1875230429895808:12345-0@lo:104: 00010000:00010000:3.0:1788361745.930192:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 23 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.930192:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930216:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896192:0@lo:104: 00000100:00100000:3.0:1788361745.930253:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361745.930259:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361745.930266:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:95122:x1875230429895808:12345-0@lo:104: Request processed in 95us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.930273:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:3.0:1788361745.930277:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.930287:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 23 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.930292:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896192 00000100:00100000:1.0:1788361745.930298:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896192 00000100:00100000:3.0:1788361745.930299:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896320:0@lo:104: 00000100:00100000:1.0:1788361745.930316:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788361745.930323:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:95122:x1875230429895936:12345-0@lo:104: 00010000:00010000:1.0:1788361745.930330:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930340:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361745.930373:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788361745.930375:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.930382:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+5:95122:x1875230429895936:12345-0@lo:104: Request processed in 58us (456us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361745.930392:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 23 pid: 94207 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930406:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896448:0@lo:104: 00000100:00100000:1.0:1788361745.930410:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788361745.930427:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896320 00000100:00100000:1.0:1788361745.930431:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896320 00000100:00100000:3.0:1788361745.930436:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.930446:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896448 00000100:00100000:1.0:1788361745.930449:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896448 00010000:00010000:3.0:1788361745.930462:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.930466:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00010000:00010000:3.0:1788361745.930478:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 23 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.930479:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d003974450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429896064:12345-0@lo:104: 00010000:00010000:1.0:1788361745.930493:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930496:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13ffa2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896576:0@lo:104: 00010000:00010000:1.0:1788361745.930539:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788361745.930545:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.930549:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d003974450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429896064:12345-0@lo:104: Request processed in 72us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.930556:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788361745.930569:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896576 00000100:00100000:1.0:1788361745.930572:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896576 00010000:00010000:3.0:1788361745.930579:0:95122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.930590:0:95122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 23 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930600:0:95122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896704:0@lo:104: 00000100:00100000:1.0:1788361745.930610:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788361745.930618:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429896192:12345-0@lo:104: 00000100:00100000:3.0:1788361745.930627:0:95122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361745.930627:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.930642:0:95122:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c71900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361745.930665:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895808:0@lo:104: 00000100:00100000:2.0:1788361745.930711:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896704 00000100:00100000:2.0:1788361745.930717:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896704 00010000:00010000:1.0:1788361745.930728:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788361745.930731:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788361745.930736:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:95122:x1875230429896192:12345-0@lo:104: Request processed in 118us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361745.930744:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+8:95122:x1875230429896320:12345-0@lo:104: 00000100:00100000:1.0:1788361745.930746:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788361745.930757:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00010000:00010000:0.0:1788361745.930758:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.930767:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788361745.930771:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:95122:x1875230429896448:12345-0@lo:104: 00000100:00100000:1.0:1788361745.930781:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:95122:x1875230429896576:12345-0@lo:104: 00010000:00010000:2.0:1788361745.930782:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.930805:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:1.0:1788361745.930811:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.930813:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+7:95122:x1875230429896320:12345-0@lo:104: Request processed in 73us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361745.930848:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:2.0:1788361745.930859:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788361745.930867:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429896448:12345-0@lo:104: Request processed in 100us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361745.930874:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00010000:00010000:1.0:1788361745.930882:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788361745.930883:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429895680:12345-0@lo:104: 00000100:00100000:1.0:1788361745.930891:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429896576:12345-0@lo:104: Request processed in 114us (347us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361745.930895:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.930928:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788361745.930934:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+6:95122:x1875230429895680:12345-0@lo:104: Request processed in 54us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361745.931022:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895936:0@lo:104: 00000100:00100000:3.0:1788361745.931055:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896064:0@lo:104: 00000100:00100000:3.0:1788361745.931063:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896192:0@lo:104: 00000100:00100000:3.0:1788361745.931070:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896320:0@lo:104: 00000100:00100000:3.0:1788361745.931077:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896448:0@lo:104: 00000100:00100000:3.0:1788361745.931083:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896576:0@lo:104: 00000100:00100000:3.0:1788361745.931093:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895680:0@lo:104: 00000100:00100000:2.0:1788361745.931563:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788361745.931593:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788361745.931612:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788361745.931620:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95122:x1875230429896704:12345-0@lo:104: 00010000:00010000:1.0:1788361745.931628:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931670:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1788361745.931675:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95122:x1875230429896704:12345-0@lo:104: Request processed in 57us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.931681:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00010000:1.0:1788361745.931700:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788361745.931705:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931713:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361745.931717:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931725:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361745.931733:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361745.931746:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788361745.931768:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429896704:0@lo:104: 00010000:00010000:1.0:1788361745.931775:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931781:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.931807:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931814:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012ea600/0x1b69fa8920fe425b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4262 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931850:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788361745.931853:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931860:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361745.931863:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931869:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361745.931876:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361745.931881:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361745.931894:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931899:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.931913:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931920:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012eb800/0x1b69fa8920fe424d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4254 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.931925:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00010000:00010000:1.0:1788361745.931936:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788361745.931940:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931946:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361745.931950:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931957:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361745.931964:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361745.931969:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361745.931982:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.931988:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.932017:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932024:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012eb600/0x1b69fa8920fe4231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4238 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.932027:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788361745.932037:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932039:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788361745.932046:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:1.0:1788361745.932048:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361745.932053:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932054:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788361745.932055:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361745.932061:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932064:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.932068:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932076:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932087:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:2.0:1788361745.932091:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361745.932093:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361745.932095:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361745.932110:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361745.932115:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361745.932118:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1788361745.932139:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932141:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361745.932156:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361745.932157:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.932167:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932175:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309c00/0x1b69fa8920fe41f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe4200 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932177:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932190:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361745.932198:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932205:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361745.932206:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012ea200/0x1b69fa8920fe41dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932211:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932222:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:0.0:1788361745.932224:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1788361745.932225:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932231:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932247:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932254:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361745.932259:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361745.932260:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361745.932277:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361745.932281:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361745.932289:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361745.932295:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361745.932296:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932304:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.932310:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932316:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932317:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012ea400/0x1b69fa8920fe41ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41b3 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932331:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.932339:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361745.932339:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932346:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932350:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139db4800/0x1b69fa8920fe4285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe428c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932356:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309800 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361745.932363:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932366:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361745.932369:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361745.932372:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932373:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1788361745.932381:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.932382:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361745.932390:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788361745.932402:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429896960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361745.932404:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932411:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.932415:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932419:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309800/0x1b69fa8920fe40d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe40da expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932427:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361745.932429:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361745.932430:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361745.932440:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361745.932446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.932476:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361745.932504:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429897600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361745.932506:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361745.932533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361745.932560:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.932562:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788361745.932571:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361745.932588:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429896832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361745.932588:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361745.932600:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361745.932600:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429897472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361745.932633:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361745.932638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361745.932645:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.932672:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361745.932700:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896960 00000100:00100000:0.0:1788361745.932708:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896960 00000100:00100000:1.0:1788361745.932713:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897088 00000100:00100000:1.0:1788361745.932719:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897088 00010000:00010000:0.0:1788361745.932732:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 25 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932737:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 25 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.932761:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897728 00000100:00100000:0.0:1788361745.932766:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897728 00000100:00100000:1.0:1788361745.932774:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897600 00000100:00100000:1.0:1788361745.932779:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897600 00010000:00010000:0.0:1788361745.932782:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 26 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932798:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 27 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.932799:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897344 00000100:00100000:0.0:1788361745.932803:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897344 00000100:00100000:1.0:1788361745.932816:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429896832 00000100:00100000:1.0:1788361745.932819:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429896832 00010000:00010000:0.0:1788361745.932844:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 28 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932852:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 29 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.932864:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897472 00000100:00100000:1.0:1788361745.932867:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897856 00000100:00100000:0.0:1788361745.932869:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897472 00000100:00100000:1.0:1788361745.932872:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897856 00010000:00010000:0.0:1788361745.932890:0:19648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 31 pid: 94207 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932891:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 31 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.932922:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1788361745.932931:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+31:3653:x1875230429896960:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361745.932934:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1788361745.932944:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+31:3650:x1875230429897088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361745.932948:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361745.932952:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361745.932956:0:19648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 31 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932958:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 31 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932969:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 31 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932980:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308e00/0x1b69fa8920fe4238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe4231 expref: 31 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.932990:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361745.933022:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+30:3650:x1875230429897088:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.933031:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1788361745.933042:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1788361745.933046:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+29:3650:x1875230429897728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361745.933051:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361745.933056:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 29 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.933072:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 29 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933088:0:19648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 29 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.933104:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137c20000/0x1b69fa8920fe428c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe4285 expref: 29 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933113:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917600/0x1b69fa8920fe4254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe424d expref: 29 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.933117:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361745.933129:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361745.933148:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+27:3650:x1875230429897728:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.933156:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1788361745.933171:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3653:x1875230429896960:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.933176:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1788361745.933185:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:1.0:1788361745.933190:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3653:x1875230429897600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361745.933200:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361745.933206:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 25 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.933210:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:3.0:1788361745.933213:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361745.933224:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3650:x1875230429897344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361745.933225:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 25 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361745.933233:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361745.933236:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361745.933245:0:19648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 25 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361745.933246:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309400/0x1b69fa8920fe41b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe41ac expref: 25 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.933255:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933268:0:19648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 25 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.933269:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361745.933289:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361745.933290:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eb000/0x1b69fa8920fe4200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe41f9 expref: 24 pid: 94211 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933302:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361745.933311:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3653:x1875230429897600:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361745.933316:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1788361745.933328:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1788361745.933334:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1178b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3652:x1875230429896832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361745.933341:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429897344:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (742us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361745.933343:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361745.933351:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 22 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.933355:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00010000:00010000:1.0:1788361745.933366:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 21 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.933374:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00010000:00010000:1.0:1788361745.933378:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309000/0x1b69fa8920fe4262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe425b expref: 21 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.933385:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3653:x1875230429897472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361745.933390:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361745.933403:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361745.933409:0:19648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 20 pid: 94207 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933418:0:19648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 20 pid: 94207 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933428:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004309600/0x1b69fa8920fe41e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe41dd expref: 20 pid: 94207 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933438:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361745.933442:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.933449:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1178b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3652:x1875230429896832:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (815us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361745.933457:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d1012eaa00/0x1b69fa8920fe4223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe422a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361745.933461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1788361745.933469:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3653:x1875230429897472:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361745.933479:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788361745.933506:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00010000:00010000:2.0:1788361745.933507:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361745.933511:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361745.933515:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361745.933517:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:3650:x1875230429897856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361745.933526:0:19648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361745.933531:0:19648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 17 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933541:0:19648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 17 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933553:0:19648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eba00/0x1b69fa8920fe40da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe40d3 expref: 17 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.933563:0:19648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361745.933595:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:3650:x1875230429897856:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361745.933612:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1788361745.933616:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429897472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361745.933633:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429896960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361745.933642:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429897600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361745.933660:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361745.933667:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429897216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361745.933705:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429896832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361745.933880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361745.933889:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895424:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361745.933914:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361745.933916:0:95122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13ffa1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95122:1875230429895552:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788361745.933936:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429897856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361745.933962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361745.934108:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049216 00000100:00100000:1.0:1788361745.934113:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049216 00010000:00010000:1.0:1788361745.934133:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 10 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361745.934177:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897216 00000100:00100000:2.0:1788361745.934182:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897216 00010000:00010000:2.0:1788361745.934202:0:9529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 16 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361745.934232:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2629 00000100:00100000:2.0:1788361745.934242:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:0.0:1788361745.934246:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407049216:12345-192.168.204.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788361745.934255:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:3653:x1875230429897216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361745.934258:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361745.934266:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 10 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.934268:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361745.934276:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 16 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.934283:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 10 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.934297:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 16 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.934325:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d101493800/0x1b69fa8920fe44c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d8 expref: 10 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.934329:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139916e00/0x1b69fa8920fe422a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe4223 expref: 16 pid: 94208 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361745.934331:0:95122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.934342:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361745.934355:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361745.934389:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+9:2409:x1875230407049216:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 146us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361745.934397:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3653:x1875230429897216:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361745.934402:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2629 00000100:00100000:2.0:1788361745.934410:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:3.0:1788361745.934427:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361745.935161:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049344 00000100:00100000:2.0:1788361745.935170:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049344 00010000:00010000:2.0:1788361745.935192:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361745.935222:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2631 00000100:00100000:2.0:1788361745.935233:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3956ab41-635b-456b-967f-6c1073c5d2df+9:2410:x1875230407049344:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361745.935244:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361745.935248:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935270:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935284:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308600/0x1b69fa8920fe44b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110ca expref: 9 pid: 94209 timeout: 2885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935299:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935309:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935332:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935339:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935346:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935353:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935360:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458de00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:2.0:1788361745.935364:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935373:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935395:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361745.935406:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361745.935433:0:95122:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361745.935445:0:95122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361745.935451:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3956ab41-635b-456b-967f-6c1073c5d2df+8:2410:x1875230407049344:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 218us (1024us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361745.935460:0:95122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00458de00/0x1b69fa8920fe458e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361745.935465:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2631 00000100:00100000:2.0:1788361745.935520:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429897216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361746.262108:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361746.262123:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361746.262422:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429898112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788361746.262525:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361746.262589:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898112 00000100:00100000:3.0:1788361746.262598:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898112 00000100:00100000:1.0:1788361746.262623:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429897984:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788361746.262649:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361746.262674:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361746.262679:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1788361746.262689:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429897984 00000100:00100000:3.0:1788361746.262694:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429898112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361746.262702:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429897984 00002000:00000024:3.0:1788361746.262731:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788361746.262740:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361746.262746:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1788361746.262755:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429897984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361746.262774:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788361746.262791:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429898112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361746.262799:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:0.0:1788361746.262844:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429898112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361746.262847:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429897984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361746.262853:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:1.0:1788361746.262928:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429897984:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788361746.519004:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361746.823396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361746.823437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361746.823474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361746.823499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361746.823500:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049472 00000100:00100000:1.0:1788361746.823511:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049472 00000100:00100000:0.0:1788361746.823530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361746.823572:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:0.0:1788361746.823577:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049600 00000100:00100000:0.0:1788361746.823583:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049600 00000100:00100000:1.0:1788361746.823584:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:2412:x1875230407049472:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361746.823634:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049856 00000100:00100000:0.0:1788361746.823640:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049728 00000100:00100000:3.0:1788361746.823641:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049856 00000100:00100000:0.0:1788361746.823647:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049728 00000100:00100000:0.0:1788361746.823681:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 952 00000100:00100000:3.0:1788361746.823685:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407049984 00000100:00100000:3.0:1788361746.823690:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407049984 00000100:00100000:0.0:1788361746.823693:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407049600:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361746.823723:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1937 00000100:00100000:1.0:1788361746.823724:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+8:2412:x1875230407049472:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 139us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361746.823735:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407049856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361746.823738:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:0.0:1788361746.823742:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407049600:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361746.823751:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 952 00000100:00100000:0.0:1788361746.823773:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 953 00000100:00100000:3.0:1788361746.823778:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407049856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361746.823785:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2412:x1875230407049728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361746.823791:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1937 00000100:00100000:3.0:1788361746.823811:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1938 00000100:00100000:3.0:1788361746.823819:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2412:x1875230407049984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361746.823884:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2412:x1875230407049728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361746.823891:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2412:x1875230407049984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361746.823896:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 953 00000100:00100000:3.0:1788361746.823914:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1938 00000100:00080000:0.0:1788361746.823953:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361746.823960:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361746.823963:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361746.823965:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361747.015489:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361747.015681:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050112 00000100:00100000:3.0:1788361747.015694:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050112 00000100:00100000:3.0:1788361747.015751:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:3.0:1788361747.015774:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407050112:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.015792:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361747.015849:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae711125 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.015879:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 9 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.015891:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 9 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.015901:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458cc00, rc 0) 00000100:00100000:3.0:1788361747.015965:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407050112:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 205us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.015973:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:3.0:1788361747.017391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361747.017458:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050240 00000100:00100000:1.0:1788361747.017467:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050240 00000100:00100000:1.0:1788361747.017518:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:1.0:1788361747.017526:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407050240:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.017677:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407050240:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.017683:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:0.0:1788361747.019909:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361747.020039:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050368 00000100:00100000:2.0:1788361747.020047:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050368 00000100:00100000:2.0:1788361747.020136:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:2.0:1788361747.020150:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407050368:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.020280:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407050368:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 132us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.020288:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:2.0:1788361747.023686:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361747.023764:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050496 00000100:00100000:0.0:1788361747.023773:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050496 00000100:00100000:0.0:1788361747.023854:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:0.0:1788361747.023866:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:73258:x1875230407050496:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361747.024042:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:73258:x1875230407050496:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 178us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.024059:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:1.0:1788361747.025495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361747.025548:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050624 00000100:00100000:3.0:1788361747.025557:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050624 00000100:00100000:3.0:1788361747.025612:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:3.0:1788361747.025623:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:73258:x1875230407050624:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361747.025742:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:73258:x1875230407050624:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 121us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.025759:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:2.0:1788361747.027737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361747.027807:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050752 00000100:00100000:1.0:1788361747.027819:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050752 00000100:00100000:1.0:1788361747.027919:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:1.0:1788361747.027930:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407050752:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361747.027949:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361747.027969:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae71112c expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.028028:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 10 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.028040:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 10 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.028049:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c200, rc 0) 00000100:00100000:1.0:1788361747.028102:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407050752:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 175us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.028110:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:2.0:1788361747.029276:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361747.029608:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407050880 00000100:00100000:0.0:1788361747.029615:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407050880 00000100:00100000:0.0:1788361747.029666:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:0.0:1788361747.029677:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407050880:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.029803:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407050880:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 129us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361747.029812:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:1.0:1788361747.287427:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429898240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361747.287523:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.287653:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898240 00000100:00100000:2.0:1788361747.287661:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898240 00000100:00100000:2.0:1788361747.287745:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4229 00000100:00100000:2.0:1788361747.287754:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429898240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361747.287787:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361747.287888:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429898240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.287897:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4229 00000100:00100000:0.0:1788361747.288010:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429898240:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788361747.542057:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361747.798002:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429898496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361747.798016:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429898368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361747.798090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.798130:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361747.798145:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429898624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361747.798155:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898368 00000100:00100000:2.0:1788361747.798164:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898368 00000100:00100000:0.0:1788361747.798181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.798217:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429898752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798246:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:0.0:1788361747.798258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.798264:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429898368:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361747.798303:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429899264:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.798306:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898624 00002000:00000024:2.0:1788361747.798309:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361747.798312:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898624 00000100:00100000:0.0:1788361747.798341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.798351:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4230 00000100:00100000:3.0:1788361747.798361:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429898624:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361747.798370:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429899776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798371:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429898368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.798378:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000004:00000024:3.0:1788361747.798388:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:2.0:1788361747.798401:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899264 00000100:00100000:2.0:1788361747.798405:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899264 00000100:00100000:0.0:1788361747.798409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.798428:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788361747.798434:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429899136:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798440:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1788361747.798451:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429899264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.798478:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429898624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.798488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.798492:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4230 00000100:00100000:2.0:1788361747.798498:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875230429899264:12345-0@lo:400:kworker.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.798507:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788361747.798514:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429899648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798525:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899136 00000100:00100000:2.0:1788361747.798529:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899136 00000100:00100000:3.0:1788361747.798531:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429898880:0@lo:400:kworker.0 00000100:00100000:0.0:1788361747.798545:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.798581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.798607:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429899008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798787:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899648 00000100:00100000:2.0:1788361747.798793:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899648 00000100:00100000:3.0:1788361747.798797:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1788361747.798816:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898752 00000100:00100000:3.0:1788361747.798818:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429899136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361747.798842:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898752 00000100:00100000:2.0:1788361747.798852:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1788361747.798862:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875230429899264:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798864:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429899648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361747.798881:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788361747.798887:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429899136:12345-0@lo:400:kworker.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.798889:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429898624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361747.798892:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3651:x1875230429898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.798902:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:2.0:1788361747.798914:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429899648:12345-0@lo:400:kworker.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.798920:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1788361747.798928:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429899136:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.798934:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898496 00000100:00100000:3.0:1788361747.798938:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898496 00000100:00100000:1.0:1788361747.798943:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3651:x1875230429898752:12345-0@lo:400:kworker.0 Request processed in 53us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.798943:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429899648:0@lo:400:kworker.0 00000100:00100000:1.0:1788361747.798950:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788361747.798957:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429898752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.798964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.798996:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581 00000100:00100000:1.0:1788361747.798999:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429898880 00000100:00100000:1.0:1788361747.799004:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429898880 00000100:00100000:2.0:1788361747.799006:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429899392:0@lo:400:kworker.0 00000100:00080000:0.0:1788361747.799006:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361747.799009:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429898496:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361747.799012:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361747.799018:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788361747.799022:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788361747.799028:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361747.799034:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1788361747.799038:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899776 00000100:00100000:0.0:1788361747.799042:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899776 00000100:00100000:2.0:1788361747.799046:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.799053:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429898880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799070:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0053d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875230429898496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.799081:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899392 00000100:00100000:2.0:1788361747.799087:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429899904:0@lo:400:kworker.0 00000100:00100000:0.0:1788361747.799088:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899392 00000100:00100000:3.0:1788361747.799093:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581 00000100:00100000:1.0:1788361747.799099:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429898880:12345-0@lo:400:kworker.0 Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.799108:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1788361747.799119:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1788361747.799127:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429899776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361747.799135:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.799136:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:1.0:1788361747.799146:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799161:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899904 00000100:00100000:3.0:1788361747.799169:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899904 00000100:00100000:2.0:1788361747.799170:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968752 gen 2 00000100:00100000:0.0:1788361747.799177:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429899776:12345-0@lo:400:kworker.0 Request processed in 51us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.799181:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429899392:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.799184:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:2.0:1788361747.799190:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429898368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361747.799191:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1788361747.799216:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429898880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799222:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1788361747.799232:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429899392:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799240:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429899904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361747.799248:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968757 gen 2 00000100:00100000:1.0:1788361747.799262:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429899776:0@lo:400:kworker.0 00000100:00100000:0.0:1788361747.799272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.799303:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899008 00000100:00100000:1.0:1788361747.799306:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899008 00000100:00100000:0.0:1788361747.799319:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429899520:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799324:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429899904:12345-0@lo:400:kworker.0 Request processed in 89us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.799333:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:1.0:1788361747.799347:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1788361747.799349:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.799355:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429899008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361747.799358:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788361747.799387:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429899008:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.799387:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429898496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361747.799393:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1788361747.799400:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429899904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799406:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429899520 00000100:00100000:3.0:1788361747.799412:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429899520 00000100:00100000:0.0:1788361747.799423:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429899008:0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799456:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1788361747.799467:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429899520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361747.799519:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429899520:12345-0@lo:400:kworker.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.799527:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1788361747.799568:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429899520:0@lo:400:kworker.0 10000000:01000000:2.0:1788361747.926068:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788361747.926077:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d1042fb800 from 58 10000000:01000000:2.0:1788361747.926083:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361747.926154:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.926169:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.926182:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.926230:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.926323:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.926379:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361747.926418:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900032 00000100:00100000:3.0:1788361747.926435:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900032 00000100:00100000:3.0:1788361747.926509:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788361747.926522:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429900032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.926541:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361747.926560:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45a3 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.926601:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 16 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.926614:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 16 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.926638:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d200, rc 0) 00000100:00100000:3.0:1788361747.926716:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429900032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.926724:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788361747.926759:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361747.926777:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.926798:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.926894:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.926927:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.926958:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.926992:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900160 00000100:00100000:1.0:1788361747.926998:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900160 00000100:00100000:1.0:1788361747.927029:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788361747.927036:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429900160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.927162:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429900160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.927169:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788361747.927201:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.927253:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.927295:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.927315:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.927344:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900288 00000100:00100000:0.0:1788361747.927349:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900288 00000100:00100000:0.0:1788361747.927382:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788361747.927389:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429900288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.927466:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429900288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.927471:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788361747.927501:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.927811:0:95126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95126:1875230429900416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.927854:0:95126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.927883:0:95126:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.927895:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900416 00000100:00100000:0.0:1788361747.927901:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900416 00000100:00100000:0.0:1788361747.927929:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788361747.927936:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95126:x1875230429900416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.928025:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95126:x1875230429900416:12345-0@lo:502:llog_process_th.0 Request processed in 89us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.928032:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788361747.928056:0:95126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95126:1875230429900416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.928099:0:95126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95126:1875230429900544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.928129:0:95126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.928148:0:95126:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361747.928179:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900544 00000100:00100000:3.0:1788361747.928184:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900544 00000100:00100000:3.0:1788361747.928232:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788361747.928240:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95126:x1875230429900544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361747.928315:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95126:x1875230429900544:12345-0@lo:502:llog_process_th.0 Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.928320:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788361747.928345:0:95126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95126:1875230429900544:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788361747.928367:0:95126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788361747.928442:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788361747.928471:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361747.928480:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.928491:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361747.928501:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788361747.928503:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1788361747.928506:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361747.928528:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.928536:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.928555:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.928570:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.928595:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.928624:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c71cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.928663:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900672 00000100:00100000:1.0:1788361747.928670:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900672 00000100:00100000:1.0:1788361747.928699:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788361747.928707:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429900672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361747.928715:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361747.928728:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45b1 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.928748:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 17 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.928757:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 17 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.928764:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c000, rc 0) 00000100:00100000:1.0:1788361747.928801:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429900672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.928808:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788361747.928868:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.928882:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.928891:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.928924:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.928942:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.928975:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c71cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.928996:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900800 00000100:00100000:0.0:1788361747.929000:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900800 00000100:00100000:0.0:1788361747.929023:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788361747.929029:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429900800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.929102:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429900800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.929117:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788361747.929130:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.929152:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.929186:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.929202:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c71cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.929217:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429900928 00000100:00100000:0.0:1788361747.929221:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429900928 00000100:00100000:0.0:1788361747.929247:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788361747.929253:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429900928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.929315:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429900928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.929322:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788361747.929344:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429900928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.929529:0:95127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95127:1875230429901056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.929558:0:95127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.929580:0:95127:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1349c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.929633:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901056 00000100:00100000:2.0:1788361747.929637:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901056 00000100:00100000:2.0:1788361747.929697:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788361747.929712:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95127:x1875230429901056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.929794:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95127:x1875230429901056:12345-0@lo:502:llog_process_th.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.929800:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788361747.929860:0:95127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95127:1875230429901056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361747.929884:0:95127:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361747.929897:0:95127:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361747.929901:0:95127:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788361747.929910:0:95127:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1788361747.929932:0:95127:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000020:01000004:1.0:1788361747.930262:0:95128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d1042fb800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361747.930267:0:95128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d1042fb800 4 00000100:00100000:0.0:1788361747.930271:0:95127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95127:1875230429901184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.930306:0:95127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.930330:0:95127:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1349c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.930347:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901184 00000100:00100000:2.0:1788361747.930352:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901184 00000100:00100000:2.0:1788361747.930378:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788361747.930385:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95127:x1875230429901184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.930442:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95127:x1875230429901184:12345-0@lo:502:llog_process_th.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.930448:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788361747.930465:0:95127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95127:1875230429901184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361747.930497:0:95127:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361747.930503:0:95127:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361747.930504:0:95127:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788361747.930508:0:95127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:3.0:1788361747.930584:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:3.0:1788361747.930607:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788361747.930614:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.930630:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361747.930639:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788361747.930641:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 58 10000000:01000000:3.0:1788361747.930644:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361747.930662:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.930670:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.930677:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.930688:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.930707:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.930723:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.930758:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901312 00000100:00100000:0.0:1788361747.930763:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901312 00000100:00100000:0.0:1788361747.930794:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788361747.930801:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429901312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361747.930810:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361747.930850:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45bf expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.930878:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 18 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.930888:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 18 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.930896:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d101493200, rc 0) 00000100:00100000:0.0:1788361747.930932:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429901312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.930939:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788361747.930986:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.931008:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.931019:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.931058:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.931082:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.931117:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.931168:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901440 00000100:00100000:0.0:1788361747.931173:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901440 00000100:00100000:0.0:1788361747.931199:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788361747.931206:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429901440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.931333:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429901440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.931340:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788361747.931386:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.931409:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.931442:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.931459:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d103929480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.931480:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901568 00000100:00100000:2.0:1788361747.931486:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901568 00000100:00100000:2.0:1788361747.931552:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788361747.931560:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429901568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.931636:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429901568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.931644:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788361747.931667:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.931917:0:95129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95129:1875230429901696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.931951:0:95129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.931987:0:95129:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.932003:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901696 00000100:00100000:1.0:1788361747.932009:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901696 00000100:00100000:1.0:1788361747.932039:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788361747.932047:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95129:x1875230429901696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361747.932146:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95129:x1875230429901696:12345-0@lo:502:llog_process_th.0 Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.932154:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788361747.932172:0:95129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95129:1875230429901696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.932205:0:95129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95129:1875230429901824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.932238:0:95129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.932264:0:95129:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.932280:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901824 00000100:00100000:0.0:1788361747.932285:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901824 00000100:00100000:0.0:1788361747.932305:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788361747.932310:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95129:x1875230429901824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.932365:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95129:x1875230429901824:12345-0@lo:502:llog_process_th.0 Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.932369:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788361747.932397:0:95129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95129:1875230429901824:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788361747.932428:0:95129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788361747.932505:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788361747.932525:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361747.932532:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.932542:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361747.932550:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788361747.932553:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1788361747.932563:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788361747.932581:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.932589:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.932597:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.932610:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.932634:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.932657:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c71cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.932670:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429901952 00000100:00100000:0.0:1788361747.932674:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429901952 00000100:00100000:0.0:1788361747.932702:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788361747.932706:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429901952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361747.932711:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361747.932719:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45cd expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.932732:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 19 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.932739:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 19 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.932743:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d101493800, rc 0) 00000100:00100000:0.0:1788361747.932765:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429901952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.932770:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788361747.932792:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429901952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.932804:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.932812:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.932866:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.932894:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.932914:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d104c71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.932952:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902080 00000100:00100000:2.0:1788361747.932957:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902080 00000100:00100000:3.0:1788361747.933032:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788361747.933041:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429902080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.933116:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429902080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.933123:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788361747.933148:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.933217:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.933244:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.933260:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.933282:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902208 00000100:00100000:1.0:1788361747.933286:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902208 00000100:00100000:1.0:1788361747.933311:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788361747.933318:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429902208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.933384:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429902208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.933391:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788361747.933412:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.933642:0:95130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95130:1875230429902336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361747.933678:0:95130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.933696:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902336 00000100:00100000:1.0:1788361747.933696:0:95130:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d004adb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.933700:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902336 00000100:00100000:2.0:1788361747.933729:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788361747.933736:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95130:x1875230429902336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.933816:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95130:x1875230429902336:12345-0@lo:502:llog_process_th.0 Request processed in 80us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.933865:0:95130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95130:1875230429902336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.933876:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000020:01000000:1.0:1788361747.933889:0:95130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361747.933898:0:95130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361747.933901:0:95130:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788361747.933919:0:95130:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1788361747.933932:0:95130:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1788361747.933950:0:95130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95130:1875230429902464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361747.933997:0:95130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.934021:0:95130:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.934036:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902464 00000100:00100000:0.0:1788361747.934041:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902464 00000100:00100000:0.0:1788361747.934067:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788361747.934075:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95130:x1875230429902464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.934147:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95130:x1875230429902464:12345-0@lo:502:llog_process_th.0 Request processed in 72us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.934154:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788361747.934157:0:95130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95130:1875230429902464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361747.934181:0:95130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361747.934186:0:95130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361747.934193:0:95130:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788361747.934197:0:95130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:2.0:1788361747.934268:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:2.0:1788361747.934286:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788361747.934292:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.934299:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361747.934307:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788361747.934314:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 58 10000000:01000000:2.0:1788361747.934317:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361747.934332:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.934339:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.934347:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.934359:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.934384:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.934402:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361747.934429:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902592 00000100:00100000:3.0:1788361747.934434:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902592 00000100:00100000:3.0:1788361747.934460:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788361747.934468:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429902592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.934476:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361747.934491:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45db expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.934507:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 20 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.934517:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 20 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.934530:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c200, rc 0) 00000100:00100000:3.0:1788361747.934561:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429902592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.934569:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788361747.934579:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361747.934593:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.934601:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.934647:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.934685:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.934701:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.934722:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902720 00000100:00100000:1.0:1788361747.934728:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902720 00000100:00100000:1.0:1788361747.934755:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788361747.934762:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429902720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.934868:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429902720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.934876:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788361747.934882:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.934911:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.934938:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.934959:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.934980:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902848 00000100:00100000:0.0:1788361747.934985:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902848 00000100:00100000:0.0:1788361747.935010:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788361747.935017:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429902848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.935076:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429902848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.935088:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788361747.935095:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429902848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.935302:0:95131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95131:1875230429902976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.935333:0:95131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.935351:0:95131:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.935382:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429902976 00000100:00100000:1.0:1788361747.935388:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429902976 00000100:00100000:1.0:1788361747.935416:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788361747.935425:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95131:x1875230429902976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361747.935504:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95131:x1875230429902976:12345-0@lo:502:llog_process_th.0 Request processed in 80us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.935514:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788361747.935526:0:95131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95131:1875230429902976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.935563:0:95131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95131:1875230429903104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361747.935593:0:95131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.935610:0:95131:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d1231ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361747.935637:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903104 00000100:00100000:3.0:1788361747.935642:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903104 00000100:00100000:3.0:1788361747.935666:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361747.935671:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95131:x1875230429903104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361747.935740:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95131:x1875230429903104:12345-0@lo:502:llog_process_th.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.935745:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788361747.935747:0:95131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95131:1875230429903104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788361747.935767:0:95131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1788361747.935818:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1788361747.935860:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361747.935867:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.935874:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361747.935880:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788361747.935882:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788361747.935883:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361747.935896:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.935901:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.935906:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.935914:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.935933:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.935955:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.935982:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903232 00000100:00100000:1.0:1788361747.935990:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903232 00000100:00100000:1.0:1788361747.936017:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361747.936026:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429903232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361747.936034:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361747.936043:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45e9 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.936058:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 21 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.936068:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 21 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.936081:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715ca00, rc 0) 00000100:00100000:1.0:1788361747.936114:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429903232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.936121:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788361747.936147:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361747.936159:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.936167:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.936212:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.936237:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.936253:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.936264:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903360 00000100:00100000:0.0:1788361747.936268:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903360 00000100:00100000:0.0:1788361747.936287:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788361747.936292:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429903360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.936357:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429903360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.936364:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788361747.936368:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.936390:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.936415:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.936427:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.936440:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903488 00000100:00100000:0.0:1788361747.936445:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903488 00000100:00100000:0.0:1788361747.936470:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788361747.936476:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429903488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.936545:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429903488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.936552:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788361747.936561:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361747.937351:0:95132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788361747.937418:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788361747.937442:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788361747.937449:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.937457:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361747.937466:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788361747.937468:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 58 10000000:01000000:2.0:1788361747.937471:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361747.937489:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.937497:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.937505:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.937526:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.937557:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.937587:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903616 00000100:00100000:2.0:1788361747.937593:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.937593:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903616 00000100:00100000:0.0:1788361747.937626:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788361747.937634:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429903616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361747.937643:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361747.937654:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe45f7 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.937669:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.937678:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361747.937684:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d101493400, rc 0) 00000100:00100000:0.0:1788361747.937718:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429903616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.937725:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788361747.937731:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361747.937746:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.937756:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361747.937797:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.937847:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361747.937875:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903744 00000100:00100000:0.0:1788361747.937881:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903744 00000100:00100000:2.0:1788361747.937882:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.937912:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788361747.937921:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429903744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.938023:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429903744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.938031:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788361747.938052:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.938092:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.938134:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.938151:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361747.938157:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429903872 00000100:00100000:0.0:1788361747.938163:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429903872 00000100:00100000:0.0:1788361747.938194:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788361747.938211:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429903872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361747.938296:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429903872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361747.938303:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788361747.938690:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429903872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.938963:0:95133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95133:1875230429904000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.939016:0:95133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.939047:0:95133:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.939060:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904000 00000100:00100000:1.0:1788361747.939066:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904000 00000100:00100000:1.0:1788361747.939101:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788361747.939111:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95133:x1875230429904000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361747.939200:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95133:x1875230429904000:12345-0@lo:502:llog_process_th.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.939206:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788361747.939222:0:95133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95133:1875230429904000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.939267:0:95133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95133:1875230429904128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361747.939312:0:95133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.939330:0:95133:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13ff70e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361747.939343:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904128 00000100:00100000:1.0:1788361747.939347:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904128 00000100:00100000:1.0:1788361747.939371:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788361747.939378:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95133:x1875230429904128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361747.939434:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95133:x1875230429904128:12345-0@lo:502:llog_process_th.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.939440:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788361747.939448:0:95133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95133:1875230429904128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788361747.939474:0:95133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788361747.939547:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788361747.939583:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361747.939592:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.939602:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361747.939611:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788361747.939613:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788361747.939616:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361747.939638:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.939645:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.939663:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.939684:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.939709:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.939727:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.939732:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904256 00000100:00100000:2.0:1788361747.939738:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904256 00000100:00100000:2.0:1788361747.939773:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788361747.939782:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429904256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361747.939790:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361747.939802:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4605 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.939842:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.939852:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361747.939860:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20800, rc 0) 00000100:00100000:2.0:1788361747.939895:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429904256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.939903:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788361747.939914:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.939928:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.939935:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361747.939988:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.940009:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361747.940036:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904384 00000100:00100000:3.0:1788361747.940040:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.940041:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904384 00000100:00100000:2.0:1788361747.940073:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788361747.940085:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429904384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.940178:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429904384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.940188:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.940196:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788361747.940211:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.940241:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361747.940253:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361747.940261:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904512 00000100:00100000:2.0:1788361747.940266:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904512 00000100:00100000:2.0:1788361747.940290:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788361747.940296:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429904512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361747.940374:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429904512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361747.940380:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788361747.940407:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361747.941354:0:95134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788361747.941435:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788361747.941478:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788361747.941489:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.941501:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361747.941525:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788361747.941528:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:1.0:1788361747.941531:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788361747.941574:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.941582:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.941594:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361747.941617:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.941677:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.941718:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361747.941734:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904640 00000100:00100000:3.0:1788361747.941743:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904640 00000100:00100000:3.0:1788361747.941800:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788361747.941809:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429904640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361747.942040:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361747.942060:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4613 expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.942091:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.942104:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361747.942112:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d600, rc 0) 00000100:00100000:3.0:1788361747.942166:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429904640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 358us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361747.942173:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788361747.942185:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361747.942204:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.942216:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361747.942286:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361747.942315:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.942344:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13796ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361747.942357:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904768 00000100:00100000:3.0:1788361747.942362:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904768 00000100:00100000:3.0:1788361747.942402:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788361747.942411:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429904768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.942495:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429904768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (178us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361747.942500:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429904768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361747.942508:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 10000000:01000000:1.0:1788361747.942534:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788361747.942544:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361747.942549:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.565971:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361748.707901:0:95232:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff72dd0100 20000000:00000080:2.0:1788361748.707919:0:95232:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99d1349acc00 uarg=0000000000000000 00000040:00100000:2.0:1788361748.708473:0:95232:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:2.0:1788361748.708480:0:95232:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1788361748.708495:0:95232:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1788361748.708888:0:95233:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 39 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:2.0:1788361748.708926:0:95233:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 39 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:2.0:1788361748.708936:0:95233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:0.0:1788361748.709097:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:0.0:1788361748.709110:0:95232:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:0.0:1788361748.709121:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:0.0:1788361748.709130:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:0.0:1788361748.709140:0:95232:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1788361748.709696:0:95234:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 40 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:2.0:1788361748.709729:0:95234:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 40 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:2.0:1788361748.709745:0:95234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:0.0:1788361748.709876:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:0.0:1788361748.709887:0:95232:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:0.0:1788361748.709901:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:0.0:1788361748.709915:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:0.0:1788361748.709926:0:95232:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1788361748.710262:0:95235:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1788361748.710285:0:95235:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1788361748.710298:0:95235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:2.0:1788361748.710405:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:2.0:1788361748.710415:0:95232:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1788361748.710426:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:2.0:1788361748.710439:0:95232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:2.0:1788361748.710452:0:95232:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788361748.710474:0:95232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710495:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 9 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710512:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710520:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710527:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710533:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710540:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710547:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710553:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710560:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710565:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710572:0:95232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710603:0:95232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710641:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.710655:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 23 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.710669:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429904896:0@lo:104: 00000100:00100000:2.0:1788361748.710730:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361748.710783:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.710785:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429904896 00000100:00100000:1.0:1788361748.710794:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429904896 00010000:00010000:2.0:1788361748.710797:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 23 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.710808:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905024:0@lo:104: 00000100:00100000:2.0:1788361748.710859:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361748.710882:0:92924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788361748.710893:0:10345:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1788361748.710899:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905024 00000100:00100000:0.0:1788361748.710903:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905024 00010000:00010000:2.0:1788361748.710907:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.710908:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788361748.710924:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429904896:12345-0@lo:104: 00010000:00010000:2.0:1788361748.710931:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 23 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.710939:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.710944:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788361748.710945:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905152:0@lo:104: 00000100:00100000:0.0:1788361748.710972:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d006a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905024:12345-0@lo:104: 00010000:00010000:0.0:1788361748.710983:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.710992:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361748.711024:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788361748.711035:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.711036:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429904896:12345-0@lo:104: Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361748.711052:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788361748.711059:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905152 00010000:00010000:2.0:1788361748.711059:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 23 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711069:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788361748.711075:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905152 00000100:00100000:0.0:1788361748.711084:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d006a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:95232:x1875230429905024:12345-0@lo:104: Request processed in 111us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361748.711085:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788361748.711086:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905280:0@lo:104: 00010000:00010000:1.0:1788361748.711095:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711108:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c800 already unused, calling callback (ffffffffc1218c20) 00000100:00100000:0.0:1788361748.711114:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 10000000:00010000:1.0:1788361748.711115:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711128:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.711135:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788361748.711152:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711153:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905280 10000000:01000000:1.0:1788361748.711163:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788361748.711173:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905280 00000100:00100000:0.0:1788361748.711178:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00010000:00010000:2.0:1788361748.711182:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711192:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.711196:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 23 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.711197:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905152:12345-0@lo:104: 00010000:00010000:0.0:1788361748.711213:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711218:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361748.711219:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788361748.711236:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905408:0@lo:104: 00000100:00100000:3.0:1788361748.711248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905280:12345-0@lo:104: 00010000:00010000:1.0:1788361748.711257:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711275:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788361748.711281:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361748.711284:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d13715c800/0x1b69fa8920fe4613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe461a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.711291:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.711291:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905152:12345-0@lo:104: Request processed in 94us (296us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361748.711301:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361748.711308:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 23 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711314:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.711333:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00010000:1.0:1788361748.711347:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ce00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:2.0:1788361748.711349:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 23 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.711352:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.711360:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905408 00000100:00100000:0.0:1788361748.711367:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905408 00010000:00010000:1.0:1788361748.711370:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.711372:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905664:0@lo:104: 10000000:00010000:1.0:1788361748.711384:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.711395:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 10000000:01000000:1.0:1788361748.711398:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788361748.711407:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905408:12345-0@lo:104: 00010000:00010000:0.0:1788361748.711418:0:10345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.711434:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361748.711438:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.711441:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788361748.711456:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361748.711459:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905280:12345-0@lo:104: Request processed in 219us (323us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361748.711466:0:10345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1788361748.711468:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711484:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711487:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788361748.711490:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905408:12345-0@lo:104: Request processed in 77us (206us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361748.711503:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 23 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.711506:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788361748.711519:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905664 00010000:00010000:1.0:1788361748.711520:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00458ce00/0x1b69fa8920fe4605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe460c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711527:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905664 00000100:00100000:2.0:1788361748.711528:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ed4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905920:0@lo:104: 00010000:00010000:1.0:1788361748.711545:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361748.711554:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361748.711560:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711561:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.711573:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361748.711582:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00010000:00010000:1.0:1788361748.711595:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21800 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:0.0:1788361748.711595:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20400 already unused, calling callback (ffffffffc1218c20) 00000100:00100000:3.0:1788361748.711605:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:95232:x1875230429905664:12345-0@lo:104: 10000000:00010000:0.0:1788361748.711607:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.711609:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.711610:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.711620:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.711649:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 23 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711649:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711655:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.711680:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361748.711683:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.711689:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906048:0@lo:104: 10000000:01000000:1.0:1788361748.711696:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361748.711704:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361748.711713:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788361748.711723:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:95232:x1875230429905664:12345-0@lo:104: Request processed in 125us (289us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361748.711727:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711734:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711738:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788361748.711749:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361748.711759:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361748.711759:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361748.711770:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905920 00010000:00010000:1.0:1788361748.711775:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711775:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711777:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905920 00010000:00010000:2.0:1788361748.711787:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711799:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429906048 00010000:00010000:0.0:1788361748.711801:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c20400/0x1b69fa8920fe45e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711807:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429906048 00010000:00010000:2.0:1788361748.711815:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 23 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711850:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c21800/0x1b69fa8920fe45f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.711870:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906432:0@lo:104: 00010000:00010000:0.0:1788361748.711871:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361748.711873:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361748.711879:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711880:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.711889:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788361748.711907:0:95232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361748.711908:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20e00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:1.0:1788361748.711909:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c400 already unused, calling callback (ffffffffc1218c20) 00000100:00100000:3.0:1788361748.711913:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905920:12345-0@lo:104: 10000000:00010000:1.0:1788361748.711918:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361748.711918:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.711928:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.711938:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.711947:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.711964:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361748.711987:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.711991:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.711994:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 9 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361748.712009:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361748.712014:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1788361748.712020:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788361748.712021:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906560:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788361748.712032:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712042:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429905920:12345-0@lo:104: Request processed in 132us (467us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361748.712044:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361748.712052:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712054:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712064:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:0.0:1788361748.712080:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361748.712084:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00458c400/0x1b69fa8920fe45cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.712091:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712097:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429906432 00010000:00010000:0.0:1788361748.712100:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c20e00/0x1b69fa8920fe45db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712101:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361748.712103:0:95232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 9 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712105:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429906432 00010000:00010000:1.0:1788361748.712121:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712134:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ca00 already unused, calling callback (ffffffffc1218c20) 00010000:00010000:2.0:1788361748.712140:0:95232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 9 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.712140:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.712141:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361748.712148:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361748.712150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00010000:00010000:0.0:1788361748.712153:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361748.712169:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361748.712175:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429906048:12345-0@lo:104: 00010000:00010000:1.0:1788361748.712178:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.712203:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.712212:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.712220:0:95232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906944:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788361748.712222:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429906176:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788361748.712242:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361748.712266:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.712272:0:95232:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10adb4d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788361748.712274:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361748.712283:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.712291:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788361748.712294:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00458ca00/0x1b69fa8920fe45bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.712294:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361748.712303:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429904896:0@lo:104: 00000100:00100000:3.0:1788361748.712310:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:95232:x1875230429906048:12345-0@lo:104: Request processed in 138us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361748.712326:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905024:0@lo:104: 00010000:00010000:1.0:1788361748.712331:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788361748.712333:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788361748.712336:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:1.0:1788361748.712339:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.712344:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905152:0@lo:104: 00000100:00100000:0.0:1788361748.712353:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429905536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361748.712355:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458dc00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361748.712362:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788361748.712371:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905280:0@lo:104: 00010000:00010000:1.0:1788361748.712391:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0070f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:95232:x1875230429906432:12345-0@lo:104: 00000100:00100000:0.0:1788361748.712396:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361748.712399:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905408:0@lo:104: 00010000:00010000:3.0:1788361748.712423:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.712424:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.712425:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429906688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361748.712431:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905664:0@lo:104: 00000100:00100000:2.0:1788361748.712461:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ed4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429905920:0@lo:104: 10000000:01000000:1.0:1788361748.712472:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788361748.712475:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361748.712486:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906048:0@lo:104: 00010000:00010000:1.0:1788361748.712498:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712507:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361748.712533:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712541:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d00458dc00/0x1b69fa8920fe45b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.712544:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429906176 00010000:00010000:3.0:1788361748.712549:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361748.712551:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429906176 00010000:00010000:1.0:1788361748.712557:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788361748.712562:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906432:0@lo:104: 00000100:00100000:3.0:1788361748.712566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0070f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:95232:x1875230429906432:12345-0@lo:104: Request processed in 176us (658us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361748.712567:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.712581:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 24 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.712594:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00010000:1.0:1788361748.712599:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21a00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:1.0:1788361748.712606:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712617:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361748.712626:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361748.712640:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788361748.712644:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905536 00000100:00100000:0.0:1788361748.712655:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905536 00010000:00010000:1.0:1788361748.712674:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.712677:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 25 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712689:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361748.712699:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.712701:0:9529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429906688 00000100:00100000:2.0:1788361748.712707:0:9529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429906688 00010000:00010000:1.0:1788361748.712711:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d137c21a00/0x1b69fa8920fe45a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe45aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.712716:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00010000:00010000:2.0:1788361748.712736:0:9529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 26 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.712736:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429906176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361748.712741:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361748.712745:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361748.712750:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361748.712751:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361748.712758:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 26 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.712759:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361748.712771:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 26 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.712773:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429905792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361748.712777:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1788361748.712791:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1178b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+26:3652:x1875230429905536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361748.712796:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d101493400/0x1b69fa8920fe45fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45f7 expref: 26 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.712801:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361748.712808:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 25 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.712811:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361748.712820:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361748.712869:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 25 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.712898:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361748.712899:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00458d600/0x1b69fa8920fe461a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe4613 expref: 25 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.712920:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429906176:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (628us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361748.712922:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361748.712933:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429906816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361748.712936:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1788361748.712970:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429905792 00000100:00100000:2.0:1788361748.712973:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1178b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3652:x1875230429905536:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.712975:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429905792 00000100:00100000:1.0:1788361748.712982:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361748.712987:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00010000:00010000:0.0:1788361748.712992:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 24 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.713009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429906816 00000100:00100000:1.0:1788361748.713011:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788361748.713012:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429906816 00000100:00100000:1.0:1788361748.713020:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429906304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361748.713028:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 24 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.713040:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1788361748.713054:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429906688:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.713056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361748.713057:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361748.713064:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00010000:00010000:2.0:1788361748.713071:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361748.713079:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 24 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.713079:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429907072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361748.713084:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429905792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361748.713100:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361748.713101:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 24 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.713108:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 24 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.713110:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361748.713122:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429906304 00010000:00010000:2.0:1788361748.713129:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d101493800/0x1b69fa8920fe45d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45cd expref: 24 pid: 94211 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361748.713131:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429906304 00010000:00010000:0.0:1788361748.713133:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 24 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.713162:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 24 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.713162:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907072 00010000:00010000:0.0:1788361748.713165:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137c20800/0x1b69fa8920fe460c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe4605 expref: 24 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.713166:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361748.713171:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907072 00000100:00100000:2.0:1788361748.713200:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3652:x1875230429906688:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (733us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361748.713202:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 24 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.713202:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361748.713239:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:0.0:1788361748.713246:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429905792:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.713255:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1788361748.713279:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:2.0:1788361748.713290:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:3.0:1788361748.713295:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429906816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.713306:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:2.0:1788361748.713307:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429906304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361748.713315:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361748.713322:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361748.713322:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429907072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361748.713328:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 22 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.713335:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 22 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.713341:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361748.713351:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 22 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.713352:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 22 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.713376:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429905792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361748.713396:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 22 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.713419:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe45e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45db expref: 22 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.713422:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 22 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.713436:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429907328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361748.713466:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe45f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45e9 expref: 21 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361748.713473:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361748.713474:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d101493200/0x1b69fa8920fe45c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45bf expref: 21 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.713481:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361748.713485:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361748.713498:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361748.713519:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361748.713528:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429907200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361748.713556:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429906816:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361748.713559:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429906304:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361748.713571:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:3650:x1875230429907072:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.713582:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361748.713594:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:3.0:1788361748.713626:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907328 00000100:00100000:0.0:1788361748.713631:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907200 00000100:00100000:3.0:1788361748.713633:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907328 00000100:00100000:0.0:1788361748.713639:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907200 00010000:00010000:3.0:1788361748.713660:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 20 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.713666:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 20 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.713903:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1788361748.713977:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0053d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429905536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.713987:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429906688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.713998:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429906176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.714043:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429906304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.714051:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429907072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361748.714060:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429906816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361748.714135:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:2.0:1788361748.714159:0:9529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:2.0:1788361748.714171:0:9529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:3653:x1875230429907328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361748.714183:0:9529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361748.714189:0:9529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 18 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.714198:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00010000:00010000:2.0:1788361748.714200:0:9529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 18 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.714211:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1178b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:3653:x1875230429907200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361748.714214:0:9529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00458d200/0x1b69fa8920fe45aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45a3 expref: 18 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361748.714231:0:9529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361748.714233:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361748.714240:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 17 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.714251:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 17 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.714265:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c000/0x1b69fa8920fe45b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe45b1 expref: 17 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361748.714271:0:9529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:3653:x1875230429907328:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (792us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361748.714279:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361748.714282:0:9529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1788361748.714297:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429907328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361748.714312:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1178b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:3653:x1875230429907200:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.714320:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1788361748.714324:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429907200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361748.716641:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361748.716669:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906560:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788361748.716685:0:95232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95232:1875230429906944:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788361748.716744:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051008 00000100:00100000:3.0:1788361748.716763:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051008 00000100:00100000:2.0:1788361748.716763:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:0.0:1788361748.716819:0:95232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.716859:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051136 00000100:00100000:1.0:1788361748.716872:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051136 00010000:00010000:3.0:1788361748.716906:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 11 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.716926:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 11 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.716988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2641 00000100:00100000:0.0:1788361748.716997:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3956ab41-635b-456b-967f-6c1073c5d2df+11:2409:x1875230407051008:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361748.717008:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361748.717013:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 11 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.717022:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 11 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.717046:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe459c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae71112c expref: 11 pid: 94209 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.717064:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361748.717142:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407051008:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 146us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361748.717317:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2642 00000100:00100000:1.0:1788361748.717328:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+10:2410:x1875230407051136:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361748.717337:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361748.717344:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 10 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361748.717352:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2641 00010000:00010000:1.0:1788361748.717359:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 10 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717374:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d00458cc00/0x1b69fa8920fe4595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae711125 expref: 9 pid: 94207 timeout: 2888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717388:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717397:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717413:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717421:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717439:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717448:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717456:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361748.717461:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717471:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717492:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361748.717503:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361748.717523:0:95232:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.717536:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+8:2410:x1875230407051136:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 208us (773us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361748.717536:0:95232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361748.717551:0:95232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137c20c00/0x1b69fa8920fe4621 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361748.717553:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2642 00010000:00010000:1.0:1788361749.590061:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361750.472298:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361750.472393:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051264 00000100:00100000:1.0:1788361750.472403:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051264 00000100:00100000:1.0:1788361750.472498:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:1.0:1788361750.472509:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+8:70890:x1875230407051264:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.472526:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361750.472546:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe4628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae711133 expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.472607:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe4628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711133 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.472618:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe4628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711133 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.472628:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c800, rc 0) 00000100:00100000:1.0:1788361750.472689:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407051264:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 181us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.472696:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:3.0:1788361750.476063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361750.476212:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051392 00000100:00100000:1.0:1788361750.476222:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051392 00000100:00100000:1.0:1788361750.476274:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:1.0:1788361750.476284:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407051392:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.476525:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407051392:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 241us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.476534:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:2.0:1788361750.478355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361750.478445:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051520 00000100:00100000:3.0:1788361750.478466:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051520 00000100:00100000:3.0:1788361750.478626:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:3.0:1788361750.478637:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407051520:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361750.478896:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407051520:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 249us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.478905:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:2.0:1788361750.481329:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361750.481506:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051648 00000100:00100000:3.0:1788361750.481515:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051648 00000100:00100000:3.0:1788361750.481612:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:3.0:1788361750.481621:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:73276:x1875230407051648:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361750.481766:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:73276:x1875230407051648:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 146us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.481773:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:0.0:1788361750.483190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361750.483463:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051776 00000100:00100000:1.0:1788361750.483469:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051776 00000100:00100000:1.0:1788361750.483552:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:1.0:1788361750.483561:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:73276:x1875230407051776:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361750.483704:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+9:73276:x1875230407051776:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 143us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.483712:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:2.0:1788361750.485323:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361750.485441:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407051904 00000100:00100000:1.0:1788361750.485457:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407051904 00000100:00100000:1.0:1788361750.485538:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:1.0:1788361750.485547:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407051904:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.485561:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361750.485579:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715d600/0x1b69fa8920fe462f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae71113a expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.485604:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715d600/0x1b69fa8920fe462f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71113a expref: 10 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.485616:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715d600/0x1b69fa8920fe462f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71113a expref: 10 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.485626:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d600, rc 0) 00000100:00100000:1.0:1788361750.485673:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407051904:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 127us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.485680:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 128 10000000:01000000:0.0:1788361750.486015:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361750.486020:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d1042fb800 from 61 10000000:01000000:0.0:1788361750.486024:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361750.486055:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.486065:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.486074:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.486096:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429907456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.486146:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.487105:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361750.487603:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907456 00000100:00100000:3.0:1788361750.487611:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907456 00000100:00100000:3.0:1788361750.487653:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788361750.487661:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+15:6520:x1875230429907456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361750.487673:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361750.487687:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe463d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4636 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.487706:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe463d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4636 expref: 16 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.487716:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe463d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4636 expref: 16 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.488148:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361750.488182:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052032 00000100:00100000:0.0:1788361750.488186:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052032 00000100:00100000:0.0:1788361750.488209:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:0.0:1788361750.488215:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407052032:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.488320:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407052032:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 103us (174us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361750.488327:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 130 00010000:00010000:3.0:1788361750.488968:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c200, rc 0) 00000100:00100000:3.0:1788361750.489010:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429907456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1349us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.489016:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788361750.489151:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429907456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.489169:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe463d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.489179:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe463d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.489243:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429907584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.489271:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.489306:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.489360:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907584 00000100:00100000:1.0:1788361750.489364:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907584 00000100:00100000:1.0:1788361750.489400:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788361750.489412:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429907584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.489563:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429907584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.489570:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788361750.489659:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429907584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.489685:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429907712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.489736:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.489756:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361750.489783:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907712 00000100:00100000:3.0:1788361750.489788:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907712 00000100:00100000:3.0:1788361750.489819:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788361750.489857:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429907712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361750.489959:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429907712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.489966:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788361750.490040:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429907712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361750.491187:0:95236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95236:1875230429907840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.491241:0:95236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361750.491272:0:95236:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.491301:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907840 00000100:00100000:1.0:1788361750.491306:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907840 00000100:00100000:1.0:1788361750.491347:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788361750.491354:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95236:x1875230429907840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361750.491455:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95236:x1875230429907840:12345-0@lo:502:llog_process_th.0 Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.491462:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788361750.492309:0:95236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95236:1875230429907840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.492371:0:95236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95236:1875230429907968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.492412:0:95236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361750.492443:0:95236:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d11f01c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.492695:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429907968 00000100:00100000:2.0:1788361750.492700:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429907968 00000100:00100000:3.0:1788361750.492803:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788361750.492845:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95236:x1875230429907968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.492961:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:95236:x1875230429907968:12345-0@lo:502:llog_process_th.0 Request processed in 150us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.492967:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788361750.493006:0:95236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95236:1875230429907968:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361750.493029:0:95236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1788361750.493155:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1788361750.493184:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361750.493195:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe463d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.493282:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe463d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361750.493293:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788361750.493295:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:0.0:1788361750.493298:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361750.493324:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.493332:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.493341:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.493357:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.493388:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.493423:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.493985:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908096 00000100:00100000:1.0:1788361750.493991:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908096 00000100:00100000:1.0:1788361750.494039:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788361750.494049:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+16:6520:x1875230429908096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.494059:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361750.494072:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe464b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4644 expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.494095:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe464b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4644 expref: 17 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.494106:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe464b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4644 expref: 17 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.494116:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c200, rc 0) 00000100:00100000:1.0:1788361750.494161:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429908096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.494168:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788361750.494194:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.494210:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe464b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.494221:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe464b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.494358:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.494386:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.494414:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361750.494489:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908224 00000100:00100000:3.0:1788361750.494494:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908224 00000100:00100000:3.0:1788361750.494530:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788361750.494538:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429908224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361750.494805:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429908224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.494813:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788361750.495044:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.495074:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.495112:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.495143:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.495280:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908352 00000100:00100000:1.0:1788361750.495284:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908352 00000100:00100000:1.0:1788361750.495316:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788361750.495323:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429908352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.495504:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429908352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.495511:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788361750.495761:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361750.496138:0:95237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95237:1875230429908480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.496167:0:95237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361750.496243:0:95237:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.496283:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908480 00000100:00100000:2.0:1788361750.496288:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908480 00000100:00100000:2.0:1788361750.496323:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788361750.496332:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95237:x1875230429908480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361750.496429:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95237:x1875230429908480:12345-0@lo:502:llog_process_th.0 Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.496436:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788361750.496471:0:95237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95237:1875230429908480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361750.496490:0:95237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361750.496499:0:95237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361750.496501:0:95237:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1788361750.496505:0:95237:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1788361750.498114:0:95237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95237:1875230429908608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.498182:0:95237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361750.498227:0:95237:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.498454:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908608 00000100:00100000:1.0:1788361750.498460:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908608 00000100:00100000:1.0:1788361750.498509:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788361750.498518:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95237:x1875230429908608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361750.498632:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:95237:x1875230429908608:12345-0@lo:502:llog_process_th.0 Request processed in 116us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.498639:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788361750.498751:0:95237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95237:1875230429908608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361750.498776:0:95237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361750.498783:0:95237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361750.498785:0:95237:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1788361750.498789:0:95237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:0.0:1788361750.499057:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:0.0:1788361750.499080:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361750.499089:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe464b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.499100:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe464b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361750.499110:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361750.499112:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d002df9000 from 61 10000000:01000000:0.0:1788361750.499115:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361750.499141:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.499150:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.499159:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.499186:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.499218:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.499286:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361750.499414:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908736 00000100:00100000:3.0:1788361750.499419:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908736 00000100:00100000:3.0:1788361750.499461:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788361750.499469:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+17:6520:x1875230429908736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361750.499486:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361750.499499:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458c000/0x1b69fa8920fe4659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4652 expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.499520:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458c000/0x1b69fa8920fe4659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4652 expref: 18 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.499530:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458c000/0x1b69fa8920fe4659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4652 expref: 18 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.499539:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c000, rc 0) 00000100:00100000:3.0:1788361750.499676:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429908736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.499684:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788361750.499736:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.499749:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4659 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.499758:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4659 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.499812:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.499957:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.500008:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.500041:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908864 00000100:00100000:1.0:1788361750.500046:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908864 00000100:00100000:1.0:1788361750.500111:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788361750.500119:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429908864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.500233:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429908864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.500240:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788361750.500302:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00223a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.500331:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00a24c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.500368:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.502702:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429908992 00000100:00100000:0.0:1788361750.502716:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429908992 00000100:00100000:2.0:1788361750.502738:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10adb4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.502880:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788361750.502892:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429908992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.503049:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429908992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.503058:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788361750.503092:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00a24c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429908992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361750.503417:0:95238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95238:1875230429909120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.503461:0:95238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361750.503484:0:95238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361750.503506:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909120 00000100:00100000:0.0:1788361750.503511:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909120 00000100:00100000:0.0:1788361750.503539:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788361750.503546:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95238:x1875230429909120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361750.503634:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95238:x1875230429909120:12345-0@lo:502:llog_process_th.0 Request processed in 88us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361750.503641:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788361750.503658:0:95238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95238:1875230429909120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.503700:0:95238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95238:1875230429909248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.503731:0:95238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361750.503754:0:95238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d10e6d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.503794:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909248 00000100:00100000:2.0:1788361750.503799:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909248 00000100:00100000:2.0:1788361750.503903:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788361750.503911:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95238:x1875230429909248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361750.503998:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:95238:x1875230429909248:12345-0@lo:502:llog_process_th.0 Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.504005:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788361750.504090:0:95238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95238:1875230429909248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788361750.504107:0:95238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1788361750.504182:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1788361750.504209:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361750.504226:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4659 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.504237:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4659 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361750.504247:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788361750.504250:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:0.0:1788361750.504254:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361750.504278:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.504286:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.504295:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.504308:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429909376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.504336:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.504364:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.504388:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909376 00000100:00100000:2.0:1788361750.504393:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909376 00000100:00100000:2.0:1788361750.504421:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788361750.504429:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+18:6520:x1875230429909376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361750.504438:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361750.504452:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c21a00/0x1b69fa8920fe4667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4660 expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361750.504472:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c21a00/0x1b69fa8920fe4667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4660 expref: 19 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361750.504482:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c21a00/0x1b69fa8920fe4667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4660 expref: 19 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361750.504490:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21a00, rc 0) 00000100:00100000:2.0:1788361750.504521:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429909376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.504528:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788361750.504551:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429909376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.504566:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4667 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.504575:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4667 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.504616:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429909504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.504648:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.504666:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.504686:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909504 00000100:00100000:1.0:1788361750.504691:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909504 00000100:00100000:1.0:1788361750.504752:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788361750.504760:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429909504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.504900:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429909504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.504927:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788361750.505008:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429909504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.505034:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429909632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.505071:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.505107:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.505197:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909632 00000100:00100000:1.0:1788361750.505201:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909632 00000100:00100000:1.0:1788361750.505244:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788361750.505254:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429909632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.505336:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429909632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.505344:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788361750.505374:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429909632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.506088:0:95239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95239:1875230429909760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361750.506128:0:95239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.506151:0:95239:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.506176:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909760 00000100:00100000:2.0:1788361750.506182:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909760 00000100:00100000:2.0:1788361750.506211:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788361750.506218:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95239:x1875230429909760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361750.506309:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95239:x1875230429909760:12345-0@lo:502:llog_process_th.0 Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.506327:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788361750.506346:0:95239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95239:1875230429909760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361750.506375:0:95239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361750.506386:0:95239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361750.506388:0:95239:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:0.0:1788361750.506394:0:95239:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1788361750.506508:0:95239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95239:1875230429909888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361750.506557:0:95239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.506577:0:95239:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.506602:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429909888 00000100:00100000:2.0:1788361750.506607:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429909888 00000100:00100000:2.0:1788361750.506639:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788361750.506644:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95239:x1875230429909888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361750.506696:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:95239:x1875230429909888:12345-0@lo:502:llog_process_th.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.506700:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788361750.506723:0:95239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95239:1875230429909888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361750.506741:0:95239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361750.506744:0:95239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361750.506745:0:95239:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:0.0:1788361750.506747:0:95239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:1.0:1788361750.506801:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:1.0:1788361750.506848:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788361750.506858:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4667 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.506869:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4667 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361750.506891:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788361750.506894:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d0021f9800 from 61 10000000:01000000:1.0:1788361750.506897:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361750.506931:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.506940:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.506950:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361750.506965:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.506994:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361750.507067:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361750.507157:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910016 00000100:00100000:3.0:1788361750.507162:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910016 00000100:00100000:3.0:1788361750.507193:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788361750.507210:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+19:6520:x1875230429910016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361750.507220:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361750.507232:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d00458d800/0x1b69fa8920fe4675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe466e expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.507252:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d00458d800/0x1b69fa8920fe4675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe466e expref: 20 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.507262:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d00458d800/0x1b69fa8920fe4675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe466e expref: 20 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361750.507285:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d800, rc 0) 00000100:00100000:3.0:1788361750.507358:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429910016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.507364:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788361750.507471:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.507501:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4675 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.507511:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4675 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361750.507557:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.507581:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361750.507614:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361750.507678:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910144 00000100:00100000:0.0:1788361750.507683:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910144 00000100:00100000:0.0:1788361750.507722:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788361750.507729:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429910144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.507855:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429910144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361750.507862:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788361750.507978:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.508004:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.508040:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361750.508066:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0056a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.508078:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910272 00000100:00100000:2.0:1788361750.508083:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910272 00000100:00100000:2.0:1788361750.508115:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788361750.508122:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429910272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.508194:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429910272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.508201:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788361750.508244:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.508642:0:95240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95240:1875230429910400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361750.508676:0:95240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361750.508698:0:95240:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.508722:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910400 00000100:00100000:2.0:1788361750.508727:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910400 00000100:00100000:2.0:1788361750.508759:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788361750.508767:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95240:x1875230429910400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361750.508885:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95240:x1875230429910400:12345-0@lo:502:llog_process_th.0 Request processed in 118us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.508892:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788361750.508984:0:95240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95240:1875230429910400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361750.509020:0:95240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95240:1875230429910528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361750.509052:0:95240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361750.509113:0:95240:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c9e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361750.509147:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910528 00000100:00100000:3.0:1788361750.509152:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910528 00000100:00100000:3.0:1788361750.509178:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788361750.509185:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95240:x1875230429910528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361750.509538:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:95240:x1875230429910528:12345-0@lo:502:llog_process_th.0 Request processed in 352us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361750.509546:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788361750.509695:0:95240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95240:1875230429910528:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361750.509713:0:95240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1788361750.509988:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1788361750.510012:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361750.510020:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4675 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.510031:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4675 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361750.510040:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788361750.510043:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788361750.510045:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361750.510067:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.510075:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.510085:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.510100:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.510129:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.510147:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.510212:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910656 00000100:00100000:1.0:1788361750.510223:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910656 00000100:00100000:1.0:1788361750.510246:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788361750.510252:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+20:6520:x1875230429910656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.510261:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361750.510271:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe4683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe467c expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.510290:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe4683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe467c expref: 21 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.510300:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe4683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe467c expref: 21 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.510308:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715ca00, rc 0) 00000100:00100000:1.0:1788361750.510352:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429910656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.510359:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788361750.510418:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.510437:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4683 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.510446:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4683 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.510500:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.510526:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.510546:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.510595:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910784 00000100:00100000:2.0:1788361750.510601:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910784 00000100:00100000:2.0:1788361750.510634:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788361750.510641:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429910784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.510755:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429910784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.510762:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788361750.510790:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.510818:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.510882:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.510901:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d00452b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.511182:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429910912 00000100:00100000:2.0:1788361750.511187:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429910912 00000100:00100000:2.0:1788361750.511218:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788361750.511226:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429910912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.511361:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429910912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.511369:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788361750.511432:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429910912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361750.512508:0:95241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788361750.512704:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788361750.512729:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788361750.512738:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4683 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.512750:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4683 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361750.512759:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788361750.512762:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d137d28000 from 61 10000000:01000000:0.0:1788361750.512765:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361750.512792:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.512812:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.512928:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.512948:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.512989:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.513054:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.513093:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911040 00000100:00100000:1.0:1788361750.513098:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911040 00000100:00100000:1.0:1788361750.513132:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788361750.513141:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:6520:x1875230429911040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.513152:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361750.513165:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715cc00/0x1b69fa8920fe4691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe468a expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.513184:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715cc00/0x1b69fa8920fe4691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe468a expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.513194:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715cc00/0x1b69fa8920fe4691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe468a expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.513210:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715cc00, rc 0) 00000100:00100000:1.0:1788361750.513253:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429911040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.513263:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788361750.513281:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.513297:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.513307:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.513396:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.513422:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.513439:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.513460:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911168 00000100:00100000:1.0:1788361750.513465:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911168 00000100:00100000:1.0:1788361750.513501:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788361750.513509:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429911168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.513616:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429911168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.513623:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788361750.513738:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.513762:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.513799:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.513816:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.513859:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911296 00000100:00100000:2.0:1788361750.513865:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911296 00000100:00100000:2.0:1788361750.513895:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788361750.513972:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429911296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.514047:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429911296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.514055:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788361750.514280:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.514728:0:95242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95242:1875230429911424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361750.514773:0:95242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.514805:0:95242:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.514881:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911424 00000100:00100000:2.0:1788361750.514886:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911424 00000100:00100000:2.0:1788361750.514914:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788361750.514931:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95242:x1875230429911424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361750.515011:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95242:x1875230429911424:12345-0@lo:502:llog_process_th.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.515017:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788361750.515047:0:95242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95242:1875230429911424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361750.515088:0:95242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95242:1875230429911552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361750.515120:0:95242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.515146:0:95242:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.515185:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911552 00000100:00100000:1.0:1788361750.515189:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911552 00000100:00100000:1.0:1788361750.515221:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788361750.515229:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95242:x1875230429911552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361750.515315:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:95242:x1875230429911552:12345-0@lo:502:llog_process_th.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.515323:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788361750.515391:0:95242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8a6f36d-efb9-41cf-af98-5917323f2b0d:95242:1875230429911552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788361750.515410:0:95242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1788361750.515562:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1788361750.515581:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361750.515590:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.515610:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361750.515636:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788361750.515639:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788361750.515642:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361750.515663:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.515671:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.515681:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361750.515695:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.515721:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361750.515741:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137d92300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.515759:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911680 00000100:00100000:2.0:1788361750.515770:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911680 00000100:00100000:2.0:1788361750.515862:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788361750.515872:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429911680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361750.515881:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361750.515892:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d137c21800/0x1b69fa8920fe469f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe4698 expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361750.515935:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d137c21800/0x1b69fa8920fe469f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe4698 expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361750.515946:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d137c21800/0x1b69fa8920fe469f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4698 expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361750.515955:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21800, rc 0) 00000100:00100000:2.0:1788361750.515996:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429911680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361750.516004:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788361750.516050:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.516064:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.516073:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.516115:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.516142:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.516164:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.516175:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911808 00000100:00100000:1.0:1788361750.516181:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911808 00000100:00100000:1.0:1788361750.516212:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788361750.516218:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429911808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.516309:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429911808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.516318:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788361750.516334:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.516359:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.516394:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.516412:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d101370900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.516425:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429911936 00000100:00100000:1.0:1788361750.516430:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429911936 00000100:00100000:1.0:1788361750.516485:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788361750.516491:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429911936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361750.516591:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429911936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.516604:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788361750.516669:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429911936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361750.517997:0:95243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788361750.518066:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788361750.518096:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361750.518104:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.518113:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361750.518123:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788361750.518125:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99d1349b4d40 from 1 10000000:01000000:0.0:1788361750.518128:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788361750.518150:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.518158:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.518417:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.518438:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429912064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.518474:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.518573:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361750.518856:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912064 00000100:00100000:1.0:1788361750.518862:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912064 00000100:00100000:1.0:1788361750.518897:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788361750.519034:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429912064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361750.519045:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361750.519060:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d13715d200/0x1b69fa8920fe46ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe46a6 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.519080:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d13715d200/0x1b69fa8920fe46ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe46a6 expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.519091:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d13715d200/0x1b69fa8920fe46ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe46a6 expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.519099:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d200, rc 0) 00000100:00100000:1.0:1788361750.519139:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429912064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361750.519193:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788361750.519251:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429912064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361750.519266:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.519389:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361750.519439:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429912192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361750.519472:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361750.519541:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d001cdc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361750.520001:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912192 00000100:00100000:2.0:1788361750.520006:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912192 00000100:00100000:2.0:1788361750.520041:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788361750.520049:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429912192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361750.520126:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429912192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (652us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361750.520134:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788361750.520153:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429912192:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788361750.520331:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361750.520339:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361750.520347:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361750.614577:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361751.382101:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d00335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429912320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788361751.382165:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361751.382166:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429912448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361751.382246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361751.382405:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912320 00000100:00100000:3.0:1788361751.382413:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912320 00000100:00080000:2.0:1788361751.382461:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361751.382469:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912448 00000100:00100000:3.0:1788361751.382473:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912448 00000100:00100000:1.0:1788361751.382501:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00080000:2.0:1788361751.382506:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361751.382509:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:1.0:1788361751.382515:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429912320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788361751.382518:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429912448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788361751.382545:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788361751.382545:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788361751.382644:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d00335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429912320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361751.382650:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429912448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788361751.382813:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00a24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429912448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 294us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361751.382813:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429912320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 301us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361751.382837:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1788361751.382842:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00010000:00010000:0.0:1788361751.638049:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361751.943695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361751.943736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361751.943773:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361751.943793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361751.943844:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052416 00000100:00100000:0.0:1788361751.943854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361751.943856:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052416 00000100:00100000:0.0:1788361751.943879:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052288 00000100:00100000:0.0:1788361751.943883:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052288 00000100:00100000:0.0:1788361751.943958:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 960 00000100:00100000:3.0:1788361751.943968:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 961 00000100:00100000:0.0:1788361751.943972:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407052288:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361751.943983:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407052416:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361751.944183:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407052288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 212us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361751.944184:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00223a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407052416:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 201us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361751.944194:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 960 00000100:00100000:0.0:1788361751.944227:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052672 00000100:00100000:0.0:1788361751.944230:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052672 00000100:00100000:0.0:1788361751.944257:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052544 00000100:00100000:3.0:1788361751.944261:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 961 00000100:00100000:0.0:1788361751.944262:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052544 00000100:00100000:3.0:1788361751.944302:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1942 00000100:00100000:3.0:1788361751.944311:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407052672:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361751.944344:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407052672:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361751.944351:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1942 00000100:00100000:3.0:1788361751.944365:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1943 00000100:00100000:3.0:1788361751.944372:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407052544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361751.944400:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2411:x1875230407052544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361751.944406:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1943 00000100:00080000:3.0:1788361751.944795:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361751.944800:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361751.944803:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361751.944805:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361751.946342:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052160 00000100:00100000:2.0:1788361751.946351:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052160 00000100:00100000:2.0:1788361751.946394:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:2.0:1788361751.946401:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2411:x1875230407052160:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361751.946450:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2411:x1875230407052160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 49us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361751.946457:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 168 00000001:02000400:0.0:1788361752.011495:0:95341:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 11:09:10 (1788361750) 00000100:00100000:0.0:1788361752.039171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.039228:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407052928 00000100:00100000:2.0:1788361752.039239:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407052928 00000100:00100000:2.0:1788361752.039301:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1371 00000100:00100000:2.0:1788361752.039313:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:73457:x1875230407052928:12345-192.168.204.35@tcp:36:mkdir.0 00010000:00010000:2.0:1788361752.039376:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.039404:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe44d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110df expref: 10 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.039422:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361752.039426:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.039482:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.039496:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.039507:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.039546:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.039551:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.039557:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040115:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040126:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040135:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.040152:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038140240 reply state 0000000064c25b62 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040163:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040170:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.040173:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.040177:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788361752.040182:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788361752.040189:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040196:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040210:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040217:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.040221:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040230:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040239:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361752.040242:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.040246:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040252:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.040265:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038140240 reply state 0000000064c25b62 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040274:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.040280:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99d105584900) 00010000:00010000:2.0:1788361752.040282:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.040284:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788361752.040375:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73457:x1875230407052928:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 1064us (1211us total) trans 124554051585 rc 0/0 00000100:00100000:2.0:1788361752.040384:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1371 00000100:00100000:2.0:1788361752.048207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361752.048256:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407053056 00000100:00100000:0.0:1788361752.048266:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407053056 00000100:00100000:0.0:1788361752.048318:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1372 00000100:00100000:0.0:1788361752.048328:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73458:x1875230407053056:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788361752.048349:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361752.048368:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe46c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711141 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.048421:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe46d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.048433:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe46d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.048443:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe46d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361752.048481:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788361752.048486:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361752.048504:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe46d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.048529:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe46c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711141 expref: 13 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.048562:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe46d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711141 expref: 12 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.048572:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:0.0:1788361752.048575:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361752.048579:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d101492c00, rc 0) 00000100:00100000:0.0:1788361752.048641:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:73458:x1875230407053056:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 315us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.048648:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1372 00000100:00100000:3.0:1788361752.050345:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.050607:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407053312 00000100:00100000:2.0:1788361752.050617:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407053312 00000100:00100000:2.0:1788361752.050666:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1373 00000100:00100000:2.0:1788361752.050677:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:73458:x1875230407053312:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788361752.050695:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.050698:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361752.050721:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe46d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711141 expref: 12 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050739:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361752.050743:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.050754:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711148 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050898:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050915:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050925:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050936:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050943:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.050949:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051035:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051043:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051050:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361752.051060:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788361752.051073:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051081:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051088:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051094:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.051098:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051106:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051114:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.051117:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.051125:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051143:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe46ec lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051162:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051168:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051175:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051181:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051186:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.051189:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051195:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051202:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361752.051204:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.051207:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051213:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe46de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051221:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051232:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051239:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051244:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.051247:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051253:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051261:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99d105584900) 00010000:00010000:2.0:1788361752.051263:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.051277:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051283:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe46e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051309:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46d7 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711148 expref: 12 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051318:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361752.051320:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.051324:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe46d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711148 expref: 12 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.051360:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20c00, rc 0) 00000100:00100000:2.0:1788361752.051416:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73458:x1875230407053312:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 742us (1077us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361752.051423:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1373 00000100:00100000:0.0:1788361752.054061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.054424:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407053440 00000100:00100000:3.0:1788361752.054434:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407053440 00000100:00100000:3.0:1788361752.054488:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1374 00000100:00100000:3.0:1788361752.054502:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73458:x1875230407053440:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361752.054521:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361752.054539:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d000/0x1b69fa8920fe46f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71114f expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.054598:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe46fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.054612:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe46fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.054624:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe46fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361752.054669:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788361752.054672:0:66901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788361752.054692:0:66901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe46fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.054716:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d000/0x1b69fa8920fe46f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71114f expref: 13 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.054732:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe46fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71114f expref: 12 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.054742:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:3.0:1788361752.054749:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361752.054754:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c600, rc 0) 00000100:00100000:3.0:1788361752.054809:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:73458:x1875230407053440:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 308us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.054816:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1374 00000100:00100000:0.0:1788361752.056333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.056410:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407053696 00000100:00100000:3.0:1788361752.056418:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407053696 00000100:00100000:3.0:1788361752.056497:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1375 00000100:00100000:3.0:1788361752.056508:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:73458:x1875230407053696:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788361752.056524:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361752.056540:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4701 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711156 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056597:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056609:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056619:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056630:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056636:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056642:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361752.056754:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788361752.056846:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056855:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056861:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056868:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056874:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361752.056879:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056901:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056913:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:3.0:1788361752.056916:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361752.056921:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056927:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe4708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056938:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056953:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056959:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056964:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361752.056967:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056973:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056981:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99d105584900) 00010000:00010000:3.0:1788361752.056984:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361752.056986:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.056992:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe470f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.057022:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4701 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711156 expref: 14 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.057032:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:3.0:1788361752.057035:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361752.057038:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458cc00/0x1b69fa8920fe4701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711156 expref: 14 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.057055:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458cc00, rc 0) 00000100:00100000:3.0:1788361752.057105:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:73458:x1875230407053696:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 599us (776us total) trans 124554051586 rc 301/301 00000100:00100000:3.0:1788361752.057111:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1375 00000100:00100000:0.0:1788361752.058565:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.058673:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407053952 00000100:00100000:3.0:1788361752.058681:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407053952 00000100:00100000:3.0:1788361752.058727:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1376 00000100:00100000:3.0:1788361752.058737:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:73458:x1875230407053952:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:3.0:1788361752.058812:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.058848:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.058860:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361752.059014:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f74e7af reply state 00000000e00cf722 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.059027:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.059034:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361752.059037:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788361752.059040:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788361752.059047:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:3.0:1788361752.059120:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:73458:x1875230407053952:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 385us (560us total) trans 124554051587 rc 0/0 00000100:00100000:3.0:1788361752.059133:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1376 00000100:00100000:0.0:1788361752.061061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.061110:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407054208 00000100:00100000:2.0:1788361752.061118:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407054208 00000100:00100000:2.0:1788361752.061156:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 244 00000100:00100000:2.0:1788361752.061166:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:73458:x1875230407054208:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788361752.061340:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:73458:x1875230407054208:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 176us (283us total) trans 124554051588 rc 0/0 00000100:00100000:2.0:1788361752.061348:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 244 00000100:00100000:0.0:1788361752.067056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.067138:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407054336 00000100:00100000:2.0:1788361752.067148:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407054336 00000100:00100000:2.0:1788361752.067212:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1377 00000100:00100000:2.0:1788361752.067222:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:73459:x1875230407054336:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.067247:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.067268:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe4724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71115d expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067336:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067351:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067362:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067379:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067387:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067394:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067464:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe4739 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067473:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe4739 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067480:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe4739 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361752.067517:0:80345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1788361752.067521:0:80345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361752.067554:0:80345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe4739 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067624:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067631:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067637:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067653:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.067658:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067775:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067788:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361752.067791:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.067796:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067803:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe472b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067815:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067841:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067848:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067852:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.067855:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067863:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067881:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99d105584900) 00010000:00010000:2.0:1788361752.067883:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.067898:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067904:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4732 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067931:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe4724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71115d expref: 18 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067946:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20000/0x1b69fa8920fe4739 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71115d expref: 17 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.067954:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.067956:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361752.067958:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20000, rc 0) 00000100:00100000:2.0:1788361752.068009:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:73459:x1875230407054336:12345-192.168.204.35@tcp:101:touch.0 Request processed in 788us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.068016:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1377 00000100:00100000:0.0:1788361752.069749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.070072:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407054592 00000100:00100000:2.0:1788361752.070082:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407054592 00000100:00100000:2.0:1788361752.070137:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1378 00000100:00100000:2.0:1788361752.070148:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:73459:x1875230407054592:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.070167:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.070187:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe4740 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711164 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070294:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070309:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070321:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070339:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070346:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070353:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.070647:0:66127:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x724:0x0], count =94 00000004:00080000:2.0:1788361752.070655:0:66127:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x724:0x0]+94 in llog 00000004:00080000:2.0:1788361752.070676:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x782:0x0], index 0: 0 00010000:00010000:2.0:1788361752.070809:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe4755 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070818:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe4755 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070846:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe4755 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070879:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070906:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070911:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070918:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070925:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.070930:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070938:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070950:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.070954:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.070958:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070965:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4747 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.070977:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be9d559a reply state 000000004891e8e1 transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070988:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.070995:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff99d105584100) 00010000:00010000:2.0:1788361752.071002:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.071005:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.071031:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe4740 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711164 expref: 20 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.071045:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe4755 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711164 expref: 19 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.071053:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584200) 00010000:00010000:2.0:1788361752.071055:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.071057:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb000, rc 0) 00000100:00100000:2.0:1788361752.071253:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:73459:x1875230407054592:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1106us (1510us total) trans 124554051589 rc 0/0 00000100:00100000:2.0:1788361752.071262:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1378 00000100:00100000:0.0:1788361752.073189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.073249:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407054848 00000100:00100000:2.0:1788361752.073258:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407054848 00000100:00100000:2.0:1788361752.073301:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1379 00000100:00100000:2.0:1788361752.073311:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:73459:x1875230407054848:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.073479:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.073502:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe4755 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711164 expref: 20 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.073516:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584200) 00010000:00010000:2.0:1788361752.073527:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.073573:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.073585:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.073602:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.073708:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d83650d reply state 00000000ced45e78 transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.073721:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.073728:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:2.0:1788361752.073730:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.073733:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.073820:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:73459:x1875230407054848:12345-192.168.204.35@tcp:36:touch.0 Request processed in 510us (634us total) trans 124554051590 rc 0/0 00000100:00100000:2.0:1788361752.073854:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1379 00000100:00100000:0.0:1788361752.075240:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.075274:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407054976 00000100:00100000:3.0:1788361752.075280:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407054976 00000100:00100000:3.0:1788361752.075319:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1380 00000100:00100000:3.0:1788361752.075325:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:73459:x1875230407054976:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361752.075341:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361752.075354:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458cc00/0x1b69fa8920fe476a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71116b expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.075388:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458cc00/0x1b69fa8920fe476a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71116b expref: 22 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.075404:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458cc00/0x1b69fa8920fe476a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71116b expref: 22 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.075418:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:3.0:1788361752.075420:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361752.075422:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458cc00, rc 0) 00000100:00100000:3.0:1788361752.075457:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:73459:x1875230407054976:12345-192.168.204.35@tcp:101:touch.0 Request processed in 132us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.075463:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1380 00000100:00100000:1.0:1788361752.076961:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.077142:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407055104 00000100:00100000:1.0:1788361752.077148:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407055104 00000100:00100000:1.0:1788361752.077176:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4941 00000100:00100000:1.0:1788361752.077182:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2410:x1875230407055104:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:1.0:1788361752.077378:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2410:x1875230407055104:12345-192.168.204.35@tcp:2:touch.0 Request processed in 194us (419us total) trans 4294968753 rc 0/0 00000100:00100000:1.0:1788361752.077387:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4941 00000100:00100000:3.0:1788361752.081630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361752.081813:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407055360 00000100:00100000:0.0:1788361752.081845:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407055360 00000100:00100000:0.0:1788361752.081909:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:0.0:1788361752.081921:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:73459:x1875230407055360:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:0.0:1788361752.082213:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:73459:x1875230407055360:12345-192.168.204.35@tcp:35:touch.0 Request processed in 293us (589us total) trans 124554051591 rc 0/0 00000100:00100000:0.0:1788361752.082223:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:3.0:1788361752.084618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.084669:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407055616 00000100:00100000:1.0:1788361752.084678:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407055616 00000100:00100000:1.0:1788361752.084739:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1381 00000100:00100000:1.0:1788361752.084750:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:73459:x1875230407055616:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.084776:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.084797:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4771 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711172 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.084938:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.084954:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.084965:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.084990:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.084998:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085016:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.085363:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x783:0x0], index 0: 0 00010000:00010000:1.0:1788361752.085501:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4786 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085510:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4786 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085518:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4786 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085550:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085556:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085563:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085568:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085574:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.085577:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085584:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085606:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.085609:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.085614:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085619:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4778 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.085631:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6faec0f reply state 00000000aa7c8682 transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085640:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085645:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff99d112cab000) 00010000:00010000:1.0:1788361752.085648:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.085651:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.085679:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4771 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711172 expref: 26 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085691:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4786 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711172 expref: 25 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.085697:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d112cab400) 00010000:00010000:1.0:1788361752.085699:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.085701:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c400, rc 0) 00000100:00100000:1.0:1788361752.085817:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:73459:x1875230407055616:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1068us (1205us total) trans 124554051592 rc 0/0 00000100:00100000:1.0:1788361752.085845:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1381 00000100:00100000:0.0:1788361752.088046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.088235:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407055872 00000100:00100000:3.0:1788361752.088245:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407055872 00000100:00100000:3.0:1788361752.088337:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1382 00000100:00100000:3.0:1788361752.088347:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:73459:x1875230407055872:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:3.0:1788361752.088403:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361752.088429:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4786 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711172 expref: 26 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.088447:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d112cab400) 00010000:00010000:3.0:1788361752.088458:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361752.088522:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.088533:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.088542:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361752.088639:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f58ba041 reply state 000000004a1f6124 transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.088652:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.088659:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:3.0:1788361752.088661:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361752.088664:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361752.088754:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:73459:x1875230407055872:12345-192.168.204.35@tcp:36:touch.0 Request processed in 408us (716us total) trans 124554051593 rc 0/0 00000100:00100000:3.0:1788361752.088760:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1382 00000100:00100000:0.0:1788361752.091087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.091198:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407056000 00000100:00100000:1.0:1788361752.091208:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407056000 00000100:00100000:1.0:1788361752.091426:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1383 00000100:00100000:1.0:1788361752.091441:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:73459:x1875230407056000:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.091462:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.091482:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d800/0x1b69fa8920fe479b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711179 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.091557:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d800/0x1b69fa8920fe479b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711179 expref: 28 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.091572:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d800/0x1b69fa8920fe479b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711179 expref: 28 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.091591:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:1.0:1788361752.091594:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.091598:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715d800, rc 0) 00000100:00100000:1.0:1788361752.091655:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:73459:x1875230407056000:12345-192.168.204.35@tcp:101:touch.0 Request processed in 218us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.091664:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1383 00000100:00100000:0.0:1788361752.093723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.093777:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407056128 00000100:00100000:3.0:1788361752.093786:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407056128 00000100:00100000:3.0:1788361752.093870:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4942 00000100:00100000:3.0:1788361752.093902:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2409:x1875230407056128:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:3.0:1788361752.094141:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2409:x1875230407056128:12345-192.168.204.35@tcp:2:touch.0 Request processed in 254us (426us total) trans 4294968754 rc 0/0 00000100:00100000:3.0:1788361752.094149:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4942 00000100:00100000:0.0:1788361752.097639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.097687:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407056384 00000100:00100000:2.0:1788361752.097697:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407056384 00000100:00100000:2.0:1788361752.097744:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:2.0:1788361752.097752:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:73459:x1875230407056384:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.098104:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:73459:x1875230407056384:12345-192.168.204.35@tcp:35:touch.0 Request processed in 351us (472us total) trans 124554051594 rc 0/0 00000100:00100000:2.0:1788361752.098112:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:0.0:1788361752.100513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.101144:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407056640 00000100:00100000:2.0:1788361752.101154:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407056640 00000100:00100000:2.0:1788361752.101209:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1384 00000100:00100000:2.0:1788361752.101219:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:73459:x1875230407056640:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.101243:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.101277:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47a2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711180 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101395:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101411:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101423:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101438:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101445:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101452:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.101771:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x784:0x0], index 0: 0 00010000:00010000:2.0:1788361752.101968:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe47b7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101977:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe47b7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.101985:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe47b7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102019:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102037:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102043:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102050:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102056:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.102060:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102068:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102080:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.102083:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.102087:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102094:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe47a9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.102106:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047829118 reply state 00000000d3373492 transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102117:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102122:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff99d105584200) 00010000:00010000:2.0:1788361752.102130:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.102133:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.102161:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47a2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711180 expref: 32 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102176:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe47b7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711180 expref: 31 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.102184:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584e00) 00010000:00010000:2.0:1788361752.102186:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.102189:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb800, rc 0) 00000100:00100000:2.0:1788361752.102360:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:73459:x1875230407056640:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1141us (1852us total) trans 124554051595 rc 0/0 00000100:00100000:2.0:1788361752.102369:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1384 00000100:00100000:0.0:1788361752.104573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.104669:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407056896 00000100:00100000:2.0:1788361752.104680:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407056896 00000100:00100000:2.0:1788361752.104740:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1385 00000100:00100000:2.0:1788361752.104750:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:73459:x1875230407056896:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.104812:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.104858:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe47b7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711180 expref: 32 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.104901:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584e00) 00010000:00010000:2.0:1788361752.104912:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.104966:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.104980:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.105004:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.105099:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eed290cf reply state 00000000971ed128 transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.105112:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.105119:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:2.0:1788361752.105121:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.105124:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.105218:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:73459:x1875230407056896:12345-192.168.204.35@tcp:36:touch.0 Request processed in 470us (650us total) trans 124554051596 rc 0/0 00000100:00100000:2.0:1788361752.105226:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1385 00000100:00100000:0.0:1788361752.107036:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.107131:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407057024 00000100:00100000:3.0:1788361752.107145:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407057024 00000100:00100000:3.0:1788361752.107203:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1386 00000100:00100000:3.0:1788361752.107214:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:73459:x1875230407057024:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361752.107236:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361752.107253:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe47cc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711187 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.107314:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe47cc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711187 expref: 34 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.107327:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d200/0x1b69fa8920fe47cc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711187 expref: 34 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.107345:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:3.0:1788361752.107361:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361752.107365:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d200, rc 0) 00000100:00100000:3.0:1788361752.107422:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73459:x1875230407057024:12345-192.168.204.35@tcp:101:touch.0 Request processed in 211us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.107428:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1386 00000100:00100000:0.0:1788361752.109373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.109441:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407057152 00000100:00100000:2.0:1788361752.109457:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407057152 00000100:00100000:2.0:1788361752.109544:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4943 00000100:00100000:2.0:1788361752.109553:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2409:x1875230407057152:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.109775:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2409:x1875230407057152:12345-192.168.204.35@tcp:2:touch.0 Request processed in 222us (412us total) trans 4294968755 rc 0/0 00000100:00100000:2.0:1788361752.109782:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4943 00000100:00100000:0.0:1788361752.112031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.112113:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407057408 00000100:00100000:2.0:1788361752.112127:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407057408 00000100:00100000:2.0:1788361752.112190:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:2.0:1788361752.112200:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73459:x1875230407057408:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.112480:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:73459:x1875230407057408:12345-192.168.204.35@tcp:35:touch.0 Request processed in 281us (678us total) trans 124554051597 rc 0/0 00000100:00100000:2.0:1788361752.112503:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:0.0:1788361752.115567:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.115739:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407057664 00000100:00100000:1.0:1788361752.115753:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407057664 00000100:00100000:1.0:1788361752.115870:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1387 00000100:00100000:1.0:1788361752.115883:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13ffa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:73459:x1875230407057664:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.116083:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.116114:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe47d3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71118e expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.116355:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.116376:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.116391:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.116411:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.116419:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.116427:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.118393:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x785:0x0], index 0: 0 00010000:00010000:1.0:1788361752.118642:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe47e8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118662:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe47e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118675:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe47e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118734:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118766:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118788:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118797:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118812:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.118818:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118862:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118880:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.118895:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.118902:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118909:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe47da lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.118926:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000746183d9 reply state 000000001b45e24a transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118939:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.118946:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff99d112cab500) 00010000:00010000:1.0:1788361752.118954:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.118958:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.119021:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe47d3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71118e expref: 38 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.119039:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe47e8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71118e expref: 37 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.119048:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d112cabc00) 00010000:00010000:1.0:1788361752.119050:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.119052:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715ce00, rc 0) 00000100:00100000:1.0:1788361752.119141:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13ffa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:73459:x1875230407057664:12345-192.168.204.35@tcp:101:touch.0 Request processed in 3261us (3587us total) trans 124554051598 rc 0/0 00000100:00100000:1.0:1788361752.119153:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1387 00000100:00100000:0.0:1788361752.122688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.122772:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407057920 00000100:00100000:2.0:1788361752.122788:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407057920 00000100:00100000:2.0:1788361752.122998:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1388 00000100:00100000:2.0:1788361752.123011:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d005234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:73459:x1875230407057920:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.123094:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.123124:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe47e8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71118e expref: 38 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.123144:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d112cabc00) 00010000:00010000:2.0:1788361752.123154:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.123206:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.123220:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.123229:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.123345:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff6bc801 reply state 00000000830a92d9 transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.123372:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.123378:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:2.0:1788361752.123381:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.123399:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.123503:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d005234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:73459:x1875230407057920:12345-192.168.204.35@tcp:36:touch.0 Request processed in 495us (1101us total) trans 124554051599 rc 0/0 00000100:00100000:2.0:1788361752.123508:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1388 00000100:00100000:0.0:1788361752.125088:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.125154:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407058048 00000100:00100000:1.0:1788361752.125166:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407058048 00000100:00100000:1.0:1788361752.125233:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1389 00000100:00100000:1.0:1788361752.125248:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:73459:x1875230407058048:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.125277:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.125304:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe47fd lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711195 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.125370:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe47fd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711195 expref: 40 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.125387:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be000/0x1b69fa8920fe47fd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711195 expref: 40 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.125431:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:1.0:1788361752.125434:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.125438:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be000, rc 0) 00000100:00100000:1.0:1788361752.125505:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:73459:x1875230407058048:12345-192.168.204.35@tcp:101:touch.0 Request processed in 262us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.125513:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1389 00000100:00100000:0.0:1788361752.127418:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.127598:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407058176 00000100:00100000:1.0:1788361752.127609:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407058176 00000100:00100000:1.0:1788361752.127685:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4944 00000100:00100000:1.0:1788361752.127698:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2412:x1875230407058176:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:1.0:1788361752.128026:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2412:x1875230407058176:12345-192.168.204.35@tcp:2:touch.0 Request processed in 329us (617us total) trans 4294968756 rc 0/0 00000100:00100000:1.0:1788361752.128036:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4944 00000100:00100000:0.0:1788361752.132165:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.132239:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407058432 00000100:00100000:2.0:1788361752.132255:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407058432 00000100:00100000:2.0:1788361752.132376:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:2.0:1788361752.132388:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:73459:x1875230407058432:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.132712:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:73459:x1875230407058432:12345-192.168.204.35@tcp:35:touch.0 Request processed in 326us (558us total) trans 124554051600 rc 0/0 00000100:00100000:2.0:1788361752.132721:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:3.0:1788361752.136065:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.136173:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407058688 00000100:00100000:2.0:1788361752.136186:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407058688 00000100:00100000:2.0:1788361752.136257:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1390 00000100:00100000:2.0:1788361752.136280:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:73459:x1875230407058688:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.136304:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.136326:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe4804 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71119c expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.136439:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.136454:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.136463:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.136474:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.136492:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.136499:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.136804:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x786:0x0], index 0: 0 00010000:00010000:2.0:1788361752.137101:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4819 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137111:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4819 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137118:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4819 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137150:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137157:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137163:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137169:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137175:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.137179:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137198:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137210:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.137213:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.137218:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137224:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe480b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.137238:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb969a97 reply state 0000000041f1fb96 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137248:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137253:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff99d105584e00) 00010000:00010000:2.0:1788361752.137256:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.137258:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.137290:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe4804 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71119c expref: 44 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137306:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4819 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71119c expref: 43 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.137313:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584400) 00010000:00010000:2.0:1788361752.137315:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.137318:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715dc00, rc 0) 00000100:00100000:2.0:1788361752.137438:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:73459:x1875230407058688:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1171us (1386us total) trans 124554051601 rc 0/0 00000100:00100000:2.0:1788361752.137446:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1390 00000100:00100000:0.0:1788361752.140967:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.141462:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407058944 00000100:00100000:3.0:1788361752.141501:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407058944 00000100:00100000:2.0:1788361752.142871:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1391 00000100:00100000:2.0:1788361752.142911:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:73459:x1875230407058944:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.142975:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.143005:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4819 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71119c expref: 44 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.143027:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584400) 00010000:00010000:2.0:1788361752.143038:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.143088:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.143101:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.143113:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.143220:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cdc0954 reply state 0000000013450182 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.143233:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.143239:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:2.0:1788361752.143242:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.143244:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.143373:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:73459:x1875230407058944:12345-192.168.204.35@tcp:36:touch.0 Request processed in 489us (2414us total) trans 124554051602 rc 0/0 00000100:00100000:2.0:1788361752.143380:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1391 00000100:00100000:0.0:1788361752.145224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.145385:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407059072 00000100:00100000:3.0:1788361752.145398:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407059072 00000100:00100000:3.0:1788361752.145470:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1392 00000100:00100000:3.0:1788361752.145483:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:73459:x1875230407059072:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:3.0:1788361752.145516:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361752.145542:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d000/0x1b69fa8920fe482e lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111a3 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.146550:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d000/0x1b69fa8920fe482e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111a3 expref: 46 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.146568:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d000/0x1b69fa8920fe482e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111a3 expref: 46 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.146585:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:3.0:1788361752.146587:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361752.146591:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d000, rc 0) 00000100:00100000:3.0:1788361752.146666:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+46:73459:x1875230407059072:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1188us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.146673:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1392 00000100:00100000:3.0:1788361752.149164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.149327:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407059200 00000100:00100000:2.0:1788361752.149344:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407059200 00000100:00100000:2.0:1788361752.149421:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4945 00000100:00100000:2.0:1788361752.149433:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2410:x1875230407059200:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.149679:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2410:x1875230407059200:12345-192.168.204.35@tcp:2:touch.0 Request processed in 248us (524us total) trans 4294968757 rc 0/0 00000100:00100000:2.0:1788361752.149688:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4945 00000100:00100000:0.0:1788361752.152448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.152615:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407059456 00000100:00100000:2.0:1788361752.152628:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407059456 00000100:00100000:2.0:1788361752.152786:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 249 00000100:00100000:2.0:1788361752.152796:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+46:73459:x1875230407059456:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.153141:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+47:73459:x1875230407059456:12345-192.168.204.35@tcp:35:touch.0 Request processed in 346us (705us total) trans 124554051603 rc 0/0 00000100:00100000:2.0:1788361752.153150:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 249 00000100:00100000:0.0:1788361752.156438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.156540:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407059712 00000100:00100000:1.0:1788361752.156549:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407059712 00000100:00100000:1.0:1788361752.156644:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1393 00000100:00100000:1.0:1788361752.156652:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+47:73459:x1875230407059712:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.156673:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.156690:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe4835 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111aa expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.156770:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.156782:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.156802:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.156812:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.156817:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.156846:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.157185:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x787:0x0], index 0: 0 00010000:00010000:1.0:1788361752.157326:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe484a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157341:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe484a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157348:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe484a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157380:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157386:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157393:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157399:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157412:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfe00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.157416:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157424:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157436:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.157439:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.157444:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157450:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe483c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.157462:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067e05b7b reply state 00000000d07cd01c transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157471:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157477:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff99d112cabd00) 00010000:00010000:1.0:1788361752.157479:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.157482:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.157508:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe4835 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111aa expref: 50 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157519:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe484a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111aa expref: 49 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.157532:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d112cab100) 00010000:00010000:1.0:1788361752.157534:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.157535:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf600, rc 0) 00000100:00100000:1.0:1788361752.157585:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:73459:x1875230407059712:12345-192.168.204.35@tcp:101:touch.0 Request processed in 933us (1155us total) trans 124554051604 rc 0/0 00000100:00100000:1.0:1788361752.157592:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1393 00000100:00100000:3.0:1788361752.161096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.161141:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407059968 00000100:00100000:2.0:1788361752.161150:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407059968 00000100:00100000:2.0:1788361752.161203:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1394 00000100:00100000:2.0:1788361752.161213:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:73459:x1875230407059968:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.161297:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.161323:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe484a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111aa expref: 50 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.161342:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d112cab100) 00010000:00010000:2.0:1788361752.161359:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.161414:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.161427:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.161437:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.161547:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d32ddb2 reply state 000000003ff7caf5 transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.161560:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.161566:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:2.0:1788361752.161568:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.161571:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.161656:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:73459:x1875230407059968:12345-192.168.204.35@tcp:36:touch.0 Request processed in 444us (566us total) trans 124554051605 rc 0/0 00000100:00100000:2.0:1788361752.161664:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1394 00000100:00100000:0.0:1788361752.163958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.164001:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407060096 00000100:00100000:1.0:1788361752.164010:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407060096 00000100:00100000:1.0:1788361752.164076:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1395 00000100:00100000:1.0:1788361752.164086:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:73459:x1875230407060096:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.164109:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.164129:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf000/0x1b69fa8920fe485f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111b1 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.164179:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf000/0x1b69fa8920fe485f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111b1 expref: 52 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.164193:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf000/0x1b69fa8920fe485f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111b1 expref: 52 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.164211:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:1.0:1788361752.164214:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.164217:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf000, rc 0) 00000100:00100000:1.0:1788361752.164273:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d120e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:73459:x1875230407060096:12345-192.168.204.35@tcp:101:touch.0 Request processed in 189us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.164296:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1395 00000100:00100000:0.0:1788361752.166856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.166933:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407060224 00000100:00100000:2.0:1788361752.166943:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407060224 00000100:00100000:2.0:1788361752.166989:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4946 00000100:00100000:2.0:1788361752.166996:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2409:x1875230407060224:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.167199:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2409:x1875230407060224:12345-192.168.204.35@tcp:2:touch.0 Request processed in 202us (350us total) trans 4294968758 rc 0/0 00000100:00100000:2.0:1788361752.167206:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4946 00000100:00100000:3.0:1788361752.169215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.169301:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407060480 00000100:00100000:2.0:1788361752.169323:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407060480 00000100:00100000:2.0:1788361752.169363:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 250 00000100:00100000:2.0:1788361752.169370:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:73459:x1875230407060480:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.169626:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+53:73459:x1875230407060480:12345-192.168.204.35@tcp:35:touch.0 Request processed in 251us (412us total) trans 124554051606 rc 0/0 00000100:00100000:2.0:1788361752.169634:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 250 00000100:00100000:0.0:1788361752.171039:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.171089:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407060736 00000100:00100000:2.0:1788361752.171097:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407060736 00000100:00100000:2.0:1788361752.171198:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1396 00000100:00100000:2.0:1788361752.171209:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+53:73459:x1875230407060736:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.171230:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.171251:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4866 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111b8 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171332:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171361:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171373:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171387:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171394:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171400:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.171684:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x788:0x0], index 0: 0 00010000:00010000:2.0:1788361752.171808:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe487b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171817:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe487b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171868:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe487b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171919:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171926:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171936:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171943:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171950:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.171954:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171962:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171974:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.171977:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.171988:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.171995:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe486d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.172020:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0c1966e reply state 0000000080b5d2ce transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.172031:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.172041:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff99d105584f00) 00010000:00010000:2.0:1788361752.172044:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.172046:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.172074:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4866 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111b8 expref: 56 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.172088:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe487b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111b8 expref: 55 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.172095:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361752.172098:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.172100:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21200, rc 0) 00000100:00100000:2.0:1788361752.172157:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+56:73459:x1875230407060736:12345-192.168.204.35@tcp:101:touch.0 Request processed in 949us (1122us total) trans 124554051607 rc 0/0 00000100:00100000:2.0:1788361752.172164:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1396 00000100:00100000:0.0:1788361752.175903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.176005:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407060992 00000100:00100000:2.0:1788361752.176014:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407060992 00000100:00100000:2.0:1788361752.176134:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1397 00000100:00100000:2.0:1788361752.176145:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+56:73459:x1875230407060992:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.176209:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.176232:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe487b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111b8 expref: 56 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.176248:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361752.176257:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.176305:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.176318:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.176327:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.176419:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029ede78e reply state 00000000473cbb89 transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.176430:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.176435:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:2.0:1788361752.176438:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.176440:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.176534:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+57:73459:x1875230407060992:12345-192.168.204.35@tcp:36:touch.0 Request processed in 390us (652us total) trans 124554051608 rc 0/0 00000100:00100000:2.0:1788361752.176541:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1397 00000100:00100000:3.0:1788361752.178464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.178563:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407061120 00000100:00100000:1.0:1788361752.178572:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407061120 00000100:00100000:1.0:1788361752.178643:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1398 00000100:00100000:1.0:1788361752.178653:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+57:73459:x1875230407061120:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.178674:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.178692:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe4890 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111bf expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.178741:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe4890 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111bf expref: 58 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.178757:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be800/0x1b69fa8920fe4890 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111bf expref: 58 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.178781:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:1.0:1788361752.178784:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.178788:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be800, rc 0) 00000100:00100000:1.0:1788361752.178861:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+58:73459:x1875230407061120:12345-192.168.204.35@tcp:101:touch.0 Request processed in 210us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.178869:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1398 00000100:00100000:0.0:1788361752.181431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.181500:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407061248 00000100:00100000:1.0:1788361752.181510:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407061248 00000100:00100000:1.0:1788361752.181571:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4947 00000100:00100000:1.0:1788361752.181581:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2409:x1875230407061248:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:1.0:1788361752.181795:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2409:x1875230407061248:12345-192.168.204.35@tcp:2:touch.0 Request processed in 215us (371us total) trans 4294968759 rc 0/0 00000100:00100000:1.0:1788361752.181816:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4947 00000100:00100000:0.0:1788361752.184875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.184940:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407061504 00000100:00100000:2.0:1788361752.184951:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407061504 00000100:00100000:2.0:1788361752.185017:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 251 00000100:00100000:2.0:1788361752.185041:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+58:73459:x1875230407061504:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.185320:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+59:73459:x1875230407061504:12345-192.168.204.35@tcp:35:touch.0 Request processed in 282us (452us total) trans 124554051609 rc 0/0 00000100:00100000:2.0:1788361752.185328:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 251 00000100:00100000:3.0:1788361752.187330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.187400:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407061760 00000100:00100000:1.0:1788361752.187408:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407061760 00000100:00100000:1.0:1788361752.187460:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1399 00000100:00100000:1.0:1788361752.187469:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+59:73459:x1875230407061760:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.187490:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.187510:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4897 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111c6 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.187611:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.187625:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.187634:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.187643:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.187648:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.187652:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.187949:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x789:0x0], index 0: 0 00010000:00010000:1.0:1788361752.188060:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe48ac lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188081:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe48ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188089:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe48ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188128:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188134:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188140:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188146:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188152:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.188156:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188163:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188173:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.188176:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.188180:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188199:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe489e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.188217:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054361bba reply state 00000000c4ee051a transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188227:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188234:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff99d112cabe00) 00010000:00010000:1.0:1788361752.188236:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.188238:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.188264:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4897 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111c6 expref: 62 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188278:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe48ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111c6 expref: 61 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.188284:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d112cab700) 00010000:00010000:1.0:1788361752.188286:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.188289:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bec00, rc 0) 00000100:00100000:1.0:1788361752.188341:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+62:73459:x1875230407061760:12345-192.168.204.35@tcp:101:touch.0 Request processed in 873us (1018us total) trans 124554051610 rc 0/0 00000100:00100000:1.0:1788361752.188349:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1399 00000100:00100000:0.0:1788361752.190656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.190726:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407062016 00000100:00100000:3.0:1788361752.190734:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407062016 00000100:00100000:2.0:1788361752.190879:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1400 00000100:00100000:2.0:1788361752.190905:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+62:73459:x1875230407062016:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.190957:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.190981:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe48ac lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111c6 expref: 62 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.190998:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d112cab700) 00010000:00010000:2.0:1788361752.191008:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.191054:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.191066:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.191074:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.191168:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000188aad9e reply state 00000000515480b7 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.191180:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.191187:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361752.191196:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.191199:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.191286:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+63:73459:x1875230407062016:12345-192.168.204.35@tcp:36:touch.0 Request processed in 385us (634us total) trans 124554051611 rc 0/0 00000100:00100000:2.0:1788361752.191293:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1400 00000100:00100000:0.0:1788361752.193352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.193535:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407062144 00000100:00100000:2.0:1788361752.193544:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407062144 00000100:00100000:2.0:1788361752.193598:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1401 00000100:00100000:2.0:1788361752.193608:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+63:73459:x1875230407062144:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.193629:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.193646:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe48c1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111cd expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.193691:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe48c1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111cd expref: 64 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.193706:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21600/0x1b69fa8920fe48c1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111cd expref: 64 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.193728:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361752.193732:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.193735:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c21600, rc 0) 00000100:00100000:2.0:1788361752.193784:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+64:73459:x1875230407062144:12345-192.168.204.35@tcp:101:touch.0 Request processed in 177us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.193790:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1401 00000100:00100000:3.0:1788361752.195422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361752.195543:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407062272 00000100:00100000:0.0:1788361752.195551:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407062272 00000100:00100000:0.0:1788361752.195694:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4948 00000100:00100000:0.0:1788361752.195717:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2410:x1875230407062272:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:0.0:1788361752.195954:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:2410:x1875230407062272:12345-192.168.204.35@tcp:2:touch.0 Request processed in 239us (536us total) trans 4294968760 rc 0/0 00000100:00100000:0.0:1788361752.195961:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4948 00000100:00100000:0.0:1788361752.197307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.197400:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407062528 00000100:00100000:2.0:1788361752.197411:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407062528 00000100:00100000:2.0:1788361752.197467:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 252 00000100:00100000:2.0:1788361752.197495:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+64:73459:x1875230407062528:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.197772:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+65:73459:x1875230407062528:12345-192.168.204.35@tcp:35:touch.0 Request processed in 280us (469us total) trans 124554051612 rc 0/0 00000100:00100000:2.0:1788361752.197779:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 252 00000100:00100000:1.0:1788361752.199879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.199968:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407062784 00000100:00100000:2.0:1788361752.199977:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407062784 00000100:00100000:2.0:1788361752.200048:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1402 00000100:00100000:2.0:1788361752.200058:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d00335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+65:73459:x1875230407062784:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.200081:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.200101:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe48c8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111d4 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200204:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200220:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200240:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200256:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200264:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200270:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.200570:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78a:0x0], index 0: 0 00010000:00010000:2.0:1788361752.200699:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe48dd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200708:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe48dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200715:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe48dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200744:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200750:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200756:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200762:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200767:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.200771:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200790:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200801:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.200804:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.200815:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200850:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe48cf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.200865:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c1a4f52 reply state 00000000dc7a948e transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200876:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200895:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff99d105584a00) 00010000:00010000:2.0:1788361752.200898:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.200901:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.200929:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe48c8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111d4 expref: 68 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200943:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe48dd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111d4 expref: 67 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.200950:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d009c1d000) 00010000:00010000:2.0:1788361752.200952:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.200954:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012eb800, rc 0) 00000100:00100000:2.0:1788361752.201008:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d00335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+68:73459:x1875230407062784:12345-192.168.204.35@tcp:101:touch.0 Request processed in 951us (1137us total) trans 124554051613 rc 0/0 00000100:00100000:2.0:1788361752.201015:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1402 00000100:00100000:0.0:1788361752.203490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.203585:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407063040 00000100:00100000:3.0:1788361752.203595:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407063040 00000100:00100000:3.0:1788361752.203687:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1403 00000100:00100000:3.0:1788361752.203702:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+68:73459:x1875230407063040:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:3.0:1788361752.203983:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361752.204011:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe48dd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111d4 expref: 68 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.204031:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d009c1d000) 00010000:00010000:3.0:1788361752.204041:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361752.204101:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.204119:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.204126:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361752.204215:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c478c447 reply state 00000000c4ad81f4 transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.204227:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.204234:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:3.0:1788361752.204236:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361752.204238:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361752.204325:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+69:73459:x1875230407063040:12345-192.168.204.35@tcp:36:touch.0 Request processed in 630us (843us total) trans 124554051614 rc 0/0 00000100:00100000:3.0:1788361752.204347:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1403 00000100:00100000:0.0:1788361752.205988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.206079:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407063168 00000100:00100000:1.0:1788361752.206088:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407063168 00000100:00100000:1.0:1788361752.206141:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1404 00000100:00100000:1.0:1788361752.206152:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+69:73459:x1875230407063168:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.206172:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.206199:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe48f2 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111db expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.206248:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe48f2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111db expref: 70 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.206262:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfa00/0x1b69fa8920fe48f2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111db expref: 70 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.206278:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:1.0:1788361752.206281:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.206284:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfa00, rc 0) 00000100:00100000:1.0:1788361752.206361:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+70:73459:x1875230407063168:12345-192.168.204.35@tcp:101:touch.0 Request processed in 211us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.206367:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1404 00000100:00100000:1.0:1788361752.208360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.208449:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407063296 00000100:00100000:3.0:1788361752.208456:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407063296 00000100:00100000:3.0:1788361752.208507:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4949 00000100:00100000:3.0:1788361752.208517:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:2409:x1875230407063296:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:3.0:1788361752.208701:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2409:x1875230407063296:12345-192.168.204.35@tcp:2:touch.0 Request processed in 185us (345us total) trans 4294968761 rc 0/0 00000100:00100000:3.0:1788361752.208710:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4949 00000100:00100000:0.0:1788361752.210584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.210630:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407063552 00000100:00100000:2.0:1788361752.210638:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407063552 00000100:00100000:2.0:1788361752.210689:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 253 00000100:00100000:2.0:1788361752.210699:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+70:73459:x1875230407063552:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.211013:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+71:73459:x1875230407063552:12345-192.168.204.35@tcp:35:touch.0 Request processed in 316us (432us total) trans 124554051615 rc 0/0 00000100:00100000:2.0:1788361752.211018:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 253 00000100:00100000:0.0:1788361752.212965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.213034:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407063808 00000100:00100000:1.0:1788361752.213044:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407063808 00000100:00100000:1.0:1788361752.213098:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1405 00000100:00100000:1.0:1788361752.213105:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+71:73459:x1875230407063808:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.213124:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.213143:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be600/0x1b69fa8920fe48f9 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111e2 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213237:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213252:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213278:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213294:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213302:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213309:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.213626:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78b:0x0], index 0: 0 00010000:00010000:1.0:1788361752.213757:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe490e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213767:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe490e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213775:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe490e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213803:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213811:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213817:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213848:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213860:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.213865:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213873:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213899:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.213903:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.213908:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213915:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe4900 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.213928:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d0c2e38 reply state 00000000ffad5b45 transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213939:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213945:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff99d112cab800) 00010000:00010000:1.0:1788361752.213947:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.213949:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.213977:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be600/0x1b69fa8920fe48f9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111e2 expref: 74 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.213992:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe490e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111e2 expref: 73 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.214006:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d112cabf00) 00010000:00010000:1.0:1788361752.214008:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.214009:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bee00, rc 0) 00000100:00100000:1.0:1788361752.214063:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+74:73459:x1875230407063808:12345-192.168.204.35@tcp:101:touch.0 Request processed in 958us (1104us total) trans 124554051616 rc 0/0 00000100:00100000:1.0:1788361752.214071:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1405 00000100:00100000:1.0:1788361752.216286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.216376:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407064064 00000100:00100000:2.0:1788361752.216386:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407064064 00000100:00100000:2.0:1788361752.216443:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1406 00000100:00100000:2.0:1788361752.216452:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+74:73459:x1875230407064064:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.216502:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.216525:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe490e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111e2 expref: 74 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.216542:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d112cabf00) 00010000:00010000:2.0:1788361752.216552:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.216599:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.216611:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.216620:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.216716:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f71fbbb1 reply state 0000000050d6a091 transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.216727:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.216734:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:2.0:1788361752.216749:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.216752:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.216871:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+75:73459:x1875230407064064:12345-192.168.204.35@tcp:36:touch.0 Request processed in 419us (590us total) trans 124554051617 rc 0/0 00000100:00100000:2.0:1788361752.216879:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1406 00000100:00100000:0.0:1788361752.218902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.218956:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407064192 00000100:00100000:2.0:1788361752.218966:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407064192 00000100:00100000:2.0:1788361752.219019:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1407 00000100:00100000:2.0:1788361752.219028:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+75:73459:x1875230407064192:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.219060:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.219081:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4923 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111e9 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.219147:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4923 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111e9 expref: 76 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.219164:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20600/0x1b69fa8920fe4923 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111e9 expref: 76 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.219182:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:2.0:1788361752.219185:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.219188:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20600, rc 0) 00000100:00100000:2.0:1788361752.219251:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+76:73459:x1875230407064192:12345-192.168.204.35@tcp:101:touch.0 Request processed in 216us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.219258:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1407 00000100:00100000:0.0:1788361752.221199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.221262:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407064320 00000100:00100000:2.0:1788361752.221272:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407064320 00000100:00100000:2.0:1788361752.221352:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4950 00000100:00100000:2.0:1788361752.221378:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2410:x1875230407064320:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.221620:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2410:x1875230407064320:12345-192.168.204.35@tcp:2:touch.0 Request processed in 246us (437us total) trans 4294968762 rc 0/0 00000100:00100000:2.0:1788361752.221628:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4950 00000100:00100000:1.0:1788361752.223534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.223586:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407064576 00000100:00100000:3.0:1788361752.223596:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407064576 00000100:00100000:1.0:1788361752.223669:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 254 00000100:00100000:1.0:1788361752.223679:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+76:73459:x1875230407064576:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361752.224005:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1170ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+77:73459:x1875230407064576:12345-192.168.204.35@tcp:35:touch.0 Request processed in 327us (479us total) trans 124554051618 rc 0/0 00000100:00100000:1.0:1788361752.224013:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 254 00000100:00100000:0.0:1788361752.225791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.225905:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407064832 00000100:00100000:2.0:1788361752.225914:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407064832 00000100:00100000:2.0:1788361752.225971:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1408 00000100:00100000:2.0:1788361752.225981:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+77:73459:x1875230407064832:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.226000:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.226020:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe492a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111f0 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226121:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226136:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226146:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226162:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226169:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226174:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.226508:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78c:0x0], index 0: 0 00010000:00010000:2.0:1788361752.226632:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe493f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226642:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe493f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226649:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe493f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226682:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226689:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226695:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226702:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226708:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.226712:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226719:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226730:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.226733:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.226744:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226751:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4931 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.226766:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000978b4533 reply state 00000000ecdc3a9e transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226778:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226784:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff99d009c1d800) 00010000:00010000:2.0:1788361752.226787:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.226789:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.226817:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe492a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111f0 expref: 80 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226862:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe493f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111f0 expref: 79 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.226869:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:2.0:1788361752.226872:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.226875:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030400, rc 0) 00000100:00100000:2.0:1788361752.226950:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+80:73459:x1875230407064832:12345-192.168.204.35@tcp:101:touch.0 Request processed in 971us (1167us total) trans 124554051619 rc 0/0 00000100:00100000:2.0:1788361752.226958:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1408 00000100:00100000:0.0:1788361752.233948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.234091:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407065088 00000100:00100000:3.0:1788361752.234102:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407065088 00000100:00100000:3.0:1788361752.234169:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1409 00000100:00100000:3.0:1788361752.234183:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+80:73459:x1875230407065088:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:3.0:1788361752.234239:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361752.234268:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe493f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111f0 expref: 80 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.234288:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:3.0:1788361752.234299:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361752.234354:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.234367:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.234377:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361752.234488:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004791fb74 reply state 00000000971d49b7 transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.234501:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.234507:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:3.0:1788361752.234509:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361752.234511:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361752.234677:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+81:73459:x1875230407065088:12345-192.168.204.35@tcp:36:touch.0 Request processed in 496us (734us total) trans 124554051620 rc 0/0 00000100:00100000:3.0:1788361752.234685:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1409 00000100:00100000:0.0:1788361752.236995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.237118:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407065216 00000100:00100000:1.0:1788361752.237139:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407065216 00000100:00100000:1.0:1788361752.237195:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1410 00000100:00100000:1.0:1788361752.237205:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+81:73459:x1875230407065216:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.237226:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.237243:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be600/0x1b69fa8920fe4954 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111f7 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.237300:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be600/0x1b69fa8920fe4954 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111f7 expref: 82 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.237331:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be600/0x1b69fa8920fe4954 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111f7 expref: 82 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.237350:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:1.0:1788361752.237353:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.237357:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be600, rc 0) 00000100:00100000:1.0:1788361752.237574:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+82:73459:x1875230407065216:12345-192.168.204.35@tcp:101:touch.0 Request processed in 370us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.237582:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1410 00000100:00100000:0.0:1788361752.239280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.239446:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407065344 00000100:00100000:1.0:1788361752.239455:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407065344 00000100:00100000:1.0:1788361752.239534:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4951 00000100:00100000:1.0:1788361752.239544:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2410:x1875230407065344:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:1.0:1788361752.239738:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:2410:x1875230407065344:12345-192.168.204.35@tcp:2:touch.0 Request processed in 196us (464us total) trans 4294968763 rc 0/0 00000100:00100000:1.0:1788361752.239746:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4951 00000100:00100000:0.0:1788361752.243797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.243879:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407065600 00000100:00100000:2.0:1788361752.243956:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407065600 00000100:00100000:2.0:1788361752.244013:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 255 00000100:00100000:2.0:1788361752.244025:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+82:73459:x1875230407065600:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.244338:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+83:73459:x1875230407065600:12345-192.168.204.35@tcp:35:touch.0 Request processed in 315us (554us total) trans 124554051621 rc 0/0 00000100:00100000:2.0:1788361752.244346:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 255 00000100:00100000:2.0:1788361752.246687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361752.246753:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407065856 00000100:00100000:0.0:1788361752.246763:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407065856 00000100:00100000:0.0:1788361752.246820:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1411 00000100:00100000:0.0:1788361752.246853:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+83:73459:x1875230407065856:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:0.0:1788361752.246876:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361752.246908:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe495b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7111fe expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247011:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247042:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247053:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247067:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247074:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247080:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361752.247375:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78d:0x0], index 0: 0 00010000:00010000:0.0:1788361752.247503:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4970 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247512:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4970 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247520:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4970 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247550:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247555:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247559:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247571:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247578:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361752.247582:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247589:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247601:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361752.247604:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361752.247608:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247615:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4962 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361752.247628:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd057bd7 reply state 000000002d5b8939 transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247639:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247643:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff99d136764700) 00010000:00010000:0.0:1788361752.247644:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361752.247646:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361752.247667:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe495b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111fe expref: 86 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247679:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4970 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111fe expref: 85 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361752.247692:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d136764f00) 00010000:00010000:0.0:1788361752.247694:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361752.247697:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916000, rc 0) 00000100:00100000:0.0:1788361752.247864:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+86:73459:x1875230407065856:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1011us (1183us total) trans 124554051622 rc 0/0 00000100:00100000:0.0:1788361752.247872:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1411 00000100:00100000:0.0:1788361752.250057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.250135:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407066112 00000100:00100000:2.0:1788361752.250147:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407066112 00000100:00100000:2.0:1788361752.250211:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1412 00000100:00100000:2.0:1788361752.250219:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+86:73459:x1875230407066112:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.250285:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.250322:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4970 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7111fe expref: 86 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.250347:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d136764f00) 00010000:00010000:2.0:1788361752.250361:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.250430:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.250445:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.250456:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.250591:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eee33111 reply state 00000000589fb9dc transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.250606:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.250637:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:2.0:1788361752.250639:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.250643:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.250751:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+87:73459:x1875230407066112:12345-192.168.204.35@tcp:36:touch.0 Request processed in 532us (708us total) trans 124554051623 rc 0/0 00000100:00100000:2.0:1788361752.250759:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1412 00000100:00100000:3.0:1788361752.252552:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.252611:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407066240 00000100:00100000:2.0:1788361752.252623:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407066240 00000100:00100000:2.0:1788361752.252689:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1413 00000100:00100000:2.0:1788361752.252703:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+87:73459:x1875230407066240:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.252732:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.252752:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031800/0x1b69fa8920fe4985 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711205 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.252817:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031800/0x1b69fa8920fe4985 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711205 expref: 88 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.252867:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031800/0x1b69fa8920fe4985 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711205 expref: 88 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.252908:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:2.0:1788361752.252912:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.252915:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100031800, rc 0) 00000100:00100000:2.0:1788361752.252969:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+88:73459:x1875230407066240:12345-192.168.204.35@tcp:101:touch.0 Request processed in 270us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.252977:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1413 00000100:00100000:0.0:1788361752.254397:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.254483:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407066368 00000100:00100000:3.0:1788361752.254493:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407066368 00000100:00100000:3.0:1788361752.254557:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4952 00000100:00100000:3.0:1788361752.254567:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:2410:x1875230407066368:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:3.0:1788361752.254768:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:2410:x1875230407066368:12345-192.168.204.35@tcp:2:touch.0 Request processed in 198us (373us total) trans 4294968764 rc 0/0 00000100:00100000:3.0:1788361752.254776:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4952 00000100:00100000:0.0:1788361752.256495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.256551:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407066624 00000100:00100000:1.0:1788361752.256560:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407066624 00000100:00100000:1.0:1788361752.256609:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 256 00000100:00100000:1.0:1788361752.256618:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+88:73459:x1875230407066624:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361752.256960:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+89:73459:x1875230407066624:12345-192.168.204.35@tcp:35:touch.0 Request processed in 342us (470us total) trans 124554051624 rc 0/0 00000100:00100000:1.0:1788361752.256968:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 256 00000100:00100000:0.0:1788361752.261154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.261232:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407066880 00000100:00100000:1.0:1788361752.261255:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407066880 00000100:00100000:1.0:1788361752.261319:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1414 00000100:00100000:1.0:1788361752.261334:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+89:73459:x1875230407066880:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.261357:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.261377:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe498c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71120c expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.261478:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.261492:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.261503:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.261524:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.261531:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.261537:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.261807:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78e:0x0], index 0: 0 00010000:00010000:1.0:1788361752.262101:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe49a1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262111:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe49a1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262130:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe49a1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262167:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262174:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262181:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262187:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262193:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bee00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.262197:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262205:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262217:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.262220:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.262224:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262231:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4993 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.262244:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8d40b0e reply state 00000000f2bd1bd6 transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262265:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262271:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff99d112cab300) 00010000:00010000:1.0:1788361752.262274:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.262276:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.262305:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe498c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71120c expref: 92 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262319:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe49a1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71120c expref: 91 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.262327:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d112cabb00) 00010000:00010000:1.0:1788361752.262329:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.262331:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf800, rc 0) 00000100:00100000:1.0:1788361752.262398:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+92:73459:x1875230407066880:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1071us (1254us total) trans 124554051625 rc 0/0 00000100:00100000:1.0:1788361752.262406:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1414 00000100:00100000:0.0:1788361752.264793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.264995:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407067136 00000100:00100000:3.0:1788361752.265006:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407067136 00000100:00100000:3.0:1788361752.265098:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1415 00000100:00100000:3.0:1788361752.265108:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+92:73459:x1875230407067136:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:3.0:1788361752.265162:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361752.265194:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe49a1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71120c expref: 92 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.265220:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d112cabb00) 00010000:00010000:3.0:1788361752.265232:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361752.265283:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.265295:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.265305:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361752.265413:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1a2a8c7 reply state 00000000ef91d101 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.265425:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.265431:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:3.0:1788361752.265433:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361752.265436:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361752.265529:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+93:73459:x1875230407067136:12345-192.168.204.35@tcp:36:touch.0 Request processed in 422us (743us total) trans 124554051626 rc 0/0 00000100:00100000:3.0:1788361752.265536:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1415 00000100:00100000:0.0:1788361752.267225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.268654:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407067264 00000100:00100000:1.0:1788361752.268671:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407067264 00000100:00100000:1.0:1788361752.268811:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1416 00000100:00100000:1.0:1788361752.268838:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+93:73459:x1875230407067264:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.268879:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.268911:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe49b6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711213 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.268972:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe49b6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711213 expref: 94 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.269004:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf200/0x1b69fa8920fe49b6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711213 expref: 94 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.269023:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:1.0:1788361752.269026:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.269030:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf200, rc 0) 00000100:00100000:1.0:1788361752.269096:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+94:73459:x1875230407067264:12345-192.168.204.35@tcp:101:touch.0 Request processed in 275us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.269103:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1416 00000100:00100000:0.0:1788361752.270615:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.270670:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407067392 00000100:00100000:1.0:1788361752.270678:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407067392 00000100:00100000:1.0:1788361752.270727:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4953 00000100:00100000:1.0:1788361752.270736:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:2409:x1875230407067392:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:1.0:1788361752.271153:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:2409:x1875230407067392:12345-192.168.204.35@tcp:2:touch.0 Request processed in 417us (540us total) trans 4294968765 rc 0/0 00000100:00100000:1.0:1788361752.271161:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4953 00000100:00100000:0.0:1788361752.272411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.272453:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407067648 00000100:00100000:2.0:1788361752.272460:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407067648 00000100:00100000:2.0:1788361752.272497:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 257 00000100:00100000:2.0:1788361752.272506:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+94:73459:x1875230407067648:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.272725:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+95:73459:x1875230407067648:12345-192.168.204.35@tcp:35:touch.0 Request processed in 220us (317us total) trans 124554051627 rc 0/0 00000100:00100000:2.0:1788361752.272734:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 257 00000100:00100000:0.0:1788361752.274054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.274134:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407067904 00000100:00100000:2.0:1788361752.274141:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407067904 00000100:00100000:2.0:1788361752.274185:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1417 00000100:00100000:2.0:1788361752.274195:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+95:73459:x1875230407067904:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.274215:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.274234:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe49bd lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71121a expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274357:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274372:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274383:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274397:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274404:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274424:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.274760:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78f:0x0], index 0: 0 00010000:00010000:2.0:1788361752.274989:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe49d2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.274999:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe49d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275007:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe49d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275039:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275058:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275065:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275071:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275078:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.275082:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275090:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275113:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.275116:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.275121:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275127:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe49c4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.275142:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e85a226 reply state 00000000ebff0480 transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275154:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275160:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff99d009c1df00) 00010000:00010000:2.0:1788361752.275162:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.275165:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.275191:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe49bd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71121a expref: 98 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275206:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe49d2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71121a expref: 97 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.275213:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:2.0:1788361752.275216:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.275218:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100031200, rc 0) 00000100:00100000:2.0:1788361752.275274:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+98:73459:x1875230407067904:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1080us (1223us total) trans 124554051628 rc 0/0 00000100:00100000:2.0:1788361752.275282:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1417 00000100:00100000:0.0:1788361752.277356:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.277435:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407068160 00000100:00100000:2.0:1788361752.277452:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407068160 00000100:00100000:2.0:1788361752.277505:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1418 00000100:00100000:2.0:1788361752.277515:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+98:73459:x1875230407068160:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.277573:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.277596:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe49d2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71121a expref: 98 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.277613:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:2.0:1788361752.277622:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.277663:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.277673:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.277679:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.277757:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bca13c4a reply state 00000000f5019653 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.277764:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.277769:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:2.0:1788361752.277771:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.277772:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.277861:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+99:73459:x1875230407068160:12345-192.168.204.35@tcp:36:touch.0 Request processed in 347us (513us total) trans 124554051629 rc 0/0 00000100:00100000:2.0:1788361752.277897:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1418 00000100:00100000:0.0:1788361752.279272:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.279394:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407068288 00000100:00100000:2.0:1788361752.279402:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407068288 00000100:00100000:2.0:1788361752.279503:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1419 00000100:00100000:2.0:1788361752.279514:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+99:73459:x1875230407068288:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.279534:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.279550:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030600/0x1b69fa8920fe49e7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711221 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.279597:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030600/0x1b69fa8920fe49e7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711221 expref: 100 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.279613:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030600/0x1b69fa8920fe49e7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711221 expref: 100 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.279630:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:2.0:1788361752.279633:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.279637:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030600, rc 0) 00000100:00100000:2.0:1788361752.279682:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+100:73459:x1875230407068288:12345-192.168.204.35@tcp:101:touch.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.279690:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1419 00000100:00100000:0.0:1788361752.281405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.281444:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407068416 00000100:00100000:3.0:1788361752.281451:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407068416 00000100:00100000:3.0:1788361752.281491:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4954 00000100:00100000:3.0:1788361752.281497:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:2410:x1875230407068416:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:3.0:1788361752.281661:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:2410:x1875230407068416:12345-192.168.204.35@tcp:2:touch.0 Request processed in 164us (264us total) trans 4294968766 rc 0/0 00000100:00100000:3.0:1788361752.281679:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4954 00000100:00100000:0.0:1788361752.283131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.283176:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407068672 00000100:00100000:1.0:1788361752.283185:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407068672 00000100:00100000:1.0:1788361752.283239:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 258 00000100:00100000:1.0:1788361752.283248:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+100:73459:x1875230407068672:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361752.283557:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+101:73459:x1875230407068672:12345-192.168.204.35@tcp:35:touch.0 Request processed in 310us (429us total) trans 124554051630 rc 0/0 00000100:00100000:1.0:1788361752.283566:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 258 00000100:00100000:0.0:1788361752.286720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.286803:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407068928 00000100:00100000:1.0:1788361752.286846:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407068928 00000100:00100000:1.0:1788361752.286913:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1420 00000100:00100000:1.0:1788361752.286923:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+101:73459:x1875230407068928:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.286947:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.286969:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe49ee lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711228 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287103:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287131:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287143:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287158:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287165:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287171:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.287473:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x790:0x0], index 0: 0 00010000:00010000:1.0:1788361752.287604:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a03 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287613:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a03 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287632:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a03 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287671:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287678:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287684:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287696:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287703:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.287707:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287714:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287726:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.287729:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.287733:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287739:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe49f5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.287753:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5942c1a reply state 00000000102fb5a1 transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287771:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287777:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff99d112cabb00) 00010000:00010000:1.0:1788361752.287780:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.287782:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.287811:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe49ee lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711228 expref: 104 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287854:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a03 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711228 expref: 103 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.287861:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d112cabf00) 00010000:00010000:1.0:1788361752.287864:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.287866:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfe00, rc 0) 00000100:00100000:1.0:1788361752.287937:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+104:73459:x1875230407068928:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1015us (1232us total) trans 124554051631 rc 0/0 00000100:00100000:1.0:1788361752.287945:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1420 00000100:00100000:0.0:1788361752.291662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.291793:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407069184 00000100:00100000:3.0:1788361752.291804:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407069184 00000100:00100000:3.0:1788361752.291994:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1421 00000100:00100000:3.0:1788361752.292004:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+104:73459:x1875230407069184:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:3.0:1788361752.292061:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361752.292089:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a03 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711228 expref: 104 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361752.293076:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d112cabf00) 00010000:00010000:3.0:1788361752.293095:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.293215:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.293232:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.293243:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.293496:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be523100 reply state 000000006ce3b012 transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.293511:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.293519:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:2.0:1788361752.293521:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.293524:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.293628:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+105:73459:x1875230407069184:12345-192.168.204.35@tcp:36:touch.0 Request processed in 1623us (1971us total) trans 124554051632 rc 0/0 00000100:00100000:2.0:1788361752.293637:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1421 00000100:00100000:0.0:1788361752.295504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.295579:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407069312 00000100:00100000:1.0:1788361752.295589:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407069312 00000100:00100000:1.0:1788361752.295654:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1422 00000100:00100000:1.0:1788361752.295664:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+105:73459:x1875230407069312:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.295688:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.295706:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe4a18 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71122f expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.295757:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe4a18 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71122f expref: 106 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.295785:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf600/0x1b69fa8920fe4a18 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71122f expref: 106 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.295804:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:1.0:1788361752.295807:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.295811:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf600, rc 0) 00000100:00100000:1.0:1788361752.295904:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+106:73459:x1875230407069312:12345-192.168.204.35@tcp:101:touch.0 Request processed in 241us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.295912:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1422 00000100:00100000:0.0:1788361752.298301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.298349:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407069440 00000100:00100000:2.0:1788361752.298363:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407069440 00000100:00100000:2.0:1788361752.298422:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4955 00000100:00100000:2.0:1788361752.298429:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:2409:x1875230407069440:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.298712:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2409:x1875230407069440:12345-192.168.204.35@tcp:2:touch.0 Request processed in 282us (415us total) trans 4294968767 rc 0/0 00000100:00100000:2.0:1788361752.298720:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4955 00000100:00100000:0.0:1788361752.300124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.300211:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407069696 00000100:00100000:2.0:1788361752.300218:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407069696 00000100:00100000:2.0:1788361752.300267:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 259 00000100:00100000:2.0:1788361752.300276:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+106:73459:x1875230407069696:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.301122:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+107:73459:x1875230407069696:12345-192.168.204.35@tcp:35:touch.0 Request processed in 845us (1001us total) trans 124554051633 rc 0/0 00000100:00100000:2.0:1788361752.301132:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 259 00000100:00100000:0.0:1788361752.304134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.304342:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407069952 00000100:00100000:2.0:1788361752.304354:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407069952 00000100:00100000:2.0:1788361752.304438:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1423 00000100:00100000:2.0:1788361752.304449:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+107:73459:x1875230407069952:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.304474:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.304496:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4a1f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711236 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.304591:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.304605:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.304615:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.304628:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.304635:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.304641:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.304970:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x791:0x0], index 0: 0 00010000:00010000:2.0:1788361752.305110:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a34 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305120:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305142:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305182:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305192:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305199:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305205:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305211:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.305215:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305224:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305236:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.305240:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.305244:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305250:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a26 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.305265:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036da9437 reply state 0000000007a11ed3 transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305283:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305289:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff99d009c1dd00) 00010000:00010000:2.0:1788361752.305291:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.305294:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.305323:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4a1f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711236 expref: 110 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305337:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a34 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711236 expref: 109 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.305345:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:2.0:1788361752.305347:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.305350:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030400, rc 0) 00000100:00100000:2.0:1788361752.305413:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73459:x1875230407069952:12345-192.168.204.35@tcp:101:touch.0 Request processed in 967us (1289us total) trans 124554051634 rc 0/0 00000100:00100000:2.0:1788361752.305419:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1423 00000100:00100000:0.0:1788361752.308444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.308682:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407070208 00000100:00100000:2.0:1788361752.308699:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407070208 00000100:00100000:2.0:1788361752.308808:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1424 00000100:00100000:2.0:1788361752.308856:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73459:x1875230407070208:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.308941:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.308974:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a34 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711236 expref: 110 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.309000:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:2.0:1788361752.309023:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.309088:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.309108:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.309121:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.309282:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5f287ff reply state 000000006b99febf transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.309296:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.309303:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:2.0:1788361752.309306:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.309308:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.309430:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+111:73459:x1875230407070208:12345-192.168.204.35@tcp:36:touch.0 Request processed in 611us (997us total) trans 124554051635 rc 0/0 00000100:00100000:2.0:1788361752.309442:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1424 00000100:00100000:0.0:1788361752.312299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.312351:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407070336 00000100:00100000:2.0:1788361752.312365:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407070336 00000100:00100000:2.0:1788361752.312438:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1425 00000100:00100000:2.0:1788361752.312452:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+111:73459:x1875230407070336:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.312478:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.312502:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe4a49 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71123d expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.312577:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe4a49 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71123d expref: 112 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.312608:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20400/0x1b69fa8920fe4a49 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71123d expref: 112 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.312625:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:2.0:1788361752.312628:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.312630:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d137c20400, rc 0) 00000100:00100000:2.0:1788361752.312686:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+112:73459:x1875230407070336:12345-192.168.204.35@tcp:101:touch.0 Request processed in 237us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.312691:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1425 00000100:00100000:3.0:1788361752.314535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.314612:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407070464 00000100:00100000:2.0:1788361752.314620:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407070464 00000100:00100000:2.0:1788361752.314675:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4956 00000100:00100000:2.0:1788361752.314685:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2410:x1875230407070464:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.314991:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:2410:x1875230407070464:12345-192.168.204.35@tcp:2:touch.0 Request processed in 308us (463us total) trans 4294968768 rc 0/0 00000100:00100000:2.0:1788361752.314998:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4956 00000100:00100000:0.0:1788361752.316514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.316626:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407070720 00000100:00100000:1.0:1788361752.316634:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407070720 00000100:00100000:1.0:1788361752.316735:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 260 00000100:00100000:1.0:1788361752.316744:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+112:73459:x1875230407070720:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361752.317041:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+113:73459:x1875230407070720:12345-192.168.204.35@tcp:35:touch.0 Request processed in 297us (533us total) trans 124554051636 rc 0/0 00000100:00100000:1.0:1788361752.317049:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 260 00000100:00100000:0.0:1788361752.320527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.321047:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407070976 00000100:00100000:1.0:1788361752.321057:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407070976 00000100:00100000:1.0:1788361752.321125:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1426 00000100:00100000:1.0:1788361752.321136:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+113:73459:x1875230407070976:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.321160:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.321183:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a50 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711244 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.321284:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.321307:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.321319:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.321336:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.321344:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.321351:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361752.321570:0:94220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d13983e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94220:1875230429912576:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788361752.321624:0:94220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361752.321719:0:94220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c96780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361752.321765:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912576 00000100:00100000:3.0:1788361752.321770:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912576 00000100:00100000:3.0:1788361752.321879:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:3.0:1788361752.321901:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13983ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:94220:x1875230429912576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788361752.321937:0:26161:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1954 00000100:00080000:2.0:1788361752.321944:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788361752.322982:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x792:0x0], index 0: 0 00010000:00010000:1.0:1788361752.323168:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4a65 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323183:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4a65 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323194:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4a65 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323232:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323241:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323248:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323265:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323272:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.323276:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323286:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323299:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.323303:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.323308:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323316:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a57 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.323330:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000322e250f reply state 000000009995fd71 transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323342:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323349:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff99d112cab700) 00010000:00010000:1.0:1788361752.323352:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.323354:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.323389:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a50 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711244 expref: 116 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323406:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4a65 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711244 expref: 115 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.323422:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d112cab100) 00010000:00010000:1.0:1788361752.323425:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.323428:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf800, rc 0) 00000100:00100000:1.0:1788361752.323506:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+116:73459:x1875230407070976:12345-192.168.204.35@tcp:101:touch.0 Request processed in 2371us (2986us total) trans 124554051637 rc 0/0 00000100:00100000:1.0:1788361752.323515:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1426 00000100:00100000:2.0:1788361752.323713:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13983ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:94220:x1875230429912576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1813us (2086us total) trans 4294968769 rc 0/0 00000100:00100000:2.0:1788361752.323721:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00000100:00100000:0.0:1788361752.324588:0:94220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d13983e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94220:1875230429912576:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361752.324613:0:94220:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x792:0x0]-[0x280000401:0x7c1:0x0] 00000100:00100000:0.0:1788361752.325983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.326039:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407071232 00000100:00100000:2.0:1788361752.326049:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407071232 00000100:00100000:2.0:1788361752.326127:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1427 00000100:00100000:2.0:1788361752.326137:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+116:73459:x1875230407071232:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.326192:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.326218:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4a65 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711244 expref: 116 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.326237:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d112cab100) 00010000:00010000:2.0:1788361752.326248:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.326316:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.326329:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.326338:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.326442:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006aebed06 reply state 000000003a6d8b3c transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.326452:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.326456:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:2.0:1788361752.326458:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.326460:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.326527:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+117:73459:x1875230407071232:12345-192.168.204.35@tcp:36:touch.0 Request processed in 392us (551us total) trans 124554051638 rc 0/0 00000100:00100000:2.0:1788361752.326532:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1427 00000100:00100000:3.0:1788361752.330280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.330383:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407071360 00000100:00100000:1.0:1788361752.330392:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407071360 00000100:00100000:1.0:1788361752.330686:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1428 00000100:00100000:1.0:1788361752.330697:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+117:73459:x1875230407071360:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.330719:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.330740:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4800/0x1b69fa8920fe4a7a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71124b expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.330796:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4800/0x1b69fa8920fe4a7a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71124b expref: 118 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.330812:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4800/0x1b69fa8920fe4a7a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71124b expref: 118 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.330853:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:1.0:1788361752.330857:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.330861:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4800, rc 0) 00000100:00100000:1.0:1788361752.330934:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+118:73459:x1875230407071360:12345-192.168.204.35@tcp:101:touch.0 Request processed in 238us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.330959:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1428 00000100:00100000:0.0:1788361752.333451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361752.333645:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407071488 00000100:00100000:3.0:1788361752.333658:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407071488 00000100:00100000:3.0:1788361752.333724:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4958 00000100:00100000:3.0:1788361752.333736:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:2410:x1875230407071488:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:3.0:1788361752.334026:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2410:x1875230407071488:12345-192.168.204.35@tcp:2:touch.0 Request processed in 292us (583us total) trans 4294968770 rc 0/0 00000100:00100000:3.0:1788361752.334035:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4958 00000100:00100000:0.0:1788361752.336584:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.337948:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407071744 00000100:00100000:2.0:1788361752.337980:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407071744 00000100:00100000:2.0:1788361752.338044:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 261 00000100:00100000:2.0:1788361752.338055:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+118:73459:x1875230407071744:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.338348:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+119:73459:x1875230407071744:12345-192.168.204.35@tcp:35:touch.0 Request processed in 295us (1777us total) trans 124554051639 rc 0/0 00000100:00100000:2.0:1788361752.338354:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 261 00000100:00100000:0.0:1788361752.340710:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.340768:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407072000 00000100:00100000:2.0:1788361752.340778:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407072000 00000100:00100000:2.0:1788361752.340975:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1429 00000100:00100000:2.0:1788361752.340986:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+119:73459:x1875230407072000:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.341007:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.341030:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4a81 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711252 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.341133:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.341148:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.341159:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.341174:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.341181:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.341188:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.341715:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x793:0x0], index 0: 0 00010000:00010000:2.0:1788361752.342004:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a96 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342015:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342024:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342057:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342064:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342070:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342076:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342081:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.342085:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342093:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342104:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.342107:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.342119:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342126:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4a88 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.342144:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047184124 reply state 00000000890db058 transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342155:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342161:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff99d009c1d000) 00010000:00010000:2.0:1788361752.342164:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.342166:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.342195:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4a81 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711252 expref: 122 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342210:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a96 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711252 expref: 121 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.342217:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172df00) 00010000:00010000:2.0:1788361752.342220:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.342222:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfc00, rc 0) 00000100:00100000:2.0:1788361752.342569:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+122:73459:x1875230407072000:12345-192.168.204.35@tcp:101:touch.0 Request processed in 1583us (1863us total) trans 124554051640 rc 0/0 00000100:00100000:2.0:1788361752.342578:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1429 00000100:00100000:0.0:1788361752.347314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.347468:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407072256 00000100:00100000:2.0:1788361752.347479:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407072256 00000100:00100000:2.0:1788361752.347767:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1430 00000100:00100000:2.0:1788361752.347780:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+122:73459:x1875230407072256:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.347878:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.347915:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4a96 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711252 expref: 122 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.347934:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172df00) 00010000:00010000:2.0:1788361752.347943:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.347990:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.348002:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.348012:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.348106:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049f11efe reply state 000000003a249cb0 transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.348118:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.348124:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:2.0:1788361752.348127:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.348129:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.348391:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+123:73459:x1875230407072256:12345-192.168.204.35@tcp:36:touch.0 Request processed in 606us (1079us total) trans 124554051641 rc 0/0 00000100:00100000:2.0:1788361752.348399:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1430 00000100:00100000:0.0:1788361752.350135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.350312:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407072384 00000100:00100000:2.0:1788361752.350322:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407072384 00000100:00100000:2.0:1788361752.350371:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1431 00000100:00100000:2.0:1788361752.350453:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+123:73459:x1875230407072384:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.350476:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.350495:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe4aab lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711259 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.350546:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe4aab lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711259 expref: 124 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.350560:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad800/0x1b69fa8920fe4aab lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711259 expref: 124 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.350577:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:2.0:1788361752.350580:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.350583:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad800, rc 0) 00000100:00100000:2.0:1788361752.350673:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+124:73459:x1875230407072384:12345-192.168.204.35@tcp:101:touch.0 Request processed in 223us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.350681:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1431 00000100:00100000:0.0:1788361752.355031:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.355125:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407072512 00000100:00100000:2.0:1788361752.355137:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407072512 00000100:00100000:2.0:1788361752.355187:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4959 00000100:00100000:2.0:1788361752.355198:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2409:x1875230407072512:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.355419:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:2409:x1875230407072512:12345-192.168.204.35@tcp:2:touch.0 Request processed in 222us (399us total) trans 4294968771 rc 0/0 00000100:00100000:2.0:1788361752.355427:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4959 00000100:00100000:0.0:1788361752.359250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.359320:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407072768 00000100:00100000:1.0:1788361752.359329:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407072768 00000100:00100000:1.0:1788361752.359389:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 262 00000100:00100000:1.0:1788361752.359401:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+124:73459:x1875230407072768:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361752.359682:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+125:73459:x1875230407072768:12345-192.168.204.35@tcp:35:touch.0 Request processed in 283us (442us total) trans 124554051642 rc 0/0 00000100:00100000:1.0:1788361752.359691:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 262 00000100:00100000:0.0:1788361752.361535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.361758:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407073024 00000100:00100000:1.0:1788361752.361767:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407073024 00000100:00100000:1.0:1788361752.361907:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1432 00000100:00100000:1.0:1788361752.361917:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+125:73459:x1875230407073024:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.361941:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.361962:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe4ab2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711260 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362047:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362060:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362072:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362086:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362111:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362119:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361752.362398:0:66128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x794:0x0], index 0: 0 00010000:00010000:1.0:1788361752.362507:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4ac7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362513:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4ac7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362518:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4ac7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362547:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362554:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362559:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362565:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362571:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db4000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361752.362575:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362594:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362606:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361752.362609:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361752.362616:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362622:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4ab9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361752.362634:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012400e31 reply state 00000000783bf820 transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362645:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362650:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff99d112cabc00) 00010000:00010000:1.0:1788361752.362652:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361752.362654:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361752.362692:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe4ab2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711260 expref: 128 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362706:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4ac7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711260 expref: 127 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.362714:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d112cab400) 00010000:00010000:1.0:1788361752.362716:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361752.362719:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4200, rc 0) 00000100:00100000:1.0:1788361752.362784:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+128:73459:x1875230407073024:12345-192.168.204.35@tcp:101:touch.0 Request processed in 869us (1253us total) trans 124554051643 rc 0/0 00000100:00100000:1.0:1788361752.362792:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1432 00000100:00100000:0.0:1788361752.365781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.365940:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407073280 00000100:00100000:2.0:1788361752.365954:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407073280 00000100:00100000:2.0:1788361752.366016:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1433 00000100:00100000:2.0:1788361752.366041:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+128:73459:x1875230407073280:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.366098:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.366126:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4ac7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711260 expref: 128 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.366147:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d112cab400) 00010000:00010000:2.0:1788361752.366158:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.366212:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.366225:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.366235:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.366364:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca7580ca reply state 000000003f042cf1 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.366376:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.366381:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:2.0:1788361752.366383:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.366385:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.366475:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+129:73459:x1875230407073280:12345-192.168.204.35@tcp:36:touch.0 Request processed in 436us (700us total) trans 124554051644 rc 0/0 00000100:00100000:2.0:1788361752.366482:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1433 00000100:00100000:0.0:1788361752.367959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.368027:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407073408 00000100:00100000:1.0:1788361752.368037:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407073408 00000100:00100000:1.0:1788361752.368086:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1434 00000100:00100000:1.0:1788361752.368095:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+129:73459:x1875230407073408:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:1.0:1788361752.368115:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361752.368143:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe4adc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711267 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.368193:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe4adc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711267 expref: 130 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.368206:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5000/0x1b69fa8920fe4adc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711267 expref: 130 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361752.368224:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:1.0:1788361752.368227:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361752.368231:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5000, rc 0) 00000100:00100000:1.0:1788361752.368271:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+130:73459:x1875230407073408:12345-192.168.204.35@tcp:101:touch.0 Request processed in 177us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.368277:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1434 00000100:00100000:0.0:1788361752.370163:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.370209:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407073536 00000100:00100000:2.0:1788361752.370217:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407073536 00000100:00100000:2.0:1788361752.370289:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4960 00000100:00100000:2.0:1788361752.370298:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:2409:x1875230407073536:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:2.0:1788361752.370471:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+24:2409:x1875230407073536:12345-192.168.204.35@tcp:2:touch.0 Request processed in 175us (316us total) trans 4294968772 rc 0/0 00000100:00100000:2.0:1788361752.370479:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4960 00000100:00100000:0.0:1788361752.372045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.372107:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407073792 00000100:00100000:2.0:1788361752.372112:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407073792 00000100:00100000:2.0:1788361752.372149:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 263 00000100:00100000:2.0:1788361752.372155:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+130:73459:x1875230407073792:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:2.0:1788361752.372420:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+131:73459:x1875230407073792:12345-192.168.204.35@tcp:35:touch.0 Request processed in 261us (375us total) trans 124554051645 rc 0/0 00000100:00100000:2.0:1788361752.372426:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 263 00000100:00100000:0.0:1788361752.373787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.373851:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407074048 00000100:00100000:2.0:1788361752.373858:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407074048 00000100:00100000:2.0:1788361752.373930:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1435 00000100:00100000:2.0:1788361752.373941:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+131:73459:x1875230407074048:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.373960:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.373981:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4ae3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71126e expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374076:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374088:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374096:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374110:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374115:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374119:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361752.374341:0:66127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x795:0x0], index 0: 0 00010000:00010000:2.0:1788361752.374483:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4af8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374489:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4af8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374493:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4af8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374515:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374520:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374533:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374538:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374542:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aade00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361752.374551:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374557:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374565:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361752.374567:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361752.374570:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374575:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4aea lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.374594:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0510406 reply state 00000000a30023a0 transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374601:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374605:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff99d12172dc00) 00010000:00010000:2.0:1788361752.374607:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.374608:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361752.374628:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4ae3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71126e expref: 134 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374637:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4af8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71126e expref: 133 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.374642:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172d700) 00010000:00010000:2.0:1788361752.374643:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361752.374648:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad200, rc 0) 00000100:00100000:2.0:1788361752.374691:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+134:73459:x1875230407074048:12345-192.168.204.35@tcp:101:touch.0 Request processed in 752us (909us total) trans 124554051646 rc 0/0 00000100:00100000:2.0:1788361752.374698:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1435 00000100:00100000:0.0:1788361752.376794:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.376891:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407074304 00000100:00100000:2.0:1788361752.376901:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407074304 00000100:00100000:2.0:1788361752.376952:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1436 00000100:00100000:2.0:1788361752.376961:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+134:73459:x1875230407074304:12345-192.168.204.35@tcp:36:touch.0 00010000:00010000:2.0:1788361752.377009:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361752.377032:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4af8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71126e expref: 134 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.377057:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172d700) 00010000:00010000:2.0:1788361752.377066:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361752.377106:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.377115:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.377121:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361752.377194:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ab67076 reply state 000000009ab9f440 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.377202:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.377205:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:2.0:1788361752.377217:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361752.377219:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361752.377281:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+135:73459:x1875230407074304:12345-192.168.204.35@tcp:36:touch.0 Request processed in 321us (493us total) trans 124554051647 rc 0/0 00000100:00100000:2.0:1788361752.377289:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1436 00000100:00100000:0.0:1788361752.379417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361752.379456:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407074432 00000100:00100000:2.0:1788361752.379465:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407074432 00000100:00100000:2.0:1788361752.379516:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1437 00000100:00100000:2.0:1788361752.379590:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+135:73459:x1875230407074432:12345-192.168.204.35@tcp:101:touch.0 00010000:00010000:2.0:1788361752.379613:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361752.379633:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe4b0d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711275 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.379683:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe4b0d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711275 expref: 136 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.379709:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aaca00/0x1b69fa8920fe4b0d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711275 expref: 136 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361752.379727:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:2.0:1788361752.379731:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361752.379734:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aaca00, rc 0) 00000100:00100000:2.0:1788361752.379783:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+136:73459:x1875230407074432:12345-192.168.204.35@tcp:101:touch.0 Request processed in 259us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.379789:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1437 00000100:00100000:0.0:1788361752.381412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.381470:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407074560 00000100:00100000:1.0:1788361752.381475:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407074560 00000100:00100000:1.0:1788361752.381510:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4961 00000100:00100000:1.0:1788361752.381519:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+24:2409:x1875230407074560:12345-192.168.204.35@tcp:2:touch.0 00000100:00100000:1.0:1788361752.381755:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2409:x1875230407074560:12345-192.168.204.35@tcp:2:touch.0 Request processed in 237us (345us total) trans 4294968773 rc 0/0 00000100:00100000:1.0:1788361752.381762:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4961 00000100:00100000:0.0:1788361752.383205:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361752.383262:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407074816 00000100:00100000:1.0:1788361752.383329:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407074816 00000100:00100000:1.0:1788361752.383410:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 264 00000100:00100000:1.0:1788361752.383418:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+136:73459:x1875230407074816:12345-192.168.204.35@tcp:35:touch.0 00000100:00100000:1.0:1788361752.383662:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+137:73459:x1875230407074816:12345-192.168.204.35@tcp:35:touch.0 Request processed in 243us (459us total) trans 124554051648 rc 0/0 00000100:00100000:1.0:1788361752.383670:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 264 00000100:00100000:0.0:1788361752.406022:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429912704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788361752.406120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361752.406163:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912704 00000100:00100000:1.0:1788361752.406172:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912704 00000100:00100000:1.0:1788361752.406267:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231 00000100:00100000:1.0:1788361752.406277:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429912704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788361752.406311:0:23938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:1.0:1788361752.406367:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429912704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361752.406374:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231 00000100:00100000:0.0:1788361752.406454:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429912704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788361752.662347:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361752.918101:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429912960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361752.918120:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361752.918142:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429912832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361752.918200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361752.918200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361752.918209:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361752.918227:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429913088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361752.918243:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361752.918255:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429913472:0@lo:400:kworker.0 00000100:00100000:2.0:1788361752.918259:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429913344:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361752.918312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361752.918314:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429913984:0@lo:400:kworker.0 00000100:00100000:2.0:1788361752.918321:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912832 00000100:00100000:2.0:1788361752.918330:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912832 00000100:00100000:0.0:1788361752.918334:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913088 00000100:00100000:0.0:1788361752.918340:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913088 00000100:00100000:3.0:1788361752.918365:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429913600:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361752.918404:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1788361752.918409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361752.918416:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:2.0:1788361752.918420:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429912832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361752.918430:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429913088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361752.918436:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913472 00000100:00100000:1.0:1788361752.918441:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913472 00000100:00100000:3.0:1788361752.918445:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429914112:0@lo:400:kworker.0 00002000:00000024:0.0:1788361752.918449:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00002000:00000024:2.0:1788361752.918455:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788361752.918503:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361752.918508:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875230429912832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.918516:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429913088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.918520:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:0.0:1788361752.918529:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00080000:2.0:1788361752.918548:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361752.918553:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10e5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429912832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788361752.918556:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361752.918557:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913600 00000100:00100000:0.0:1788361752.918562:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913600 00000100:00100000:2.0:1788361752.918574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361752.918590:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429912960 00000100:00100000:3.0:1788361752.918595:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429912960 00000100:00100000:0.0:1788361752.918596:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914112 00000100:00100000:0.0:1788361752.918601:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914112 00000100:00100000:2.0:1788361752.918603:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429913856:0@lo:400:kworker.0 00000100:00100000:0.0:1788361752.918624:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913344 00000100:00100000:0.0:1788361752.918628:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913344 00000100:00100000:3.0:1788361752.918635:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4232 00000100:00100000:2.0:1788361752.918640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361752.918654:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1788361752.918659:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3653:x1875230429912960:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788361752.918660:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1170ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429913088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361752.918667:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788361752.918670:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429913472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361752.918677:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429913216:0@lo:400:kworker.0 00000004:00000024:3.0:1788361752.918692:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:1.0:1788361752.918708:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1788361752.918723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361752.918723:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429913600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361752.918736:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875230429913472:12345-0@lo:400:kworker.0 Request processed in 70us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.918743:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3653:x1875230429912960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.918750:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1788361752.918757:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4232 00000100:00100000:2.0:1788361752.918776:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429913728:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918788:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875230429913600:12345-0@lo:400:kworker.0 Request processed in 71us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.918794:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875230429913600:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918800:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1788361752.918801:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913984 00000100:00100000:3.0:1788361752.918807:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913984 00000100:00100000:2.0:1788361752.918808:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361752.918814:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875230429913472:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918857:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913728 00000100:00100000:2.0:1788361752.918859:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1411d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429914240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918863:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913728 00000100:00100000:3.0:1788361752.918885:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913856 00000100:00100000:3.0:1788361752.918889:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913856 00000100:00100000:0.0:1788361752.918896:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1788361752.918902:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1788361752.918907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361752.918908:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429914112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918919:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429913984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361752.918934:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1788361752.918943:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429912960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361752.918946:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429913856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.918972:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429913984:12345-0@lo:400:kworker.0 Request processed in 57us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.918979:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429913216 00000100:00100000:1.0:1788361752.918980:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1788361752.918985:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429913216 00000100:00100000:0.0:1788361752.919003:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429914112:12345-0@lo:400:kworker.0 Request processed in 99us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.919012:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429913856:12345-0@lo:400:kworker.0 Request processed in 67us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.919014:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1788361752.919024:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429913984:0@lo:400:kworker.0 00000100:00100000:2.0:1788361752.919025:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788361752.919033:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1788361752.919040:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429913216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361752.919071:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361752.919076:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361752.919077:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429914112:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.919087:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914240 00000100:00100000:1.0:1788361752.919092:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914240 00000100:00100000:2.0:1788361752.919095:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429913216:12345-0@lo:400:kworker.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361752.919097:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1788361752.919108:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1788361752.919109:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788361752.919114:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875230429913344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361752.919122:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13fec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429913728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.919127:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1788361752.919139:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429914240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361752.919159:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429913216:0@lo:400:kworker.0 00000100:00100000:3.0:1788361752.919170:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875230429913344:12345-0@lo:400:kworker.0 Request processed in 61us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.919174:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13fec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429913728:12345-0@lo:400:kworker.0 Request processed in 55us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.919180:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429913728:0@lo:400:kworker.0 00000100:00100000:3.0:1788361752.919186:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1788361752.919191:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429914240:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361752.919197:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1788361752.919200:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429914240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361752.919204:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1788361752.919220:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429913856:0@lo:400:kworker.0 00000100:00100000:2.0:1788361752.919234:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1411d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875230429913344:0@lo:400:kworker.0 00010000:00010000:1.0:1788361753.686003:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361753.723508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361753.723595:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407074944 00000100:00100000:3.0:1788361753.723606:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407074944 00000100:00100000:3.0:1788361753.723742:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1438 00000100:00100000:3.0:1788361753.723755:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+137:73486:x1875230407074944:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:3.0:1788361753.723865:0:66126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:3.0:1788361753.723944:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+137:73486:x1875230407074944:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 193us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361753.723953:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1438 00000100:00080000:2.0:1788361753.724013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361753.725718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361753.725778:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407075072 00000100:00100000:2.0:1788361753.725785:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407075072 00000100:00080000:3.0:1788361753.725838:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788361753.725890:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1439 00000100:00100000:2.0:1788361753.725899:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73486:x1875230407075072:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788361753.725923:0:67579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361753.725966:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73486:x1875230407075072:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361753.725974:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1439 00000100:00100000:0.0:1788361753.727786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361753.727871:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407075200 00000100:00100000:1.0:1788361753.727881:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407075200 00000100:00080000:3.0:1788361753.727936:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361753.727953:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1586 00000100:00100000:1.0:1788361753.727965:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14182e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:73486:x1875230407075200:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788361753.728016:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788361753.728074:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14182e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:73486:x1875230407075200:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361753.728082:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1586 00000100:00100000:0.0:1788361753.730688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361753.730743:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407075328 00000100:00100000:2.0:1788361753.730752:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407075328 00000100:00080000:3.0:1788361753.730806:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361753.730806:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1587 00000100:00100000:2.0:1788361753.730851:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:73486:x1875230407075328:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788361753.730892:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361753.730946:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:73486:x1875230407075328:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361753.730965:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1587 00000001:00080000:2.0:1788361754.120686:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968773 is committed 00000001:00080000:2.0:1788361754.120710:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968769 is committed 00000001:00080000:0.0:1788361754.120998:0:94202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:1.0:1788361754.121172:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121187:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121196:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121203:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121209:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121218:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121236:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99d105584900) 00010000:00010000:1.0:1788361754.121240:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121245:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121252:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20800/0x1b69fa8920fe46bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121276:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121295:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121301:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121306:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121310:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121315:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121324:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361754.121326:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121329:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121334:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20e00/0x1b69fa8920fe46c2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121350:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121357:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121362:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121367:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121376:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121382:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121391:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361754.121394:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361754.121396:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121402:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe471d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121415:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121421:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121427:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121433:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eba00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121437:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121443:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121452:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff99d105584100) 00010000:00010000:1.0:1788361754.121454:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121462:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121469:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eba00/0x1b69fa8920fe474e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121484:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121490:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121495:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121500:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121503:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121510:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121519:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:1.0:1788361754.121521:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121524:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121530:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea200/0x1b69fa8920fe4763 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121541:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121558:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121564:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121571:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715da00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121574:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121582:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121591:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff99d112cab000) 00010000:00010000:1.0:1788361754.121594:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121598:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121604:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe477f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121621:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121628:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121635:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121640:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121649:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121656:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121665:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:1.0:1788361754.121668:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121671:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121679:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4794 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121691:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121698:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121705:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121710:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121714:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121721:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121728:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff99d105584200) 00010000:00010000:1.0:1788361754.121731:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121739:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121745:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb600/0x1b69fa8920fe47b0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121760:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121766:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121772:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121777:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121780:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121786:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121793:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:1.0:1788361754.121795:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121799:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121805:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe47c5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121816:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121858:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121864:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121869:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715c400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121872:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121878:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121886:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff99d112cab500) 00010000:00010000:1.0:1788361754.121888:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121891:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121897:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe47e1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121911:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121918:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121924:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121929:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121938:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121945:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121953:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:1.0:1788361754.121955:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.121957:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121962:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe47f6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121973:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121980:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121985:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121989:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eaa00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.121992:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.121997:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122005:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff99d105584e00) 00010000:00010000:1.0:1788361754.122007:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122016:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122022:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe4812 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122037:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122044:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122050:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122054:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122057:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122063:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122072:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:1.0:1788361754.122074:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122077:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122083:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4827 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122094:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122108:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122114:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122120:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bea00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122124:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122132:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122142:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff99d112cabd00) 00010000:00010000:1.0:1788361754.122145:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122148:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122155:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4843 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122173:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122180:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122186:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122191:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122200:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122207:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122215:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:1.0:1788361754.122218:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122221:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122227:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4858 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122239:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122246:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122252:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122257:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122260:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122266:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122274:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff99d105584f00) 00010000:00010000:1.0:1788361754.122277:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122286:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122293:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea400/0x1b69fa8920fe4874 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122310:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122316:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122322:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122327:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c20c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122330:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122336:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122343:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:1.0:1788361754.122345:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122348:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122353:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c20c00/0x1b69fa8920fe4889 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122363:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122376:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122382:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122387:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122389:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122395:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122403:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff99d112cabe00) 00010000:00010000:1.0:1788361754.122405:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122408:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122413:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe48a5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122426:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122432:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122437:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122441:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d137c21200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122447:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122452:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122458:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:1.0:1788361754.122460:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122463:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122468:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d137c21200/0x1b69fa8920fe48ba lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122477:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122482:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122487:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122491:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122494:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122498:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122505:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff99d105584a00) 00010000:00010000:1.0:1788361754.122507:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122514:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122519:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe48d6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122534:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122540:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122546:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122550:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122553:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122559:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122566:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:1.0:1788361754.122569:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122571:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122577:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe48eb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122586:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122601:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122608:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122613:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122616:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122622:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122629:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff99d112cab800) 00010000:00010000:1.0:1788361754.122631:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122634:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122640:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4907 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122654:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122659:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122665:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122669:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122678:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122685:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122693:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:1.0:1788361754.122695:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122698:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122704:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb800/0x1b69fa8920fe491c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122715:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122720:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122726:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122731:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122733:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122739:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122746:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff99d009c1d800) 00010000:00010000:1.0:1788361754.122747:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122756:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122762:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4938 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122778:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122784:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122789:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122794:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.122797:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122802:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.122810:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:1.0:1788361754.122812:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.122815:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124236:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c400/0x1b69fa8920fe494d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124253:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124270:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124277:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124282:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124286:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124293:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124302:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff99d136764700) 00010000:00010000:1.0:1788361754.124306:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124308:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124327:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4969 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124342:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124348:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124353:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124358:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124367:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124384:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124394:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:1.0:1788361754.124397:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124400:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124406:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe497e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124420:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124427:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124432:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124438:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124441:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124448:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124455:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff99d112cab300) 00010000:00010000:1.0:1788361754.124458:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124468:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124474:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe499a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124491:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124497:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124503:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124509:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124512:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124518:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124528:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:1.0:1788361754.124530:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124533:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124539:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe49af lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124550:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124566:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124572:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124577:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124581:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124587:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124595:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff99d009c1df00) 00010000:00010000:1.0:1788361754.124598:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124601:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124607:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe49cb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124624:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124630:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124636:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124641:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124650:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124656:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124665:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:1.0:1788361754.124667:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124670:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124676:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030e00/0x1b69fa8920fe49e0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124689:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124695:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124701:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124706:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bec00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124709:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124715:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124722:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff99d112cabb00) 00010000:00010000:1.0:1788361754.124725:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124734:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124740:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe49fc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124783:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124790:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124796:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124802:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124805:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124811:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124838:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:1.0:1788361754.124841:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124855:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124862:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4a11 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124875:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124890:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124896:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124901:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124904:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124911:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124920:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff99d009c1dd00) 00010000:00010000:1.0:1788361754.124922:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124925:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124930:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031e00/0x1b69fa8920fe4a2d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124946:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124952:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124958:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124964:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.124973:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124980:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.124989:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:1.0:1788361754.124991:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.124994:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125000:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4a42 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125013:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125019:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125025:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125031:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfe00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125034:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125040:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125047:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff99d112cab700) 00010000:00010000:1.0:1788361754.125050:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125059:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125065:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4a5e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125081:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125088:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125094:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125099:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125102:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125108:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125116:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:1.0:1788361754.125118:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125121:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125127:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4a73 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125139:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125166:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125172:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125177:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bee00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125180:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125187:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125195:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff99d009c1d000) 00010000:00010000:1.0:1788361754.125198:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125201:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125207:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bee00/0x1b69fa8920fe4a8f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125223:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125230:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125236:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125241:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125250:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125257:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125265:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:1.0:1788361754.125268:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125271:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125276:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4aa4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125289:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125294:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125299:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125303:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125305:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125310:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125317:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff99d112cabc00) 00010000:00010000:1.0:1788361754.125319:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125328:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125333:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4ac0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125347:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125488:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125496:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125501:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125504:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125509:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125517:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:1.0:1788361754.125519:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125522:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125527:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4ad5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125540:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125555:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125562:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125567:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125570:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125576:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125583:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff99d12172dc00) 00010000:00010000:1.0:1788361754.125585:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125587:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125592:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4af1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125605:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125609:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125615:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125619:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361754.125626:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125632:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125639:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:1.0:1788361754.125641:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361754.125644:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361754.125649:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4b06 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361754.188991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361754.189501:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407075584 00000100:00100000:2.0:1788361754.189517:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407075584 00000100:00100000:2.0:1788361754.189598:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1440 00000100:00100000:2.0:1788361754.189611:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+31:73527:x1875230407075584:12345-192.168.204.35@tcp:36:mcreate.0 00010000:00010000:2.0:1788361754.189690:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361754.189725:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe46fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71114f expref: 31 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.189746:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361754.189752:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361754.190071:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190090:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190102:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190121:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190128:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190135:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190602:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190614:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190621:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190628:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190635:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361754.190639:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190648:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190658:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361754.190660:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361754.190664:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190670:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361754.190697:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069e052ed reply state 000000001d12b8db transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190709:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.190722:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d00720b200) 00010000:00010000:2.0:1788361754.190725:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361754.190728:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361754.190865:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:73527:x1875230407075584:12345-192.168.204.35@tcp:36:mcreate.0 Request processed in 1255us (1891us total) trans 124554051649 rc 0/0 00000100:00100000:2.0:1788361754.190874:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1440 00000100:00100000:0.0:1788361754.204013:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361754.204066:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407075712 00000100:00100000:0.0:1788361754.204081:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407075712 00000100:00100000:0.0:1788361754.204169:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1441 00000100:00100000:0.0:1788361754.204181:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:73530:x1875230407075712:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:0.0:1788361754.204216:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361754.204247:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71127c expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.204337:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4b29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.204355:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.204371:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361754.204451:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788361754.204456:0:66127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788361754.204491:0:66127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.204522:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71127c expref: 34 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.204542:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4b29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71127c expref: 33 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.204553:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:0.0:1788361754.204556:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361754.204566:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917e00, rc 0) 00000100:00100000:0.0:1788361754.204660:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:73530:x1875230407075712:12345-192.168.204.35@tcp:101:rm.0 Request processed in 481us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361754.204668:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1441 00000100:00100000:3.0:1788361754.206413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361754.208070:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407075840 00000100:00100000:2.0:1788361754.208088:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407075840 00000100:00100000:2.0:1788361754.208178:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1442 00000100:00100000:2.0:1788361754.208194:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:73530:x1875230407075840:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788361754.208223:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361754.208253:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711283 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208341:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208359:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208374:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208389:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208397:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208417:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208520:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208527:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208534:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361754.208587:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1788361754.208593:0:67579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361754.208616:0:67579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208740:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208751:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208758:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208810:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208817:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208887:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aade00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361754.208893:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208907:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208924:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361754.208928:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361754.208934:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208941:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aade00/0x1b69fa8920fe4b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208970:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208977:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208983:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208989:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361754.208992:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.208998:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.209018:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d00720b200) 00010000:00010000:2.0:1788361754.209020:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361754.209023:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.209029:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4b3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.209064:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711283 expref: 35 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.209079:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711283 expref: 34 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.209087:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99d00720bb00) 00010000:00010000:2.0:1788361754.209090:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361754.209093:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac000, rc 0) 00000100:00100000:2.0:1788361754.209183:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73530:x1875230407075840:12345-192.168.204.35@tcp:101:rm.0 Request processed in 994us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361754.209192:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1442 00000100:00100000:0.0:1788361754.213553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361754.213626:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076096 00000100:00100000:2.0:1788361754.213644:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076096 00000100:00100000:2.0:1788361754.213732:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1443 00000100:00100000:2.0:1788361754.213745:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73530:x1875230407076096:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:2.0:1788361754.214447:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788361754.214490:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4b45 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711283 expref: 34 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214528:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99d00720bb00) 00010000:00010000:2.0:1788361754.214551:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4b29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71127c expref: 33 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214705:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361754.214709:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361754.214743:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214760:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214771:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214785:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214794:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.214801:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.215682:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.215697:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.215707:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216564:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216583:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216593:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216601:0:80345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216608:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216615:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216641:0:80345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361754.216672:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361754.216676:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.216679:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216682:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216688:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.216689:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916400 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:0.0:1788361754.216693:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361754.216698:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.216699:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.216708:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216708:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.216722:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99d119de6900) 00010000:00010000:2.0:1788361754.216725:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361754.216729:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216731:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99d119de6900) 00010000:00010000:0.0:1788361754.216733:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361754.216736:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b61 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216737:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216743:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b5a lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361754.216750:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361754.216752:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361754.216754:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361754.216764:0:80345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216771:0:80345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216777:0:80345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216783:0:80345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aada00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361754.216786:0:80345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216790:0:80345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216796:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:0.0:1788361754.216798:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361754.216799:0:80345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216803:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4b4c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361754.216866:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045edb20b reply state 0000000083a6ede2 transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216882:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361754.216889:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d00720b200) 00010000:00010000:0.0:1788361754.216892:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361754.216895:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361754.217058:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73530:x1875230407076096:12345-192.168.204.35@tcp:36:rm.0 Request processed in 3314us (3514us total) trans 124554051650 rc 0/0 00000100:00100000:0.0:1788361754.217068:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1443 00010000:00010000:0.0:1788361754.717308:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361755.734051:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361756.502963:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361756.502989:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d0038dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429914368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361756.503069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361756.503269:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914368 00000100:00100000:2.0:1788361756.503277:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914368 00000100:00100000:2.0:1788361756.503333:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:2.0:1788361756.503341:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429914368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788361756.503369:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00010000:00000080:2.0:1788361756.503383:0:10106:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038ddf80 x1875230429914368/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:62/0 lens 224/368 e 0 to 0 dl 1788361767 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361756.503422:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429914368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361756.503429:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00080000:2.0:1788361756.503462:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361756.503497:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d0038dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429914368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788361756.504338:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361756.504352:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429914496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788361756.504380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361756.504418:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914496 00000100:00100000:1.0:1788361756.504425:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914496 00000100:00100000:1.0:1788361756.504470:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1788361756.504482:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429914496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361756.504502:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1788361756.504580:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361756.504969:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429914496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 489us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361756.504974:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d007350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429914496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361756.504981:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00010000:00010000:1.0:1788361756.757936:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361756.992306:0:95735:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:3.0:1788361757.063411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.063455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.063512:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.063514:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076352 00000100:00100000:0.0:1788361757.063525:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076352 00000100:00100000:1.0:1788361757.063564:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076480 00000100:00100000:1.0:1788361757.063579:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076480 00000100:00100000:0.0:1788361757.063604:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 968 00000100:00100000:0.0:1788361757.063617:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2409:x1875230407076352:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361757.063644:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.063681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.063698:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2409:x1875230407076352:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.063731:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 968 00000100:00100000:0.0:1788361757.063752:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 969 00000100:00100000:0.0:1788361757.063760:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2410:x1875230407076480:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:1.0:1788361757.063784:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361757.063800:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361757.063811:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076224 00000100:00100000:3.0:1788361757.063817:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076224 00000100:00100000:0.0:1788361757.063817:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2410:x1875230407076480:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 57us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.063857:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 969 00000100:00100000:3.0:1788361757.063963:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 170 00000100:00100000:3.0:1788361757.063972:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407076224:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361757.064064:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407076224:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 93us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.064073:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 170 00000100:00100000:3.0:1788361757.064112:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076736 00000100:00100000:3.0:1788361757.064116:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076736 00000100:00100000:3.0:1788361757.064153:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076608 00000100:00100000:3.0:1788361757.064161:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076608 00000100:00100000:3.0:1788361757.064191:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1946 00000100:00100000:3.0:1788361757.064199:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407076736:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788361757.064233:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2410:x1875230407076736:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 35us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.064242:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1946 00000100:00100000:3.0:1788361757.064258:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1947 00000100:00100000:3.0:1788361757.064266:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10e5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407076608:12345-192.168.204.35@tcp:400:kworker.0 00010000:00000080:3.0:1788361757.064279:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d10e5e6300 x1875230407076608/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 224/224 e 0 to 0 dl 1788361768 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361757.064312:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10e5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2409:x1875230407076608:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 49us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.064319:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1947 00000100:00080000:3.0:1788361757.064445:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361757.064448:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361757.093308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.093372:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076864 00000100:00100000:2.0:1788361757.093382:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076864 00000100:00100000:2.0:1788361757.093460:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1444 00000100:00100000:2.0:1788361757.093468:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73607:x1875230407076864:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.093489:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.093512:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4b68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71128a expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.093574:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4b6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.093594:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.093610:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361757.093655:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788361757.093660:0:66128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788361757.093705:0:66128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.093737:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4b68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71128a expref: 36 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.093769:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac600/0x1b69fa8920fe4b6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71128a expref: 35 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.093780:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:2.0:1788361757.093783:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361757.093797:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac600, rc 0) 00000100:00100000:2.0:1788361757.093896:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:73607:x1875230407076864:12345-192.168.204.35@tcp:101:dd.0 Request processed in 428us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.093903:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1444 00000100:00100000:3.0:1788361757.095246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.095353:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407076992 00000100:00100000:1.0:1788361757.095360:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407076992 00000100:00100000:1.0:1788361757.095407:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1445 00000100:00100000:1.0:1788361757.095418:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:73608:x1875230407076992:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.095440:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.095455:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe4b76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711291 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.095513:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4b7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.095527:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4b7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.095537:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4b7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361757.095575:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788361757.095578:0:66126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788361757.095593:0:66126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4b7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.095610:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5a00/0x1b69fa8920fe4b76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711291 expref: 37 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.095624:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4b7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711291 expref: 36 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.095632:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:1.0:1788361757.095635:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361757.095639:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4000, rc 0) 00000100:00100000:1.0:1788361757.095684:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:73608:x1875230407076992:12345-192.168.204.35@tcp:101:dd.0 Request processed in 268us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.095692:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1445 00000100:00100000:1.0:1788361757.098748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.098816:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407077248 00000100:00100000:0.0:1788361757.098861:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407077248 00000100:00100000:0.0:1788361757.098928:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1446 00000100:00100000:0.0:1788361757.098939:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d139d3e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:73607:x1875230407077248:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.098960:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.098984:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4b84 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711298 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099136:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099152:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099167:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099185:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099193:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099201:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099280:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b99 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099289:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b99 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099313:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b99 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361757.099329:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00000100:00100000:3.0:1788361757.099363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:0.0:1788361757.099451:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099461:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099467:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099473:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099479:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.099484:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099493:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099506:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361757.099509:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.099515:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099522:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4b8b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.099525:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407077376 00010000:00010000:0.0:1788361757.099537:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.099548:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407077376 00010000:00010000:0.0:1788361757.099560:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099566:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099569:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.099572:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099580:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099590:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff99d10af47400) 00010000:00010000:0.0:1788361757.099593:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.099597:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099602:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4b92 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.099628:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 697 00000100:00100000:1.0:1788361757.099643:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2409:x1875230407077376:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361757.099660:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361757.099670:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4b84 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711298 expref: 40 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.099689:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4000/0x1b69fa8920fe4b7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711291 expref: 39 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099695:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b99 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711298 expref: 39 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.099729:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:0.0:1788361757.099732:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361757.099736:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d009c1dc00) 00010000:00010000:1.0:1788361757.099744:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361757.099746:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916400, rc 0) 00000100:00100000:1.0:1788361757.099938:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2409:x1875230407077376:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 296us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.099950:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 697 00000100:00100000:0.0:1788361757.099959:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d139d3e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:73607:x1875230407077248:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1014us (1213us total) trans 124554051651 rc 0/0 00000100:00100000:0.0:1788361757.099978:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1446 00000100:00100000:1.0:1788361757.104209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.104269:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407077504 00000100:00100000:0.0:1788361757.104290:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407077504 00000100:00100000:0.0:1788361757.104361:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1447 00000100:00100000:0.0:1788361757.104375:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+37:73607:x1875230407077504:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:1.0:1788361757.104384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:0.0:1788361757.104416:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.104439:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4ba7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71129f expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.104466:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407077760 00000100:00100000:2.0:1788361757.104473:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407077760 00010000:00010000:0.0:1788361757.104501:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe4bae lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.104524:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe4bae lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.104544:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1448 00010000:00010000:0.0:1788361757.104544:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe4bae lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.104555:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:73609:x1875230407077760:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.104564:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.104577:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4bb5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112a6 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.104680:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4ba7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71129f expref: 41 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.104711:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.104711:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916800/0x1b69fa8920fe4bae lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71129f expref: 40 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.104731:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.104734:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:0.0:1788361757.104741:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.104746:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.104756:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916800, rc 0) 00010000:00010000:2.0:1788361757.104764:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.104779:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.104786:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.104854:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:73607:x1875230407077504:12345-192.168.204.35@tcp:101:dd.0 Request processed in 482us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.104861:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1447 00010000:00010000:2.0:1788361757.104880:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4bca lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.104890:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4bca lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.104897:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4bca lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361757.104907:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:2.0:1788361757.104992:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105000:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105006:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105013:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105020:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.105024:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105045:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105160:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361757.105164:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.105169:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105176:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4bbc lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105186:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105206:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105212:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105216:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aada00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.105219:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105225:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105232:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff99d00720b700) 00010000:00010000:2.0:1788361757.105235:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.105238:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105254:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4bc3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105307:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4bb5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112a6 expref: 41 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105319:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4bca lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112a6 expref: 40 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.105326:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:2.0:1788361757.105328:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361757.105330:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac000, rc 0) 00000100:00100000:2.0:1788361757.105368:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:73609:x1875230407077760:12345-192.168.204.35@tcp:101:dd.0 Request processed in 815us (989us total) trans 124554051652 rc 0/0 00000100:00100000:2.0:1788361757.105375:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1448 00000100:00100000:1.0:1788361757.107030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.107077:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078016 00000100:00100000:3.0:1788361757.107085:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078016 00000100:00100000:3.0:1788361757.107126:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1449 00000100:00100000:3.0:1788361757.107135:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:73607:x1875230407078016:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.107175:0:66901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.107195:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916400/0x1b69fa8920fe4b99 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711298 expref: 40 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.107209:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:3.0:1788361757.107213:0:66901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.107371:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.107383:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.107390:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361757.107440:0:66901:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051653 00000004:00010000:3.0:1788361757.107458:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d294385 reply state 0000000059eac9f7 transno 124554051654 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.107470:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.107475:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:3.0:1788361757.107478:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.107480:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.107561:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:73607:x1875230407078016:12345-192.168.204.35@tcp:36:dd.0 Request processed in 426us (535us total) trans 124554051654 rc 0/0 00000100:00100000:3.0:1788361757.107568:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1449 00000020:00080000:3.0:1788361757.107571:0:66901:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.108061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.108101:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078144 00000100:00100000:3.0:1788361757.108106:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078144 00000100:00100000:3.0:1788361757.108145:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1450 00000100:00100000:3.0:1788361757.108152:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:73609:x1875230407078144:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.108165:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.108176:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe4bdf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112ad expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.108198:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe4be6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.108207:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe4be6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.108214:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe4be6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.108286:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309600/0x1b69fa8920fe4bdf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112ad expref: 44 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.108644:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309000/0x1b69fa8920fe4be6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112ad expref: 43 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.108656:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:3.0:1788361757.108658:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361757.108668:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309000, rc 0) 00000100:00100000:1.0:1788361757.108691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.108705:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:73609:x1875230407078144:12345-192.168.204.35@tcp:101:dd.0 Request processed in 553us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.108712:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1450 00000100:00100000:3.0:1788361757.108726:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078400 00000100:00100000:3.0:1788361757.108730:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078400 00000100:00100000:3.0:1788361757.108754:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1451 00000100:00100000:3.0:1788361757.108760:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:73608:x1875230407078400:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.108769:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.108778:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4bed lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112b4 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109085:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109094:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109101:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109112:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109117:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.109126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:3.0:1788361757.109127:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109167:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4c02 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.109177:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078528 00000100:00100000:1.0:1788361757.109181:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078528 00010000:00010000:3.0:1788361757.109182:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4c02 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109189:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4c02 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361757.109199:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00000100:00100000:1.0:1788361757.109211:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4962 00000100:00100000:1.0:1788361757.109219:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:73607:x1875230407078528:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.109228:0:26170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.109240:0:26170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4c10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112bb expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109254:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.109258:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x782:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.109261:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109267:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109272:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109278:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361757.109278:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.109282:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.109282:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.109289:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109298:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361757.109301:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.109305:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109311:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4bf4 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109329:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109335:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.109340:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4c10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112bb expref: 6 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109341:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109348:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.109350:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109356:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.109357:0:26170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4c10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112bb expref: 6 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109364:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff99d13a135100) 00010000:00010000:3.0:1788361757.109366:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361757.109368:0:26170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5a00, rc 0) 00010000:00010000:3.0:1788361757.109369:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1788361757.109374:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d5880 x1875230407078528/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788361757.109375:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4bfb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109405:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4bed lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112b4 expref: 46 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.109415:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:73607:x1875230407078528:12345-192.168.204.35@tcp:101:dd.0 Request processed in 198us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.109422:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4962 00010000:00010000:3.0:1788361757.109428:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4c02 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112b4 expref: 45 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.109446:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:3.0:1788361757.109448:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361757.109451:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309c00, rc 0) 00000100:00100000:3.0:1788361757.109472:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:73608:x1875230407078400:12345-192.168.204.35@tcp:101:dd.0 Request processed in 712us (781us total) trans 124554051655 rc 0/0 00000100:00100000:3.0:1788361757.109478:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1451 00000100:00100000:0.0:1788361757.111319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.111358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.111409:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078912 00000100:00100000:2.0:1788361757.111418:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078912 00000100:00100000:1.0:1788361757.111440:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078656 00000100:00100000:1.0:1788361757.111446:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078656 00002000:00010000:1.0:1788361757.111469:0:24839:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.111474:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1411d5500 with x1875230407078656 ext(0->18446744073709551615) 00000100:00100000:2.0:1788361757.111475:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1452 00002000:00010000:1.0:1788361757.111486:0:24839:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d1411d5500. 00000100:00100000:2.0:1788361757.111488:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:73609:x1875230407078912:12345-192.168.204.35@tcp:36:dd.0 00000100:00100000:1.0:1788361757.111544:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 601 00000100:00100000:1.0:1788361757.111552:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2411:x1875230407078656:12345-192.168.204.35@tcp:10:dd.0 00010000:00010000:2.0:1788361757.111590:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361757.111623:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4bca lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112a6 expref: 45 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.111640:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:2.0:1788361757.111645:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1788361757.111690:0:24839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.111693:0:24839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.111696:0:24839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.111698:0:24839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.111711:0:24839:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.111720:0:24839:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d5500 x1875230407078656/t4294968774(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361757.111767:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.111778:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407078656:12345-192.168.204.35@tcp:10:dd.0 Request processed in 226us (462us total) trans 4294968774 rc 0/0 00000100:00100000:1.0:1788361757.111800:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 601 00010000:00010000:2.0:1788361757.111805:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.111805:0:24839:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.111809:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1411d5500 with x1875230407078656 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.111817:0:24839:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d1411d5500. 00010000:00010000:2.0:1788361757.111844:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361757.111882:0:66127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051656 00000004:00010000:2.0:1788361757.111901:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ff3eddc reply state 000000003e58e40b transno 124554051657 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.111910:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.111915:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:2.0:1788361757.111918:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361757.111920:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361757.111964:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+47:73609:x1875230407078912:12345-192.168.204.35@tcp:36:dd.0 Request processed in 481us (606us total) trans 124554051657 rc 0/0 00000100:00100000:2.0:1788361757.111969:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1452 00000020:00080000:2.0:1788361757.111972:0:66127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.112632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.112690:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407079040 00000100:00100000:1.0:1788361757.112697:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407079040 00000100:00100000:1.0:1788361757.112731:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1453 00000100:00100000:1.0:1788361757.112739:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+47:73608:x1875230407079040:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.112752:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.112771:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe4c1e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112c2 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.112807:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe4c25 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.112818:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe4c25 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.112856:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe4c25 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.112937:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe4c1e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112c2 expref: 49 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.112967:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5c00/0x1b69fa8920fe4c25 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112c2 expref: 48 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.112975:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:1.0:1788361757.112978:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361757.112980:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5c00, rc 0) 00000100:00100000:1.0:1788361757.113010:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+48:73608:x1875230407079040:12345-192.168.204.35@tcp:101:dd.0 Request processed in 273us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.113016:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1453 00000100:00100000:0.0:1788361757.113264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.113379:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407079296 00000100:00100000:2.0:1788361757.113385:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407079296 00000100:00100000:2.0:1788361757.113464:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1454 00000100:00100000:2.0:1788361757.113473:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+48:73613:x1875230407079296:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.113483:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.113495:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4c2c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112c9 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113574:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113587:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113593:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113602:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113606:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113611:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113663:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4c41 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113671:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4c41 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113678:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4c41 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361757.113692:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:2.0:1788361757.113753:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113775:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113782:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113805:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113811:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.113815:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113853:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113864:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361757.113868:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.113871:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113878:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4c33 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113889:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113895:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113901:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113906:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.113910:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113927:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113936:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff99d00720b700) 00010000:00010000:2.0:1788361757.113939:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.113941:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113947:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4c3a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.113994:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4c2c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112c9 expref: 51 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.114009:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4c41 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112c9 expref: 50 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.114016:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:2.0:1788361757.114018:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361757.114020:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad600, rc 0) 00000100:00100000:2.0:1788361757.114073:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:73613:x1875230407079296:12345-192.168.204.35@tcp:101:dd.0 Request processed in 601us (809us total) trans 124554051658 rc 0/0 00000100:00100000:2.0:1788361757.114080:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1454 00000100:00100000:0.0:1788361757.114285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.114331:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407079424 00000100:00100000:2.0:1788361757.114336:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407079424 00000100:00100000:2.0:1788361757.114377:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4963 00000100:00100000:2.0:1788361757.114384:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:73609:x1875230407079424:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.114401:0:26161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.114420:0:26161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc404cb2/0x1b69fa8920fe4c4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112d0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361757.114440:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x784:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:2.0:1788361757.114453:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:2.0:1788361757.114457:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361757.114462:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc404cb2/0x1b69fa8920fe4c4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112d0 expref: 8 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.114473:0:26161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc404cb2/0x1b69fa8920fe4c4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112d0 expref: 8 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.114480:0:26161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aade00, rc 0) 00010000:00000080:2.0:1788361757.114485:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d4380 x1875230407079424/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.114515:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:73609:x1875230407079424:12345-192.168.204.35@tcp:101:dd.0 Request processed in 132us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.114519:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4963 00000100:00100000:0.0:1788361757.115137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.115212:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407079680 00000100:00100000:3.0:1788361757.115217:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407079680 00000100:00100000:3.0:1788361757.115259:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1455 00000100:00100000:3.0:1788361757.115267:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:73608:x1875230407079680:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.115313:0:66901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.115331:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4c02 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112b4 expref: 50 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.115345:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:3.0:1788361757.115353:0:66901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.115466:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.115483:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.115491:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361757.115528:0:66901:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051659 00000004:00010000:3.0:1788361757.115548:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e24b931 reply state 0000000054104e56 transno 124554051660 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.115568:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.115575:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:3.0:1788361757.115578:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.115580:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.115641:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:73608:x1875230407079680:12345-192.168.204.35@tcp:36:dd.0 Request processed in 375us (504us total) trans 124554051660 rc 0/0 00000100:00100000:3.0:1788361757.115649:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1455 00000020:00080000:3.0:1788361757.115653:0:66901:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361757.117059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.117095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.117101:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407080064 00000100:00100000:2.0:1788361757.117109:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407080064 00000100:00100000:2.0:1788361757.117153:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 265 00000100:00100000:2.0:1788361757.117162:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:73607:x1875230407080064:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:1.0:1788361757.117332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.117378:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+53:73607:x1875230407080064:12345-192.168.204.35@tcp:35:dd.0 Request processed in 215us (321us total) trans 124554051661 rc 0/0 00000100:00100000:2.0:1788361757.117401:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 265 00000100:00100000:3.0:1788361757.117461:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407080192 00000100:00100000:3.0:1788361757.117467:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407080192 00000100:00100000:0.0:1788361757.117477:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407080448 00000100:00100000:0.0:1788361757.117482:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407080448 00000100:00100000:1.0:1788361757.117524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.117566:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407079936 00000100:00100000:1.0:1788361757.117569:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407079936 00002000:00010000:1.0:1788361757.117589:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.117595:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007353800 with x1875230407079936 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.117604:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007353800. 00000100:00100000:1.0:1788361757.117627:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 602 00000100:00100000:1.0:1788361757.117633:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2412:x1875230407079936:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:1.0:1788361757.117736:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.117739:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.117742:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.117745:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.117747:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.117754:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007353800 x1875230407079936/t4294968775(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.117818:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2412:x1875230407079936:12345-192.168.204.35@tcp:10:dd.0 Request processed in 185us (297us total) trans 4294968775 rc 0/0 00000100:00100000:1.0:1788361757.117853:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 602 00002000:00010000:1.0:1788361757.117857:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.117859:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007353800 with x1875230407079936 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.117864:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007353800. 00000100:00100000:3.0:1788361757.118014:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1456 00000100:00100000:2.0:1788361757.118026:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1457 00000100:00100000:3.0:1788361757.118036:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+54:73613:x1875230407080192:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:2.0:1788361757.118040:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+54:73610:x1875230407080448:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.118053:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.118056:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.118069:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4c5d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112de expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118107:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4c64 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112d7 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118132:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4c6b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118145:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4c6b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118155:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4c6b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118179:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118191:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118200:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118213:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118220:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118227:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118242:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4c64 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112d7 expref: 57 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118261:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309800/0x1b69fa8920fe4c6b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112d7 expref: 56 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118270:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:3.0:1788361757.118273:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.118274:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4c80 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.118277:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309800, rc 0) 00010000:00010000:2.0:1788361757.118287:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4c80 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118308:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4c80 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.118312:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+56:73613:x1875230407080192:12345-192.168.204.35@tcp:101:dd.0 Request processed in 289us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.118324:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1456 00000004:00200000:2.0:1788361757.118324:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1788361757.118392:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118401:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118406:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118412:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118417:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.118421:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118430:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118439:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361757.118442:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.118446:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118453:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4c72 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118474:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118486:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118492:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118498:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.118501:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118507:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118515:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff99d00720b800) 00010000:00010000:2.0:1788361757.118518:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.118521:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118527:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4c79 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118558:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4c5d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112de expref: 57 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118573:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4c80 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112de expref: 56 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.118579:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:2.0:1788361757.118582:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361757.118590:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf800, rc 0) 00000100:00100000:2.0:1788361757.118627:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+56:73610:x1875230407080448:12345-192.168.204.35@tcp:101:dd.0 Request processed in 592us (1296us total) trans 124554051662 rc 0/0 00000100:00100000:2.0:1788361757.118634:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1457 00000100:00100000:3.0:1788361757.119929:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.120010:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407080576 00000100:00100000:2.0:1788361757.120023:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407080576 00000100:00100000:2.0:1788361757.120069:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4964 00000100:00100000:2.0:1788361757.120079:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:73608:x1875230407080576:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.121092:0:26162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.121111:0:26162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4c8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112e5 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361757.121136:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x783:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:2.0:1788361757.121157:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:2.0:1788361757.121162:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361757.121172:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4c8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112e5 expref: 10 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.121189:0:26162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4c8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112e5 expref: 10 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.121215:0:26162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bee00, rc 0) 00000100:00100000:0.0:1788361757.121222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00000080:2.0:1788361757.121226:0:26162:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed4380 x1875230407080576/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.121262:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407080832 00000100:00100000:3.0:1788361757.121268:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407080832 00000100:00100000:2.0:1788361757.121294:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:73608:x1875230407080576:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1216us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.121318:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4964 00000100:00100000:3.0:1788361757.121357:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1458 00000100:00100000:3.0:1788361757.121366:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+56:73613:x1875230407080832:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.121408:0:66901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.121462:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4c41 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112c9 expref: 56 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.121479:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:3.0:1788361757.121483:0:66901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.121630:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.121657:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.121666:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361757.121723:0:66901:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051663 00000004:00010000:3.0:1788361757.121742:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000313acc4b reply state 0000000049f32fc4 transno 124554051664 ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.121752:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.121768:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:3.0:1788361757.121771:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.121774:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.121870:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+58:73613:x1875230407080832:12345-192.168.204.35@tcp:36:dd.0 Request processed in 504us (649us total) trans 124554051664 rc 0/0 00000100:00100000:3.0:1788361757.121876:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1458 00000020:00080000:3.0:1788361757.121880:0:66901:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.122306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.122350:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081088 00000100:00100000:1.0:1788361757.122355:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081088 00000100:00100000:1.0:1788361757.122381:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 266 00000100:00100000:1.0:1788361757.122396:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+58:73609:x1875230407081088:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:1.0:1788361757.122530:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+59:73609:x1875230407081088:12345-192.168.204.35@tcp:35:dd.0 Request processed in 143us (226us total) trans 124554051665 rc 0/0 00000100:00100000:1.0:1788361757.122535:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 266 00000100:00100000:2.0:1788361757.123329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.123407:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081216 00000100:00100000:3.0:1788361757.123419:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081216 00002000:00010000:3.0:1788361757.123437:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:3.0:1788361757.123442:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d0038de300 with x1875230407081216 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.123450:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d0038de300. 00000100:00100000:3.0:1788361757.123473:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 603 00000100:00100000:3.0:1788361757.123480:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2411:x1875230407081216:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:3.0:1788361757.123603:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788361757.123616:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:3.0:1788361757.123618:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:3.0:1788361757.123622:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:3.0:1788361757.123624:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788361757.123632:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038de300 x1875230407081216/t4294968776(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.123674:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407081216:12345-192.168.204.35@tcp:10:dd.0 Request processed in 193us (346us total) trans 4294968776 rc 0/0 00000100:00100000:3.0:1788361757.123681:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 603 00002000:00010000:3.0:1788361757.123684:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:3.0:1788361757.123687:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d0038de300 with x1875230407081216 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.123691:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d0038de300. 00000100:00100000:2.0:1788361757.124236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.124283:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081344 00000100:00100000:3.0:1788361757.124299:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081344 00000100:00100000:3.0:1788361757.124386:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4965 00000100:00100000:3.0:1788361757.124394:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:73613:x1875230407081344:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.124407:0:26160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.124421:0:26160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe4c9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112ec expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.124438:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x788:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.124453:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.124457:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.124464:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe4c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112ec expref: 12 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.124499:0:26160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe4c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112ec expref: 12 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.124511:0:26160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d004309600, rc 0) 00010000:00000080:3.0:1788361757.124517:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038ded80 x1875230407081344/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.124551:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:73613:x1875230407081344:12345-192.168.204.35@tcp:101:dd.0 Request processed in 158us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.124559:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4965 00000100:00100000:0.0:1788361757.126453:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.126503:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081472 00000100:00100000:2.0:1788361757.126511:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081472 00000100:00100000:2.0:1788361757.126558:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1459 00000100:00100000:2.0:1788361757.126567:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+59:73610:x1875230407081472:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.126586:0:80345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.126603:0:80345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ca3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112f3 expref: -99 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.126631:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4caa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.126645:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4caa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.126655:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4caa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.126771:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ca3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112f3 expref: 61 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.126799:0:80345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf400/0x1b69fa8920fe4caa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112f3 expref: 60 pid: 80345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.126808:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:2.0:1788361757.126811:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.126820:0:80345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bf400, rc 0) 00000100:00100000:2.0:1788361757.126906:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+60:73610:x1875230407081472:12345-192.168.204.35@tcp:101:dd.0 Request processed in 340us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.126913:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1459 00000100:00100000:1.0:1788361757.127130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.127274:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081728 00000100:00100000:3.0:1788361757.127279:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081728 00000100:00100000:3.0:1788361757.127321:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1460 00000100:00100000:3.0:1788361757.127329:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+60:73611:x1875230407081728:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.127338:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.127348:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4cb1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7112fa expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127465:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127475:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127484:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127508:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127516:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127523:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127565:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4cc6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127573:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4cc6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127580:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4cc6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361757.127589:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00010000:00010000:3.0:1788361757.127661:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127668:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127675:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127682:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127689:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.127698:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127707:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127717:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361757.127720:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.127724:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127731:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4cb8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127742:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127749:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127754:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127760:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aada00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.127762:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127768:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127775:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff99d13a135300) 00010000:00010000:3.0:1788361757.127778:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.127798:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127805:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aada00/0x1b69fa8920fe4cbf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127871:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4cb1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112fa expref: 63 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127884:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4cc6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112fa expref: 62 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.127891:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:3.0:1788361757.127894:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361757.127896:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad200, rc 0) 00000100:00100000:3.0:1788361757.127931:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+62:73611:x1875230407081728:12345-192.168.204.35@tcp:101:dd.0 Request processed in 602us (800us total) trans 124554051666 rc 0/0 00000100:00100000:3.0:1788361757.127938:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1460 00000100:00100000:1.0:1788361757.128244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.128291:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081856 00000100:00100000:3.0:1788361757.128297:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081856 00000100:00100000:1.0:1788361757.128311:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00010000:3.0:1788361757.128320:0:8445:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:3.0:1788361757.128325:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007352d80 with x1875230407081856 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.128333:0:8445:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007352d80. 00000100:00100000:0.0:1788361757.128392:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 604 00000100:00100000:2.0:1788361757.128395:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407082112 00000100:00100000:2.0:1788361757.128400:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407082112 00000100:00100000:0.0:1788361757.128405:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2412:x1875230407081856:12345-192.168.204.35@tcp:10:dd.0 00000100:00100000:2.0:1788361757.128473:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 267 00000100:00100000:2.0:1788361757.128482:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+62:73608:x1875230407082112:12345-192.168.204.35@tcp:35:dd.0 00002000:00010000:0.0:1788361757.128539:0:24841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788361757.128542:0:24841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.128544:0:24841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:0.0:1788361757.128552:0:24841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.128553:0:24841:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788361757.128560:0:24841:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007352d80 x1875230407081856/t4294968777(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.128596:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:2412:x1875230407081856:12345-192.168.204.35@tcp:10:dd.0 Request processed in 195us (353us total) trans 4294968777 rc 0/0 00000100:00100000:0.0:1788361757.128609:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 604 00002000:00010000:0.0:1788361757.128612:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.128616:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007352d80 with x1875230407081856 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.128621:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007352d80. 00000100:00100000:2.0:1788361757.128649:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+63:73608:x1875230407082112:12345-192.168.204.35@tcp:35:dd.0 Request processed in 167us (338us total) trans 124554051667 rc 0/0 00000100:00100000:2.0:1788361757.128657:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 267 00000100:00100000:0.0:1788361757.132140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.132180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.132229:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407082496 00000100:00100000:2.0:1788361757.132229:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407082240 00000100:00100000:2.0:1788361757.132241:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407082240 00000100:00100000:3.0:1788361757.132250:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407082496 00000100:00100000:3.0:1788361757.132308:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1461 00000100:00100000:2.0:1788361757.132316:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1462 00000100:00100000:3.0:1788361757.132321:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+64:73620:x1875230407082496:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:2.0:1788361757.132331:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+64:73611:x1875230407082240:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.132350:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.132350:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.132378:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4cdb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711308 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132379:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe4cd4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711301 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132419:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4ce2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132435:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4ce2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132449:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4ce2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132509:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132520:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132529:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132545:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132548:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be400/0x1b69fa8920fe4cd4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711301 expref: 67 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132563:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132572:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132577:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bea00/0x1b69fa8920fe4ce2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711301 expref: 66 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.132587:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:2.0:1788361757.132590:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.132593:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bea00, rc 0) 00010000:00010000:3.0:1788361757.132631:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4cf7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132640:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4cf7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132647:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4cf7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.132707:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+66:73611:x1875230407082240:12345-192.168.204.35@tcp:101:dd.0 Request processed in 380us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.132715:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1462 00000004:00200000:3.0:1788361757.132764:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00000100:00100000:1.0:1788361757.132852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.132916:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407082752 00000100:00100000:0.0:1788361757.132922:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407082752 00010000:00010000:3.0:1788361757.132964:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.132966:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1463 00010000:00010000:3.0:1788361757.132973:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.132974:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+67:73610:x1875230407082752:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.132984:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132991:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.132997:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.132999:0:67579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.133001:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133008:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133015:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4c80 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112de expref: 67 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133016:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361757.133019:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.133022:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133025:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:3.0:1788361757.133028:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4ce9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133028:0:67579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.133059:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133064:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133069:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133073:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.133081:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133099:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133108:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff99d13a135b00) 00010000:00010000:3.0:1788361757.133110:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.133114:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133120:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4cf0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133136:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133144:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133151:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133154:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4cdb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711308 expref: 68 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133165:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4cf7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711308 expref: 67 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.133172:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:3.0:1788361757.133175:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361757.133177:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad400, rc 0) 00000100:00100000:3.0:1788361757.133219:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+67:73620:x1875230407082496:12345-192.168.204.35@tcp:101:dd.0 Request processed in 903us (1038us total) trans 124554051668 rc 0/0 00000100:00100000:3.0:1788361757.133226:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1461 00000001:00080000:0.0:1788361757.133275:0:67579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051669 00000004:00010000:0.0:1788361757.133299:0:67579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eaebafeb reply state 00000000d10c2c4c transno 124554051670 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133325:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.133333:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:0.0:1788361757.133336:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.133339:0:67579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361757.133399:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+68:73610:x1875230407082752:12345-192.168.204.35@tcp:36:dd.0 Request processed in 426us (549us total) trans 124554051670 rc 0/0 00000100:00100000:0.0:1788361757.133407:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1463 00000020:00080000:0.0:1788361757.133411:0:67579:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788361757.134363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.134415:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407083008 00000100:00100000:0.0:1788361757.134432:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407083008 00000100:00100000:0.0:1788361757.134484:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1464 00000100:00100000:0.0:1788361757.134493:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+68:73611:x1875230407083008:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:0.0:1788361757.134531:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361757.134551:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4cc6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112fa expref: 68 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.134575:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:0.0:1788361757.134579:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361757.134712:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.134725:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.134734:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.134743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000001:00080000:0.0:1788361757.134804:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051671 00000100:00100000:2.0:1788361757.134845:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407083264 00000100:00100000:2.0:1788361757.134851:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407083264 00000004:00010000:0.0:1788361757.134870:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6605994 reply state 00000000649dc1de transno 124554051672 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.134880:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.134885:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:0.0:1788361757.134887:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.134889:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361757.134893:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 268 00000100:00100000:2.0:1788361757.134903:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+70:73613:x1875230407083264:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:0.0:1788361757.134949:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+71:73611:x1875230407083008:12345-192.168.204.35@tcp:36:dd.0 Request processed in 457us (590us total) trans 124554051672 rc 0/0 00000100:00100000:0.0:1788361757.134958:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1464 00000020:00080000:0.0:1788361757.134963:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788361757.135061:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+71:73613:x1875230407083264:12345-192.168.204.35@tcp:35:dd.0 Request processed in 152us (309us total) trans 124554051673 rc 0/0 00000100:00100000:2.0:1788361757.135072:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 268 00000100:00100000:2.0:1788361757.135514:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.135561:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407083392 00000100:00100000:0.0:1788361757.135566:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407083392 00000100:00100000:0.0:1788361757.135600:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4966 00000100:00100000:0.0:1788361757.135618:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:73610:x1875230407083392:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.135630:0:26159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.135651:0:26159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe4d13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71130f expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.135672:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x785:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:0.0:1788361757.135689:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:0.0:1788361757.135694:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361757.135702:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe4d13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71130f expref: 14 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.135733:0:26159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe4d13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71130f expref: 14 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.135744:0:26159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139916400, rc 0) 00010000:00000080:0.0:1788361757.135752:0:26159:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038dea00 x1875230407083392/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.135806:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:73610:x1875230407083392:12345-192.168.204.35@tcp:101:dd.0 Request processed in 189us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.135812:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4966 00000100:00100000:1.0:1788361757.137030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.137064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.137075:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407083776 00000100:00100000:2.0:1788361757.137083:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407083776 00000100:00100000:1.0:1788361757.137098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.137112:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407083904 00000100:00100000:3.0:1788361757.137118:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407083904 00000100:00100000:2.0:1788361757.137138:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407083520 00000100:00100000:2.0:1788361757.137143:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407083520 00000100:00100000:0.0:1788361757.137156:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1465 00000100:00100000:3.0:1788361757.137162:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4967 00000100:00100000:0.0:1788361757.137168:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+72:73612:x1875230407083776:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:3.0:1788361757.137174:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:73611:x1875230407083904:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:2.0:1788361757.137183:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1466 00010000:00010000:0.0:1788361757.137187:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788361757.137197:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+72:73620:x1875230407083520:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.137205:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4d1a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71131d expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.137207:0:15123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.137208:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.137223:0:15123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe4d21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711324 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.137231:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4d28 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711316 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.137247:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x786:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.137260:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:2.0:1788361757.137262:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe4d2f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.137264:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.137276:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe4d21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711324 expref: 15 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.137280:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe4d2f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.137289:0:15123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe4d21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711324 expref: 15 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.137295:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe4d2f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.137298:0:15123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aada00, rc 0) 00010000:00000080:3.0:1788361757.137306:0:15123:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007350e00 x1875230407083904/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788361757.137327:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137337:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137346:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137360:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.137362:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:73611:x1875230407083904:12345-192.168.204.35@tcp:101:dd.0 Request processed in 189us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.137374:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4967 00010000:00010000:0.0:1788361757.137381:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137392:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.137394:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4d28 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711316 expref: 75 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.137420:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bec00/0x1b69fa8920fe4d2f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711316 expref: 74 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.137428:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:2.0:1788361757.137431:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.137434:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bec00, rc 0) 00010000:00010000:0.0:1788361757.137466:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe4d44 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.137469:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+74:73620:x1875230407083520:12345-192.168.204.35@tcp:101:dd.0 Request processed in 274us (370us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361757.137481:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe4d44 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.137483:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1466 00010000:00010000:0.0:1788361757.137494:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe4d44 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361757.137503:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788361757.137585:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137594:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137601:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137608:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137615:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.137619:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137638:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137650:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361757.137653:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.137658:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137665:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916000/0x1b69fa8920fe4d36 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.137672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:0.0:1788361757.137681:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137689:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137695:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137700:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.137704:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.137709:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084032 00010000:00010000:0.0:1788361757.137711:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.137716:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084032 00010000:00010000:0.0:1788361757.137725:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff99d10af47700) 00010000:00010000:0.0:1788361757.137728:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.137731:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.137744:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00010000:00010000:0.0:1788361757.137748:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916c00/0x1b69fa8920fe4d3d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788361757.137750:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed7b80 with x1875230407084032 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.137766:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed7b80. 00010000:00010000:0.0:1788361757.137799:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917e00/0x1b69fa8920fe4d1a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71131d expref: 75 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.137803:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 605 00000100:00100000:1.0:1788361757.137816:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2410:x1875230407084032:12345-192.168.204.35@tcp:10:dd.0 00010000:00010000:0.0:1788361757.137840:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe4d44 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71131d expref: 74 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.137851:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:0.0:1788361757.137855:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361757.137858:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139917800, rc 0) 00000100:00100000:0.0:1788361757.137891:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+74:73612:x1875230407083776:12345-192.168.204.35@tcp:101:dd.0 Request processed in 727us (864us total) trans 124554051674 rc 0/0 00000100:00100000:0.0:1788361757.137898:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1465 00002000:00010000:1.0:1788361757.137939:0:24837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.137944:0:24837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.137946:0:24837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.137948:0:24837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.137951:0:24837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.137958:0:24837:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed7b80 x1875230407084032/t4294968778(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.137996:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:2410:x1875230407084032:12345-192.168.204.35@tcp:10:dd.0 Request processed in 183us (329us total) trans 4294968778 rc 0/0 00000100:00100000:1.0:1788361757.138003:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 605 00002000:00010000:1.0:1788361757.138007:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.138010:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed7b80 with x1875230407084032 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.138015:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed7b80. 00000100:00100000:3.0:1788361757.139293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.139337:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084160 00000100:00100000:0.0:1788361757.139344:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084160 00002000:00010000:0.0:1788361757.139362:0:24840:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.139365:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed4a80 with x1875230407084160 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.139371:0:24840:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed4a80. 00000100:00100000:0.0:1788361757.139391:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 606 00000100:00100000:0.0:1788361757.139396:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:2411:x1875230407084160:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:0.0:1788361757.139486:0:24840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788361757.139489:0:24840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.139490:0:24840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:0.0:1788361757.139492:0:24840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.139504:0:24840:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788361757.139511:0:24840:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed4a80 x1875230407084160/t4294968779(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.139550:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:2411:x1875230407084160:12345-192.168.204.35@tcp:10:dd.0 Request processed in 155us (265us total) trans 4294968779 rc 0/0 00000100:00100000:0.0:1788361757.139556:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 606 00002000:00010000:0.0:1788361757.139558:0:24840:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.139560:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed4a80 with x1875230407084160 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.139564:0:24840:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed4a80. 00000100:00100000:2.0:1788361757.140511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.140665:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084288 00000100:00100000:1.0:1788361757.140672:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084288 00000100:00100000:1.0:1788361757.140724:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1467 00000100:00100000:1.0:1788361757.140734:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+74:73612:x1875230407084288:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.140759:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.140779:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4d52 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71132b expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.140850:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4d59 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.140875:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4d59 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.140889:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4d59 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.140890:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:1.0:1788361757.140993:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5800/0x1b69fa8920fe4d52 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71132b expref: 76 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.141010:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4200/0x1b69fa8920fe4d59 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71132b expref: 75 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.141019:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:1.0:1788361757.141021:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361757.141025:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4200, rc 0) 00000100:00100000:0.0:1788361757.141047:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084544 00000100:00100000:0.0:1788361757.141052:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084544 00000100:00100000:1.0:1788361757.141088:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+76:73612:x1875230407084288:12345-192.168.204.35@tcp:101:dd.0 Request processed in 354us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.141090:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1468 00000100:00100000:1.0:1788361757.141104:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1467 00000100:00100000:0.0:1788361757.141104:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+76:73620:x1875230407084544:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:0.0:1788361757.141137:0:66901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361757.141156:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad400/0x1b69fa8920fe4cf7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711308 expref: 75 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141173:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:0.0:1788361757.141177:0:66901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361757.141308:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141318:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141326:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361757.141389:0:66901:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051675 00000004:00010000:0.0:1788361757.141413:0:66901:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002cf82b3c reply state 00000000af6d3611 transno 124554051676 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141435:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141442:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:0.0:1788361757.141444:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.141447:0:66901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361757.141506:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+77:73620:x1875230407084544:12345-192.168.204.35@tcp:36:dd.0 Request processed in 406us (619us total) trans 124554051676 rc 0/0 00000100:00100000:0.0:1788361757.141513:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1468 00000020:00080000:0.0:1788361757.141517:0:66901:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361757.141642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.141676:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.141684:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084928 00000100:00100000:0.0:1788361757.141688:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084928 00000100:00100000:0.0:1788361757.141723:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1469 00000100:00100000:2.0:1788361757.141732:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407085056 00000100:00100000:0.0:1788361757.141733:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+77:73614:x1875230407084928:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:2.0:1788361757.141740:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407085056 00010000:00010000:0.0:1788361757.141747:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.141760:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe4d67 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711332 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.141781:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 269 00000100:00100000:1.0:1788361757.141799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.141805:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+79:73610:x1875230407085056:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:3.0:1788361757.141868:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407085312 00000100:00100000:3.0:1788361757.141874:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407085312 00010000:00010000:0.0:1788361757.141889:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141898:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.141904:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 270 00010000:00010000:0.0:1788361757.141906:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.141917:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+81:73611:x1875230407085312:12345-192.168.204.35@tcp:35:dd.0 00010000:00010000:0.0:1788361757.141928:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141937:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.141946:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.141990:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+81:73610:x1875230407085056:12345-192.168.204.35@tcp:35:dd.0 Request processed in 189us (312us total) trans 124554051677 rc 0/0 00000100:00100000:2.0:1788361757.141998:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 269 00010000:00010000:0.0:1788361757.142008:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08600/0x1b69fa8920fe4d7c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142019:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08600/0x1b69fa8920fe4d7c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142027:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08600/0x1b69fa8920fe4d7c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361757.142042:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:0.0:1788361757.142096:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142105:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142111:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142119:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142125:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101492c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.142137:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.142146:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+82:73611:x1875230407085312:12345-192.168.204.35@tcp:35:dd.0 Request processed in 230us (357us total) trans 124554051678 rc 0/0 00010000:00010000:0.0:1788361757.142148:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.142162:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 270 00010000:00010000:0.0:1788361757.142167:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361757.142172:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.142176:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142183:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101492c00/0x1b69fa8920fe4d6e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142196:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142202:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142208:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142214:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101493e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.142217:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142223:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142231:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff99d10af47e00) 00010000:00010000:0.0:1788361757.142236:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.142244:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142250:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d101493e00/0x1b69fa8920fe4d75 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142290:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139916e00/0x1b69fa8920fe4d67 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711332 expref: 82 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142303:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08600/0x1b69fa8920fe4d7c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711332 expref: 81 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.142310:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:0.0:1788361757.142312:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361757.142314:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c08600, rc 0) 00000100:00100000:0.0:1788361757.142336:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+81:73614:x1875230407084928:12345-192.168.204.35@tcp:101:dd.0 Request processed in 606us (695us total) trans 124554051679 rc 0/0 00000100:00100000:0.0:1788361757.142343:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1469 00000100:00100000:1.0:1788361757.144740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.144779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.144806:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407085440 00000100:00100000:2.0:1788361757.144814:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407085440 00000100:00100000:1.0:1788361757.144851:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.144909:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4968 00000100:00100000:0.0:1788361757.144913:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407085696 00000100:00100000:0.0:1788361757.144919:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407085696 00000100:00100000:2.0:1788361757.144922:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:73620:x1875230407085440:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.144941:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788361757.144952:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407085824 00000100:00100000:0.0:1788361757.144955:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407085824 00010000:00010000:2.0:1788361757.144960:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe4d8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711339 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.144977:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1470 00000100:00100000:0.0:1788361757.144986:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+82:73612:x1875230407085696:12345-192.168.204.35@tcp:36:dd.0 00002000:00010000:2.0:1788361757.144995:0:8535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78f:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:2.0:1788361757.145022:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:2.0:1788361757.145027:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361757.145029:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361757.145037:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe4d8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711339 expref: 18 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.145055:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917800/0x1b69fa8920fe4d44 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71131d expref: 82 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.145058:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe4d8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711339 expref: 18 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.145059:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1471 00000100:00100000:3.0:1788361757.145077:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+81:73614:x1875230407085824:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.145086:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.145086:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030e00, rc 0) 00010000:00010000:0.0:1788361757.145094:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00000080:2.0:1788361757.145097:0:8535:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a0aa00 x1875230407085440/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788361757.145098:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4d91 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711340 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.145116:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.145135:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4d98 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145148:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4d98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145159:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4d98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.145168:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:73620:x1875230407085440:12345-192.168.204.35@tcp:101:dd.0 Request processed in 249us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.145185:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4968 00010000:00010000:3.0:1788361757.145237:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac200/0x1b69fa8920fe4d91 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711340 expref: 84 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145259:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac000/0x1b69fa8920fe4d98 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711340 expref: 83 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145267:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:3.0:1788361757.145270:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361757.145273:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac000, rc 0) 00010000:00010000:0.0:1788361757.145276:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.145288:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.145297:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.145314:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+83:73614:x1875230407085824:12345-192.168.204.35@tcp:101:dd.0 Request processed in 241us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.145328:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1471 00000001:00080000:0.0:1788361757.145342:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051680 00000004:00010000:0.0:1788361757.145365:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000573fc503 reply state 0000000056f276a5 transno 124554051681 ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.145376:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.145383:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:0.0:1788361757.145385:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.145387:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361757.145433:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+84:73612:x1875230407085696:12345-192.168.204.35@tcp:36:dd.0 Request processed in 447us (653us total) trans 124554051681 rc 0/0 00000100:00100000:1.0:1788361757.145477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.145513:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086080 00000100:00100000:3.0:1788361757.145519:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086080 00000100:00100000:3.0:1788361757.145556:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1472 00000100:00100000:3.0:1788361757.145564:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+85:73615:x1875230407086080:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.145573:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.145584:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4da6 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711347 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.145704:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1470 00000020:00080000:0.0:1788361757.145709:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361757.145799:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145807:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145813:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145924:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145930:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.145936:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146039:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4dbb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146060:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4dbb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146068:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4dbb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361757.146077:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788361757.146126:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146134:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146141:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146147:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146153:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aacc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.146157:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146165:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146173:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361757.146176:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.146180:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146186:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4dad lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146205:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146211:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146217:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146222:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.146225:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146231:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146240:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff99d13a135b00) 00010000:00010000:3.0:1788361757.146242:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.146245:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146251:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4db4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146294:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4da6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711347 expref: 87 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146309:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4dbb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711347 expref: 86 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.146328:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:3.0:1788361757.146330:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361757.146332:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad200, rc 0) 00000100:00100000:3.0:1788361757.146417:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+86:73615:x1875230407086080:12345-192.168.204.35@tcp:101:dd.0 Request processed in 853us (939us total) trans 124554051682 rc 0/0 00000100:00100000:3.0:1788361757.146424:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1472 00000100:00100000:1.0:1788361757.147120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.147148:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086208 00000100:00100000:1.0:1788361757.147153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.147156:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086208 00000100:00100000:3.0:1788361757.147200:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4969 00000100:00100000:1.0:1788361757.147210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.147215:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:73612:x1875230407086208:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:2.0:1788361757.147220:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086464 00000100:00100000:2.0:1788361757.147224:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086464 00010000:00010000:3.0:1788361757.147226:0:26169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788361757.147237:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086592 00010000:00010000:3.0:1788361757.147241:0:26169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe4dc9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71134e expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.147242:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086592 00002000:00010000:0.0:1788361757.147260:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00010000:3.0:1788361757.147264:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x787:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00002000:00100000:0.0:1788361757.147264:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a09180 with x1875230407086592 ext(0->18446744073709551615) 00000100:00100000:2.0:1788361757.147266:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1473 00002000:00010000:0.0:1788361757.147274:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a09180. 00000100:00100000:2.0:1788361757.147277:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+86:73614:x1875230407086464:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.147280:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.147284:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.147290:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe4dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71134e expref: 20 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.147303:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 607 00010000:00010000:3.0:1788361757.147305:0:26169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe4dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71134e expref: 20 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.147316:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2409:x1875230407086592:12345-192.168.204.35@tcp:10:dd.0 00010000:00010000:3.0:1788361757.147320:0:26169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad400, rc 0) 00010000:00010000:2.0:1788361757.147334:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00000080:3.0:1788361757.147335:0:26169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a09500 x1875230407086208/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361757.147348:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08600/0x1b69fa8920fe4d7c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711332 expref: 86 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.147360:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361757.147363:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361757.147367:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:73612:x1875230407086208:12345-192.168.204.35@tcp:101:dd.0 Request processed in 160us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.147372:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4969 00002000:00010000:0.0:1788361757.147430:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788361757.147434:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.147437:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:0.0:1788361757.147439:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.147442:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788361757.147450:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a09180 x1875230407086592/t4294968780(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361757.147462:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.147474:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.147478:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2409:x1875230407086592:12345-192.168.204.35@tcp:10:dd.0 Request processed in 166us (269us total) trans 4294968780 rc 0/0 00000100:00100000:0.0:1788361757.147490:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 607 00010000:00010000:2.0:1788361757.147492:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.147493:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.147497:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a09180 with x1875230407086592 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.147502:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a09180. 00000001:00080000:2.0:1788361757.147533:0:66127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051683 00000004:00010000:2.0:1788361757.147554:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000584951cc reply state 00000000b6827b07 transno 124554051684 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.147565:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.147573:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361757.147575:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361757.147585:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361757.147644:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+88:73614:x1875230407086464:12345-192.168.204.35@tcp:36:dd.0 Request processed in 368us (492us total) trans 124554051684 rc 0/0 00000100:00100000:2.0:1788361757.147651:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1473 00000020:00080000:2.0:1788361757.147655:0:66127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361757.148233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.148296:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086720 00000100:00100000:0.0:1788361757.148302:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086720 00000100:00100000:0.0:1788361757.148350:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1474 00000100:00100000:0.0:1788361757.148359:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+88:73615:x1875230407086720:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.148372:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.148384:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4dd7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711355 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148407:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08800/0x1b69fa8920fe4dde lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148417:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08800/0x1b69fa8920fe4dde lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148438:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08800/0x1b69fa8920fe4dde lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148509:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4dd7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711355 expref: 90 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148523:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08800/0x1b69fa8920fe4dde lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711355 expref: 89 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148530:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:0.0:1788361757.148533:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361757.148536:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c08800, rc 0) 00000100:00100000:0.0:1788361757.148569:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+89:73615:x1875230407086720:12345-192.168.204.35@tcp:101:dd.0 Request processed in 211us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.148576:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1474 00000100:00100000:2.0:1788361757.148644:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.148707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.148709:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086976 00000100:00100000:0.0:1788361757.148713:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086976 00000100:00100000:2.0:1788361757.148747:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407087104 00000100:00100000:2.0:1788361757.148752:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407087104 00002000:00010000:2.0:1788361757.148771:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:2.0:1788361757.148775:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed6d80 with x1875230407087104 ext(0->18446744073709551615) 00000100:00100000:0.0:1788361757.148781:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1475 00002000:00010000:2.0:1788361757.148783:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed6d80. 00000100:00100000:0.0:1788361757.148805:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+89:73625:x1875230407086976:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.148815:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788361757.148842:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 608 00010000:00010000:0.0:1788361757.148846:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe4de5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71135c expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.148854:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2409:x1875230407087104:12345-192.168.204.35@tcp:10:dd.0 00010000:00010000:0.0:1788361757.148945:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.148955:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361757.148959:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788361757.148964:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:2.0:1788361757.148971:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:2.0:1788361757.148976:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:2.0:1788361757.148978:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1788361757.148980:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1788361757.148986:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed6d80 x1875230407087104/t4294968781(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788361757.149005:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149014:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.149020:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:2409:x1875230407087104:12345-192.168.204.35@tcp:10:dd.0 Request processed in 169us (313us total) trans 4294968781 rc 0/0 00010000:00010000:0.0:1788361757.149024:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.149030:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 608 00002000:00010000:2.0:1788361757.149037:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:2.0:1788361757.149040:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed6d80 with x1875230407087104 ext(0->18446744073709551615) 00002000:00010000:2.0:1788361757.149045:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed6d80. 00010000:00010000:0.0:1788361757.149077:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4dfa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149102:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4dfa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149110:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4dfa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361757.149123:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:0.0:1788361757.149175:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149183:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149190:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149196:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149207:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.149211:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149219:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149228:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361757.149231:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.149235:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149241:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4dec lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149251:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149258:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149264:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149269:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.149272:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149278:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149298:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff99d10af47700) 00010000:00010000:0.0:1788361757.149301:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.149304:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149309:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4df3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149342:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe4de5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71135c expref: 92 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149355:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4dfa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71135c expref: 91 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.149362:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:0.0:1788361757.149366:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361757.149369:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c08a00, rc 0) 00000100:00100000:2.0:1788361757.149396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.149413:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+91:73625:x1875230407086976:12345-192.168.204.35@tcp:101:dd.0 Request processed in 622us (771us total) trans 124554051685 rc 0/0 00000100:00100000:0.0:1788361757.149421:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1475 00000100:00100000:2.0:1788361757.149472:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407087360 00000100:00100000:2.0:1788361757.149476:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407087360 00000100:00100000:2.0:1788361757.149510:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 271 00000100:00100000:2.0:1788361757.149517:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+91:73620:x1875230407087360:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:2.0:1788361757.149716:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+92:73620:x1875230407087360:12345-192.168.204.35@tcp:35:dd.0 Request processed in 197us (320us total) trans 124554051686 rc 0/0 00000100:00100000:2.0:1788361757.149725:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 271 00000100:00100000:0.0:1788361757.149978:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.150006:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407087488 00000100:00100000:3.0:1788361757.150011:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407087488 00000100:00100000:3.0:1788361757.150051:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4970 00000100:00100000:3.0:1788361757.150058:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:73614:x1875230407087488:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.150066:0:26172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.150077:0:26172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe4e08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711363 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.150095:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x789:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.150107:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.150111:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.150118:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe4e08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711363 expref: 22 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.150131:0:26172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe4e08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711363 expref: 22 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.150141:0:26172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aac200, rc 0) 00010000:00000080:3.0:1788361757.150146:0:26172:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d4000 x1875230407087488/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.150193:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:73614:x1875230407087488:12345-192.168.204.35@tcp:101:dd.0 Request processed in 135us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.150200:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4970 00000100:00100000:2.0:1788361757.150979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.151012:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407087744 00000100:00100000:3.0:1788361757.151017:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407087744 00000100:00100000:3.0:1788361757.151088:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1476 00000100:00100000:3.0:1788361757.151098:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+92:73615:x1875230407087744:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.151128:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.151145:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4dbb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711347 expref: 92 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.151168:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:3.0:1788361757.151171:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.151272:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.151284:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.151293:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361757.151329:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051687 00000004:00010000:3.0:1788361757.151347:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa687da2 reply state 000000004f34d3fc transno 124554051688 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.151357:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.151374:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:3.0:1788361757.151376:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.151378:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.151453:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+94:73615:x1875230407087744:12345-192.168.204.35@tcp:36:dd.0 Request processed in 357us (475us total) trans 124554051688 rc 0/0 00000100:00100000:3.0:1788361757.151460:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1476 00000020:00080000:3.0:1788361757.151464:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788361757.151898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.151932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.152009:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088256 00000100:00100000:3.0:1788361757.152014:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088256 00000100:00100000:3.0:1788361757.152049:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 272 00000100:00100000:3.0:1788361757.152057:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+94:73612:x1875230407088256:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:3.0:1788361757.152180:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+95:73612:x1875230407088256:12345-192.168.204.35@tcp:35:dd.0 Request processed in 124us (284us total) trans 124554051689 rc 0/0 00000100:00100000:3.0:1788361757.152188:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 272 00000100:00100000:1.0:1788361757.152249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.152269:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088512 00000100:00100000:3.0:1788361757.152273:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088512 00000100:00100000:1.0:1788361757.152323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00010000:3.0:1788361757.152350:0:8445:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00000100:00100000:1.0:1788361757.152350:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00100000:3.0:1788361757.152354:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a09f80 with x1875230407088512 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.152361:0:8445:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a09f80. 00000100:00100000:3.0:1788361757.152378:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 609 00000100:00100000:3.0:1788361757.152425:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2411:x1875230407088512:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:3.0:1788361757.152498:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788361757.152502:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:3.0:1788361757.152504:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:3.0:1788361757.152506:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:3.0:1788361757.152515:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788361757.152524:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a09f80 x1875230407088512/t4294968782(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.152559:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:2411:x1875230407088512:12345-192.168.204.35@tcp:10:dd.0 Request processed in 174us (310us total) trans 4294968782 rc 0/0 00000100:00100000:3.0:1788361757.152566:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 609 00002000:00010000:3.0:1788361757.152570:0:8445:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:3.0:1788361757.152574:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a09f80 with x1875230407088512 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.152579:0:8445:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a09f80. 00000100:00100000:0.0:1788361757.152594:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088384 00000100:00100000:0.0:1788361757.152599:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088384 00000100:00100000:3.0:1788361757.152603:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088640 00000100:00100000:3.0:1788361757.152609:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088640 00000100:00100000:0.0:1788361757.152634:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407087872 00000100:00100000:0.0:1788361757.152640:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407087872 00000100:00100000:3.0:1788361757.152647:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4971 00000100:00100000:3.0:1788361757.152657:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:73615:x1875230407088640:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.152665:0:26163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788361757.152678:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1477 00010000:00010000:3.0:1788361757.152680:0:26163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4e16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711378 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.152689:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+96:73617:x1875230407088384:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:1.0:1788361757.152695:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1478 00000100:00100000:1.0:1788361757.152710:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+96:73625:x1875230407087872:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.152713:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.152726:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe4e1d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711371 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.152733:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1788361757.152746:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78a:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:1.0:1788361757.152746:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4e24 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71136a expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.152766:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.152773:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361757.152775:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4c00/0x1b69fa8920fe4e2b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.152782:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4e16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711378 expref: 24 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.152799:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4c00/0x1b69fa8920fe4e2b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.152813:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4c00/0x1b69fa8920fe4e2b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.152814:0:26163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4e16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711378 expref: 24 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.152851:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.152867:0:26163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231be400, rc 0) 00010000:00010000:0.0:1788361757.152868:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1788361757.152877:0:26163:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a08000 x1875230407088640/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788361757.152880:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.152906:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.152920:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.152927:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4e24 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71136a expref: 99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.152928:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+24:73615:x1875230407088640:12345-192.168.204.35@tcp:101:dd.0 Request processed in 271us (575us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361757.152932:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.152944:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4971 00010000:00010000:0.0:1788361757.152981:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4e40 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.152990:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4e40 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.152997:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4e40 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361757.153005:0:66126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:0.0:1788361757.153060:0:66126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.153068:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4c00/0x1b69fa8920fe4e2b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71136a expref: 99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153072:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.153082:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:0.0:1788361757.153084:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.153087:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361757.153094:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.153099:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4c00, rc 0) 00010000:00010000:0.0:1788361757.153102:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.153110:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153120:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153132:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00000100:00100000:1.0:1788361757.153134:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+99:73625:x1875230407087872:12345-192.168.204.35@tcp:101:dd.0 Request processed in 428us (812us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361757.153136:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.153143:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.153148:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1478 00010000:00010000:0.0:1788361757.153156:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4e32 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153168:0:66126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153174:0:66126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153180:0:66126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153191:0:66126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.153194:0:66126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153201:0:66126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153211:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff99d10af47700) 00010000:00010000:0.0:1788361757.153214:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.153217:0:66126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153222:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09600/0x1b69fa8920fe4e39 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153253:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe4e1d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711371 expref: 99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153263:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4e40 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711371 expref: 98 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.153269:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:0.0:1788361757.153271:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361757.153273:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c09a00, rc 0) 00000100:00100000:0.0:1788361757.153306:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+98:73617:x1875230407088384:12345-192.168.204.35@tcp:101:dd.0 Request processed in 620us (1373us total) trans 124554051690 rc 0/0 00000100:00100000:0.0:1788361757.153313:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1477 00000100:00100000:2.0:1788361757.154264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.154405:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088768 00000100:00100000:0.0:1788361757.154418:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088768 00002000:00010000:0.0:1788361757.154455:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.154459:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d141099180 with x1875230407088768 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.154467:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d141099180. 00000100:00100000:0.0:1788361757.154502:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 610 00000100:00100000:0.0:1788361757.154513:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+24:2410:x1875230407088768:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:0.0:1788361757.154620:0:24843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788361757.154624:0:24843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.154626:0:24843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:0.0:1788361757.154628:0:24843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.154630:0:24843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788361757.154638:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d141099180 x1875230407088768/t4294968783(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.154686:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2410:x1875230407088768:12345-192.168.204.35@tcp:10:dd.0 Request processed in 176us (427us total) trans 4294968783 rc 0/0 00000100:00100000:0.0:1788361757.154694:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 610 00002000:00010000:0.0:1788361757.154697:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.154700:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d141099180 with x1875230407088768 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.154704:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d141099180. 00000100:00100000:2.0:1788361757.154861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.154922:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407089024 00000100:00100000:0.0:1788361757.154928:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407089024 00000100:00100000:0.0:1788361757.154961:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1479 00000100:00100000:0.0:1788361757.154970:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+98:73625:x1875230407089024:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:0.0:1788361757.155010:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361757.155127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.155157:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407089280 00000100:00100000:3.0:1788361757.155163:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407089280 00010000:00010000:0.0:1788361757.155220:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4dfa lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71135c expref: 99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.155313:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 273 00010000:00010000:0.0:1788361757.155319:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00000100:00100000:3.0:1788361757.155324:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+98:73614:x1875230407089280:12345-192.168.204.35@tcp:35:dd.0 00010000:00010000:0.0:1788361757.155327:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361757.155463:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155476:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155486:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.155494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.155515:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+100:73614:x1875230407089280:12345-192.168.204.35@tcp:35:dd.0 Request processed in 193us (386us total) trans 124554051692 rc 0/0 00000100:00100000:3.0:1788361757.155525:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 273 00000001:00080000:0.0:1788361757.155541:0:66127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051691 00000004:00010000:0.0:1788361757.155568:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb9c345f reply state 0000000002b7046c transno 124554051693 ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155581:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155588:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:0.0:1788361757.155591:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.155596:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361757.155597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.155630:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407089408 00000100:00100000:2.0:1788361757.155634:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407089408 00000100:00100000:0.0:1788361757.155670:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+102:73625:x1875230407089024:12345-192.168.204.35@tcp:36:dd.0 Request processed in 701us (809us total) trans 124554051693 rc 0/0 00000100:00100000:2.0:1788361757.155675:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407089664 00000100:00100000:2.0:1788361757.155680:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407089664 00000100:00100000:0.0:1788361757.155685:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1479 00000020:00080000:0.0:1788361757.155691:0:66127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361757.155703:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1480 00000100:00100000:0.0:1788361757.155711:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1481 00000100:00100000:0.0:1788361757.155719:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+102:73616:x1875230407089664:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:1.0:1788361757.155724:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+102:73617:x1875230407089408:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.155727:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.155733:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.155744:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08e00/0x1b69fa8920fe4e55 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711386 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155746:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4a00/0x1b69fa8920fe4e5c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71137f expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155774:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe4e63 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155784:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe4e63 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155806:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe4e63 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155867:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155875:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155881:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155887:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4a00/0x1b69fa8920fe4e5c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71137f expref: 105 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155891:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155899:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155903:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5200/0x1b69fa8920fe4e63 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71137f expref: 104 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155906:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.155915:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:1.0:1788361757.155918:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361757.155920:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5200, rc 0) 00010000:00010000:0.0:1788361757.155941:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08c00/0x1b69fa8920fe4e78 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.155947:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08c00/0x1b69fa8920fe4e78 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.155948:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+104:73617:x1875230407089408:12345-192.168.204.35@tcp:101:dd.0 Request processed in 236us (460us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361757.155954:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08c00/0x1b69fa8920fe4e78 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.155966:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1480 00000004:00200000:0.0:1788361757.155966:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00010000:00010000:0.0:1788361757.156002:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156029:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156036:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156044:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156050:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c08400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.156055:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156064:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156074:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361757.156076:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.156080:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156086:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08400/0x1b69fa8920fe4e6a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156097:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156103:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156108:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156119:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.156123:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156129:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156139:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff99d10af47e00) 00010000:00010000:0.0:1788361757.156142:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.156145:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156150:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09800/0x1b69fa8920fe4e71 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156183:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08e00/0x1b69fa8920fe4e55 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711386 expref: 105 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156195:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08c00/0x1b69fa8920fe4e78 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711386 expref: 104 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.156201:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:0.0:1788361757.156203:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361757.156206:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c08c00, rc 0) 00000100:00100000:0.0:1788361757.156237:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+104:73616:x1875230407089664:12345-192.168.204.35@tcp:101:dd.0 Request processed in 519us (642us total) trans 124554051694 rc 0/0 00000100:00100000:0.0:1788361757.156244:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1481 00000100:00100000:2.0:1788361757.156303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.156350:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407089920 00000100:00100000:1.0:1788361757.156356:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407089920 00000100:00100000:1.0:1788361757.156389:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 274 00000100:00100000:1.0:1788361757.156398:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+104:73615:x1875230407089920:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:1.0:1788361757.156544:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+105:73615:x1875230407089920:12345-192.168.204.35@tcp:35:dd.0 Request processed in 147us (242us total) trans 124554051695 rc 0/0 00000100:00100000:1.0:1788361757.156553:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 274 00000100:00100000:3.0:1788361757.157545:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.157585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.157664:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090048 00000100:00100000:0.0:1788361757.157664:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090304 00000100:00100000:1.0:1788361757.157672:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090048 00000100:00100000:0.0:1788361757.157702:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090304 00000100:00100000:1.0:1788361757.157751:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4972 00000100:00100000:1.0:1788361757.157763:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:73625:x1875230407090048:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:0.0:1788361757.157777:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1482 00010000:00010000:1.0:1788361757.157778:0:26170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788361757.157807:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+105:73617:x1875230407090304:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:1.0:1788361757.157812:0:26170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4e86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71138d expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.157879:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x794:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:1.0:1788361757.157897:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:1.0:1788361757.157902:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361757.157910:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4e86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71138d expref: 26 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.157925:0:26170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4e86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71138d expref: 26 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.157930:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361757.157951:0:26170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5800, rc 0) 00010000:00000080:1.0:1788361757.157957:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed5f80 x1875230407090048/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788361757.157968:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4e40 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711371 expref: 105 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.157991:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:0.0:1788361757.157997:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361757.158007:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:73625:x1875230407090048:12345-192.168.204.35@tcp:101:dd.0 Request processed in 244us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.158017:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4972 00010000:00010000:0.0:1788361757.158193:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.158211:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.158224:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.158249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000001:00080000:0.0:1788361757.158286:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051696 00000004:00010000:0.0:1788361757.158315:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0dd3729 reply state 00000000879c6582 transno 124554051697 ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.158329:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.158337:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:0.0:1788361757.158340:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.158343:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361757.158353:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090432 00000100:00100000:1.0:1788361757.158360:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090432 00000100:00100000:1.0:1788361757.158400:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1483 00000100:00100000:1.0:1788361757.158411:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+108:73616:x1875230407090432:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:2.0:1788361757.158416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:1.0:1788361757.158431:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788361757.158436:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090688 00000100:00100000:3.0:1788361757.158440:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090688 00010000:00010000:1.0:1788361757.158447:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4400/0x1b69fa8920fe4e94 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711394 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.158468:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73617:x1875230407090304:12345-192.168.204.35@tcp:36:dd.0 Request processed in 678us (878us total) trans 124554051697 rc 0/0 00010000:00010000:1.0:1788361757.158475:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe4e9b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.158479:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1484 00010000:00010000:1.0:1788361757.158490:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe4e9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.158493:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73618:x1875230407090688:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:0.0:1788361757.158501:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1482 00010000:00010000:3.0:1788361757.158502:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.158502:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe4e9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788361757.158516:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361757.158517:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4ea2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71139b expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.158604:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4400/0x1b69fa8920fe4e94 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711394 expref: 111 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.158630:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5400/0x1b69fa8920fe4e9b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711394 expref: 110 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158633:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.158639:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:1.0:1788361757.158642:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361757.158645:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5400, rc 0) 00010000:00010000:3.0:1788361757.158647:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158655:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158669:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158677:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158683:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.158684:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73616:x1875230407090432:12345-192.168.204.35@tcp:101:dd.0 Request processed in 278us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.158691:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1483 00010000:00010000:3.0:1788361757.158733:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4eb7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158742:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4eb7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.158749:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4eb7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361757.158758:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00010000:00010000:2.0:1788361757.159001:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159010:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159016:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159029:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159035:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231be200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.159039:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159047:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159057:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361757.159060:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.159063:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159069:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe4ea9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159083:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159089:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159094:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159100:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfe00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.159102:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159117:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159126:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff99d13a135d00) 00010000:00010000:2.0:1788361757.159137:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.159141:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159146:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfe00/0x1b69fa8920fe4eb0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159182:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4ea2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71139b expref: 111 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159194:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4eb7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71139b expref: 110 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.159202:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:2.0:1788361757.159204:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361757.159207:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aad200, rc 0) 00000100:00100000:2.0:1788361757.159240:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73618:x1875230407090688:12345-192.168.204.35@tcp:101:dd.0 Request processed in 752us (828us total) trans 124554051698 rc 0/0 00000100:00100000:2.0:1788361757.159247:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1484 00000100:00100000:3.0:1788361757.159623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.159677:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090816 00000100:00100000:1.0:1788361757.159684:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090816 00002000:00010000:1.0:1788361757.159714:0:24839:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.159720:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed7100 with x1875230407090816 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.159729:0:24839:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed7100. 00000100:00100000:1.0:1788361757.159754:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 611 00000100:00100000:1.0:1788361757.159762:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2409:x1875230407090816:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:1.0:1788361757.159929:0:24839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.159933:0:24839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.159935:0:24839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.159937:0:24839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.159940:0:24839:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.159948:0:24839:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed7100 x1875230407090816/t4294968784(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.159987:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2409:x1875230407090816:12345-192.168.204.35@tcp:10:dd.0 Request processed in 226us (365us total) trans 4294968784 rc 0/0 00000100:00100000:1.0:1788361757.160002:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 611 00002000:00010000:1.0:1788361757.160007:0:24839:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.160011:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed7100 with x1875230407090816 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.160016:0:24839:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed7100. 00000100:00100000:2.0:1788361757.160609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.160643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.160667:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090944 00000100:00100000:0.0:1788361757.160679:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090944 00000100:00100000:3.0:1788361757.160699:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407091200 00000100:00100000:3.0:1788361757.160707:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407091200 00000100:00100000:0.0:1788361757.160743:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4973 00000100:00100000:3.0:1788361757.160761:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1485 00000100:00100000:0.0:1788361757.160764:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:73617:x1875230407090944:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:3.0:1788361757.160777:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+110:73616:x1875230407091200:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:0.0:1788361757.160783:0:26161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.160820:0:26161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9aecb92/0x1b69fa8920fe4ec5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113a2 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.160878:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.160901:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08c00/0x1b69fa8920fe4e78 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711386 expref: 110 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.160916:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:3.0:1788361757.160920:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.161048:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.161062:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.161075:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.161086:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78c:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:0.0:1788361757.161111:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:0.0:1788361757.161117:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=0s v=(0 0) 00000001:00080000:3.0:1788361757.161125:0:66128:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051699 00010000:00010000:0.0:1788361757.161128:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9aecb92/0x1b69fa8920fe4ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113a2 expref: 28 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.161147:0:26161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9aecb92/0x1b69fa8920fe4ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113a2 expref: 28 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361757.161152:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f30b769 reply state 00000000ab47e546 transno 124554051700 ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.161157:0:26161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c09000, rc 0) 00010000:00000080:0.0:1788361757.161168:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d13a269850 x1875230407090944/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788361757.161175:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.161184:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:3.0:1788361757.161187:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.161191:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361757.161231:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:73617:x1875230407090944:12345-192.168.204.35@tcp:101:dd.0 Request processed in 478us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.161238:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4973 00000100:00100000:3.0:1788361757.161257:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+112:73616:x1875230407091200:12345-192.168.204.35@tcp:36:dd.0 Request processed in 482us (610us total) trans 124554051700 rc 0/0 00000100:00100000:3.0:1788361757.161266:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1485 00000020:00080000:3.0:1788361757.161272:0:66128:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.162699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.162747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.162805:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.162863:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407091456 00000100:00100000:1.0:1788361757.162870:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407091456 00000100:00100000:0.0:1788361757.162875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.162903:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407091968 00000100:00100000:0.0:1788361757.162908:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407091968 00002000:00010000:0.0:1788361757.162933:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00000100:00100000:3.0:1788361757.162934:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407091712 00002000:00100000:0.0:1788361757.162939:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1411d6300 with x1875230407091968 ext(0->18446744073709551615) 00000100:00100000:3.0:1788361757.162948:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407091712 00002000:00010000:0.0:1788361757.162952:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d1411d6300. 00000100:00100000:0.0:1788361757.162980:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 612 00000100:00100000:0.0:1788361757.162991:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:2410:x1875230407091968:12345-192.168.204.35@tcp:10:dd.0 00000100:00100000:3.0:1788361757.162993:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407091840 00000100:00100000:3.0:1788361757.162998:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407091840 00000100:00100000:2.0:1788361757.163039:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1486 00000100:00100000:2.0:1788361757.163057:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+114:73619:x1875230407091712:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:1.0:1788361757.163079:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 275 00000100:00100000:1.0:1788361757.163097:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+114:73625:x1875230407091456:12345-192.168.204.35@tcp:35:dd.0 00010000:00010000:2.0:1788361757.163102:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788361757.163110:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1487 00002000:00010000:0.0:1788361757.163114:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788361757.163118:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.163121:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00000100:00100000:3.0:1788361757.163127:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+114:73618:x1875230407091840:12345-192.168.204.35@tcp:101:dd.0 00002000:00010000:0.0:1788361757.163127:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00010000:00010000:2.0:1788361757.163128:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4ed3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113a9 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.163137:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1788361757.163155:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000080:0.0:1788361757.163160:0:24842:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d6300 x1875230407091968/t4294968785(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788361757.163174:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4eda lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113b0 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.163205:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2410:x1875230407091968:12345-192.168.204.35@tcp:10:dd.0 Request processed in 217us (330us total) trans 4294968785 rc 0/0 00010000:00010000:3.0:1788361757.163207:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4ee1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.163213:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 612 00002000:00010000:0.0:1788361757.163218:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.163222:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1411d6300 with x1875230407091968 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.163226:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d1411d6300. 00010000:00010000:3.0:1788361757.163227:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4ee1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.163239:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4ee1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.163287:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+117:73625:x1875230407091456:12345-192.168.204.35@tcp:35:dd.0 Request processed in 196us (591us total) trans 124554051701 rc 0/0 00000100:00100000:1.0:1788361757.163297:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 275 00010000:00010000:2.0:1788361757.163321:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.163329:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad600/0x1b69fa8920fe4eda lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113b0 expref: 117 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.163338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788361757.163353:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163372:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163393:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.163398:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aacc00/0x1b69fa8920fe4ee1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113b0 expref: 116 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163409:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163426:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163506:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe4ef6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163516:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe4ef6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163524:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe4ef6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361757.163534:0:66901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:3.0:1788361757.163576:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:3.0:1788361757.163590:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361757.163594:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d117aacc00, rc 0) 00000100:00100000:1.0:1788361757.163596:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407092096 00000100:00100000:1.0:1788361757.163611:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407092096 00010000:00010000:2.0:1788361757.163628:0:66901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163640:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.163641:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+117:73618:x1875230407091840:12345-192.168.204.35@tcp:101:dd.0 Request processed in 518us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.163649:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4974 00000100:00100000:3.0:1788361757.163675:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1487 00000100:00100000:1.0:1788361757.163675:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:73616:x1875230407092096:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.163683:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.163688:0:26162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.163699:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163708:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361757.163710:0:26162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe4f04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113b7 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163715:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163751:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163766:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361757.163769:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.163773:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163779:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4ee8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163805:0:66901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163811:0:66901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163817:0:66901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163874:0:66901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.163879:0:66901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163886:0:66901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.163892:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78b:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:2.0:1788361757.163896:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff99d00720b000) 00010000:00010000:2.0:1788361757.163902:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.163905:0:66901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163912:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4eef lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.163915:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:1.0:1788361757.163923:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361757.163933:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe4f04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113b7 expref: 30 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.163966:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4ed3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113a9 expref: 117 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.163968:0:26162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe4f04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113b7 expref: 30 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.164010:0:26162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4000, rc 0) 00010000:00010000:2.0:1788361757.164016:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe4ef6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113a9 expref: 116 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1788361757.164019:0:26162:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d4a80 x1875230407092096/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788361757.164054:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:2.0:1788361757.164060:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361757.164063:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030000, rc 0) 00000100:00100000:1.0:1788361757.164090:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:73616:x1875230407092096:12345-192.168.204.35@tcp:101:dd.0 Request processed in 421us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.164100:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4974 00000100:00100000:2.0:1788361757.164113:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+116:73619:x1875230407091712:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1059us (1363us total) trans 124554051702 rc 0/0 00000100:00100000:2.0:1788361757.164123:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1486 00000100:00100000:0.0:1788361757.165971:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.166007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.166038:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407092352 00000100:00100000:0.0:1788361757.166044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.166073:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407092352 00000100:00100000:1.0:1788361757.166093:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407092608 00000100:00100000:0.0:1788361757.166100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.166104:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407092608 00000100:00100000:2.0:1788361757.166148:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407092736 00000100:00100000:0.0:1788361757.166154:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407092992 00000100:00100000:2.0:1788361757.166155:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407092736 00000100:00100000:0.0:1788361757.166163:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407092992 00000100:00100000:1.0:1788361757.166164:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 276 00000100:00100000:1.0:1788361757.166182:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+119:73617:x1875230407092608:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:2.0:1788361757.166209:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1488 00000100:00100000:2.0:1788361757.166221:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+119:73618:x1875230407092352:12345-192.168.204.35@tcp:36:dd.0 00000100:00100000:0.0:1788361757.166254:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1489 00000100:00100000:0.0:1788361757.166269:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+119:73619:x1875230407092736:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.166274:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361757.166284:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.166304:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4f0b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113be expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.166308:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad200/0x1b69fa8920fe4eb7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71139b expref: 119 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.166331:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1490 00000100:00100000:3.0:1788361757.166353:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+120:73621:x1875230407092992:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.166362:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.166375:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:3.0:1788361757.166376:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4f19 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113c5 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.166376:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4f12 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.166391:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361757.166400:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4f12 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.166413:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4f12 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.166472:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+121:73617:x1875230407092608:12345-192.168.204.35@tcp:35:dd.0 Request processed in 297us (463us total) trans 124554051703 rc 0/0 00000100:00100000:1.0:1788361757.166482:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 276 00010000:00010000:0.0:1788361757.166491:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4f0b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113be expref: 122 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166498:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.166506:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08a00/0x1b69fa8920fe4f12 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113be expref: 120 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166507:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.166515:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:3.0:1788361757.166517:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.166518:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361757.166522:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c08a00, rc 0) 00010000:00010000:3.0:1788361757.166532:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166539:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166547:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.166557:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+121:73619:x1875230407092736:12345-192.168.204.35@tcp:101:dd.0 Request processed in 294us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.166574:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1489 00010000:00010000:2.0:1788361757.166578:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166594:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe4f35 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.166595:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.166634:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166635:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe4f35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166663:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe4f35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361757.166686:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00000001:00080000:2.0:1788361757.166705:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051704 00000004:00010000:2.0:1788361757.166739:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df3080cc reply state 0000000088fcaa3a transno 124554051705 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.166757:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.166768:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788361757.166777:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:2.0:1788361757.166783:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361757.166802:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361757.166805:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166817:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.166898:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407093120 00000100:00100000:0.0:1788361757.166905:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407093120 00002000:00010000:0.0:1788361757.166935:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00010000:00010000:3.0:1788361757.166936:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.166944:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+123:73618:x1875230407092352:12345-192.168.204.35@tcp:36:dd.0 Request processed in 717us (970us total) trans 124554051705 rc 0/0 00002000:00100000:0.0:1788361757.166945:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe3100 with x1875230407093120 ext(0->18446744073709551615) 00010000:00010000:3.0:1788361757.166947:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.166954:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309c00 already unused, calling callback (ffffffffc18294f0) 00002000:00010000:0.0:1788361757.166958:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe3100. 00010000:00010000:3.0:1788361757.166962:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.166976:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1488 00010000:00010000:3.0:1788361757.166979:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361757.166983:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.166990:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 613 00010000:00010000:3.0:1788361757.167000:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361757.167003:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788361757.167003:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2409:x1875230407093120:12345-192.168.204.35@tcp:10:dd.0 00010000:00010000:3.0:1788361757.167008:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167014:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309c00/0x1b69fa8920fe4f20 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167030:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167103:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167108:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.167110:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1788361757.167114:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458c600 already unused, calling callback (ffffffffc18294f0) 00002000:00010000:0.0:1788361757.167114:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00010000:00010000:3.0:1788361757.167117:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.167117:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:0.0:1788361757.167120:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.167122:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1788361757.167124:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788361757.167130:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe3100 x1875230407093120/t4294968786(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788361757.167131:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff99d13a135500) 00010000:00010000:3.0:1788361757.167134:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.167137:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167143:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458c600/0x1b69fa8920fe4f27 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.167172:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+31:2409:x1875230407093120:12345-192.168.204.35@tcp:10:dd.0 Request processed in 174us (422us total) trans 4294968786 rc 0/0 00000100:00100000:0.0:1788361757.167179:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 613 00002000:00010000:0.0:1788361757.167182:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.167184:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe3100 with x1875230407093120 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.167189:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe3100. 00010000:00010000:3.0:1788361757.167240:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004309400/0x1b69fa8920fe4f19 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113c5 expref: 123 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167256:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe4f35 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113c5 expref: 122 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.167264:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:3.0:1788361757.167267:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361757.167276:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458ce00, rc 0) 00000100:00100000:3.0:1788361757.167308:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+122:73621:x1875230407092992:12345-192.168.204.35@tcp:101:dd.0 Request processed in 962us (1208us total) trans 124554051706 rc 0/0 00000100:00100000:3.0:1788361757.167315:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1490 00000100:00100000:0.0:1788361757.168669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.168717:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407093376 00000100:00100000:1.0:1788361757.168724:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407093376 00000100:00100000:1.0:1788361757.168765:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1491 00000100:00100000:1.0:1788361757.168773:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+122:73619:x1875230407093376:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:1.0:1788361757.168851:0:66126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361757.168872:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030000/0x1b69fa8920fe4ef6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113a9 expref: 122 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.168905:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:1.0:1788361757.168910:0:66126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361757.169038:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169049:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169057:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361757.169093:0:66126:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051707 00000004:00010000:1.0:1788361757.169113:0:66126:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e83c1f0 reply state 00000000bcaef002 transno 124554051708 ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169124:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.169126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:1.0:1788361757.169135:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:1.0:1788361757.169138:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788361757.169140:0:66126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361757.169209:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+124:73619:x1875230407093376:12345-192.168.204.35@tcp:36:dd.0 Request processed in 436us (542us total) trans 124554051708 rc 0/0 00000100:00100000:1.0:1788361757.169215:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1491 00000020:00080000:1.0:1788361757.169218:0:66126:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361757.169328:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407093504 00000100:00100000:1.0:1788361757.169334:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407093504 00000100:00100000:1.0:1788361757.169361:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1492 00000100:00100000:1.0:1788361757.169366:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+124:73621:x1875230407093504:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.169379:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.169398:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4f4a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113cc expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169413:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4a00/0x1b69fa8920fe4f51 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169419:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4a00/0x1b69fa8920fe4f51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169425:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4a00/0x1b69fa8920fe4f51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169480:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4f4a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113cc expref: 126 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169489:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db4a00/0x1b69fa8920fe4f51 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113cc expref: 125 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.169495:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:1.0:1788361757.169506:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361757.169508:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4a00, rc 0) 00000100:00100000:1.0:1788361757.169532:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+125:73621:x1875230407093504:12345-192.168.204.35@tcp:101:dd.0 Request processed in 166us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.169536:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1492 00000100:00100000:3.0:1788361757.169939:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.169985:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407093760 00000100:00100000:2.0:1788361757.169992:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407093760 00000100:00100000:2.0:1788361757.170029:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1493 00000100:00100000:2.0:1788361757.170038:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+125:73622:x1875230407093760:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.170049:0:66128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.170061:0:66128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4f58 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113d3 expref: -99 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170226:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170237:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170247:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170263:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170272:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170280:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.170290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788361757.170331:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4f6d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170352:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4f6d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.170360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788361757.170365:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4f6d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361757.170379:0:66128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00000100:00100000:3.0:1788361757.170558:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407093888 00000100:00100000:1.0:1788361757.170560:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094016 00000100:00100000:3.0:1788361757.170564:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407093888 00010000:00010000:2.0:1788361757.170566:0:66128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.170567:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094016 00010000:00010000:2.0:1788361757.170577:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170585:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170592:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170598:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.170602:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170611:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170621:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:2.0:1788361757.170624:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.170628:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170634:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031400/0x1b69fa8920fe4f5f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.170648:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4975 00010000:00010000:2.0:1788361757.170657:0:66128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.170659:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:73618:x1875230407093888:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.170671:0:66128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.170675:0:26160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.170679:0:66128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170685:0:66128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031a00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361757.170688:0:66128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170695:0:66128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.170700:0:26160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc82d920/0x1b69fa8920fe4f7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113da expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170705:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff99d00720b000) 00010000:00010000:2.0:1788361757.170712:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361757.170717:0:66128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170724:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031a00/0x1b69fa8920fe4f66 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.170727:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78d:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00000100:00100000:1.0:1788361757.170737:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4976 00010000:00010000:3.0:1788361757.170744:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=2797s v=(0 0) 00000100:00100000:1.0:1788361757.170750:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:73619:x1875230407094016:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.170761:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361757.170764:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031600/0x1b69fa8920fe4f58 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113d3 expref: 128 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.170768:0:26167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.170773:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc82d920/0x1b69fa8920fe4f7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113da expref: 33 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.170781:0:26167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4f82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113e1 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.170804:0:26160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc82d920/0x1b69fa8920fe4f7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113da expref: 33 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.170814:0:66128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4f6d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113d3 expref: 127 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.170814:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78e:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:1.0:1788361757.170854:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:2.0:1788361757.170858:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:1.0:1788361757.170860:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361757.170863:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361757.170867:0:66128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030400, rc 0) 00010000:00010000:1.0:1788361757.170870:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4f82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113e1 expref: 34 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.170896:0:26167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4f82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113e1 expref: 34 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.170908:0:26167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db4400, rc 0) 00010000:00000080:1.0:1788361757.170916:0:26167:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe1500 x1875230407094016/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.170921:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+127:73622:x1875230407093760:12345-192.168.204.35@tcp:101:dd.0 Request processed in 881us (979us total) trans 124554051709 rc 0/0 00000100:00100000:2.0:1788361757.170936:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1493 00010000:00010000:3.0:1788361757.170937:0:26160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c400, rc 0) 00010000:00000080:3.0:1788361757.170945:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe2d80 x1875230407093888/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.170955:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:73619:x1875230407094016:12345-192.168.204.35@tcp:101:dd.0 Request processed in 207us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.170972:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4976 00000100:00100000:3.0:1788361757.170997:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:73618:x1875230407093888:12345-192.168.204.35@tcp:101:dd.0 Request processed in 339us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.171000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.171009:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4975 00000100:00100000:2.0:1788361757.171095:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094272 00000100:00100000:2.0:1788361757.171100:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094272 00000100:00100000:2.0:1788361757.171137:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1494 00000100:00100000:2.0:1788361757.171144:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+127:73621:x1875230407094272:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:2.0:1788361757.171171:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361757.171184:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ce00/0x1b69fa8920fe4f35 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113c5 expref: 127 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.171196:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:2.0:1788361757.171200:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361757.171292:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.171303:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.171311:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.171334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000001:00080000:2.0:1788361757.171351:0:66128:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051710 00000100:00100000:3.0:1788361757.171371:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094528 00000100:00100000:3.0:1788361757.171376:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094528 00000004:00010000:2.0:1788361757.171382:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053ebf206 reply state 00000000a30023a0 transno 124554051711 ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.171395:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.171403:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:2.0:1788361757.171406:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361757.171409:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.171410:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 277 00000100:00100000:3.0:1788361757.171421:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+129:73616:x1875230407094528:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:2.0:1788361757.171483:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+130:73621:x1875230407094272:12345-192.168.204.35@tcp:36:dd.0 Request processed in 338us (484us total) trans 124554051711 rc 0/0 00000100:00100000:2.0:1788361757.171490:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1494 00000020:00080000:2.0:1788361757.171494:0:66128:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361757.171769:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+130:73616:x1875230407094528:12345-192.168.204.35@tcp:35:dd.0 Request processed in 349us (435us total) trans 124554051712 rc 0/0 00000100:00100000:3.0:1788361757.171776:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 277 00000100:00100000:1.0:1788361757.172550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.172595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.172595:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094656 00000100:00100000:0.0:1788361757.172601:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094656 00002000:00010000:0.0:1788361757.172621:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.172625:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a08380 with x1875230407094656 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.172631:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a08380. 00000100:00100000:0.0:1788361757.172644:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094784 00000100:00100000:0.0:1788361757.172646:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094784 00002000:00010000:0.0:1788361757.172652:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.172654:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a0aa00 with x1875230407094784 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.172657:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a0aa00. 00000100:00100000:1.0:1788361757.172662:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 614 00000100:00100000:1.0:1788361757.172675:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2410:x1875230407094656:12345-192.168.204.35@tcp:10:dd.0 00000100:00100000:0.0:1788361757.172717:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 615 00000100:00100000:0.0:1788361757.172723:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2411:x1875230407094784:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:1.0:1788361757.172818:0:24837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.172855:0:24837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.172858:0:24837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.172861:0:24837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.172863:0:24837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.172873:0:24837:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a08380 x1875230407094656/t4294968787(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1788361757.172880:0:24841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788361757.172885:0:24841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.172888:0:24841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:0.0:1788361757.172890:0:24841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.172893:0:24841:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788361757.172902:0:24841:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a0aa00 x1875230407094784/t4294968788(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.172919:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:2410:x1875230407094656:12345-192.168.204.35@tcp:10:dd.0 Request processed in 246us (371us total) trans 4294968787 rc 0/0 00000100:00100000:1.0:1788361757.172928:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 614 00002000:00010000:1.0:1788361757.172932:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00000100:00100000:0.0:1788361757.172935:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:2411:x1875230407094784:12345-192.168.204.35@tcp:10:dd.0 Request processed in 210us (339us total) trans 4294968788 rc 0/0 00002000:00100000:1.0:1788361757.172937:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a08380 with x1875230407094656 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.172947:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a08380. 00000100:00100000:0.0:1788361757.172948:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 615 00002000:00010000:0.0:1788361757.172956:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.172959:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a0aa00 with x1875230407094784 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.172966:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a0aa00. 00000100:00100000:2.0:1788361757.173280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.173371:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094912 00000100:00100000:0.0:1788361757.173384:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094912 00000100:00100000:0.0:1788361757.173424:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1495 00000100:00100000:1.0:1788361757.173425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.173569:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407095040 00000100:00100000:3.0:1788361757.173574:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407095040 00000100:00100000:3.0:1788361757.173608:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4977 00000100:00100000:3.0:1788361757.173616:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:73621:x1875230407095040:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.173627:0:15123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.173643:0:15123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4f90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113ef expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.173669:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x790:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.173688:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.173696:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.173703:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4f90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113ef expref: 36 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.173718:0:15123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4f90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113ef expref: 36 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.173741:0:15123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458c600, rc 0) 00010000:00000080:3.0:1788361757.173748:0:15123:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a09500 x1875230407095040/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.173802:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:73621:x1875230407095040:12345-192.168.204.35@tcp:101:dd.0 Request processed in 187us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.173810:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4977 00000100:00100000:0.0:1788361757.173977:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+130:73622:x1875230407094912:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788361757.173990:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361757.174003:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4f97 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113e8 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.174032:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4f9e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.174044:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4f9e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.174055:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4f9e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.174164:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09c00/0x1b69fa8920fe4f97 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113e8 expref: 132 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.174180:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09a00/0x1b69fa8920fe4f9e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113e8 expref: 131 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.174188:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:0.0:1788361757.174191:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361757.174194:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c09a00, rc 0) 00000100:00100000:0.0:1788361757.174224:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+131:73622:x1875230407094912:12345-192.168.204.35@tcp:101:dd.0 Request processed in 252us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.174230:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1495 00000100:00100000:1.0:1788361757.175622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.175657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.175681:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407095296 00000100:00100000:3.0:1788361757.175690:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407095296 00000100:00100000:2.0:1788361757.175694:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407095552 00000100:00100000:1.0:1788361757.175695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.175700:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407095552 00000100:00100000:2.0:1788361757.175738:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407095808 00000100:00100000:3.0:1788361757.175740:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1496 00000100:00100000:2.0:1788361757.175741:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407095808 00000100:00100000:0.0:1788361757.175753:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 278 00000100:00100000:3.0:1788361757.175765:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+133:73623:x1875230407095296:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:1.0:1788361757.175777:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 279 00000100:00100000:0.0:1788361757.175777:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+133:73619:x1875230407095552:12345-192.168.204.35@tcp:35:dd.0 00010000:00010000:3.0:1788361757.175794:0:66127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788361757.175803:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d108a2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+133:73618:x1875230407095808:12345-192.168.204.35@tcp:35:dd.0 00010000:00010000:3.0:1788361757.175812:0:66127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe4fa5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113f6 expref: -99 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.175953:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.175966:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.175977:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.175991:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.175999:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176013:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176063:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe4fba lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176072:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe4fba lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.176073:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d108a2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+136:73618:x1875230407095808:12345-192.168.204.35@tcp:35:dd.0 Request processed in 283us (376us total) trans 124554051714 rc 0/0 00010000:00010000:3.0:1788361757.176091:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe4fba lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.176092:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 279 00000004:00200000:3.0:1788361757.176107:0:66127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00000100:00100000:0.0:1788361757.176121:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+135:73619:x1875230407095552:12345-192.168.204.35@tcp:35:dd.0 Request processed in 348us (462us total) trans 124554051713 rc 0/0 00000100:00100000:0.0:1788361757.176130:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 278 00010000:00010000:3.0:1788361757.176173:0:66127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176184:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176191:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176198:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176204:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458d600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.176209:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176216:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176237:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:3.0:1788361757.176240:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.176245:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176252:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458d600/0x1b69fa8920fe4fac lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176332:0:66127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176339:0:66127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176343:0:66127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176348:0:66127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458dc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:3.0:1788361757.176351:0:66127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176356:0:66127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176365:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff99d13a135a00) 00010000:00010000:3.0:1788361757.176367:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361757.176371:0:66127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176377:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458dc00/0x1b69fa8920fe4fb3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176460:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe4fa5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113f6 expref: 136 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176474:0:66127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe4fba lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113f6 expref: 135 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.176482:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:3.0:1788361757.176485:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361757.176487:0:66127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458de00, rc 0) 00000100:00100000:3.0:1788361757.176521:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+135:73623:x1875230407095296:12345-192.168.204.35@tcp:101:dd.0 Request processed in 770us (902us total) trans 124554051715 rc 0/0 00000100:00100000:3.0:1788361757.176528:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1496 00000100:00100000:1.0:1788361757.177506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.177544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.177660:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407096192 00000100:00100000:2.0:1788361757.177669:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407096192 00000100:00100000:2.0:1788361757.177715:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1497 00000100:00100000:2.0:1788361757.177725:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+135:73622:x1875230407096192:12345-192.168.204.35@tcp:36:dd.0 00000100:00100000:0.0:1788361757.177820:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407095936 00000100:00100000:0.0:1788361757.177884:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407095936 00010000:00010000:2.0:1788361757.177893:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361757.177926:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030400/0x1b69fa8920fe4f6d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113d3 expref: 135 pid: 66128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.177944:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:2.0:1788361757.177949:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1788361757.177949:0:24840:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.177960:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a08a80 with x1875230407095936 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.177979:0:24840:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a08a80. 00000100:00100000:0.0:1788361757.178020:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 616 00000100:00100000:0.0:1788361757.178035:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:2410:x1875230407095936:12345-192.168.204.35@tcp:10:dd.0 00010000:00010000:2.0:1788361757.178091:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.178122:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.178132:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361757.178188:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051716 00000004:00010000:2.0:1788361757.178220:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e946c85 reply state 000000009ab9f440 transno 124554051717 ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.178234:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361757.178243:0:24840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1788361757.178244:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00002000:00010000:0.0:1788361757.178257:0:24840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00010000:00010000:2.0:1788361757.178258:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1788361757.178267:0:24840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00000100:00100000:2.0:1788361757.178268:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1788361757.178276:0:24840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:0.0:1788361757.178281:0:24840:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788361757.178299:0:24840:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d004a08a80 x1875230407095936/t4294968789(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.178359:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+137:73622:x1875230407096192:12345-192.168.204.35@tcp:36:dd.0 Request processed in 634us (811us total) trans 124554051717 rc 0/0 00000100:00100000:2.0:1788361757.178365:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1497 00000020:00080000:2.0:1788361757.178372:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.178382:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+37:2410:x1875230407095936:12345-192.168.204.35@tcp:10:dd.0 Request processed in 345us (870us total) trans 4294968789 rc 0/0 00000100:00100000:0.0:1788361757.178392:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 616 00002000:00010000:0.0:1788361757.178397:0:24840:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:0.0:1788361757.178400:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d004a08a80 with x1875230407095936 ext(0->18446744073709551615) 00002000:00010000:0.0:1788361757.178404:0:24840:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d004a08a80. 00000100:00100000:2.0:1788361757.179666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.179747:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407096320 00000100:00100000:1.0:1788361757.179770:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407096320 00000100:00100000:1.0:1788361757.179876:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1498 00000100:00100000:1.0:1788361757.179905:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+137:73623:x1875230407096320:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.179935:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.179958:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4fcf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae7113fd expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.179999:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4fd6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180015:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4fd6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180026:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4fd6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180138:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715d000/0x1b69fa8920fe4fcf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113fd expref: 139 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180161:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715c400/0x1b69fa8920fe4fd6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113fd expref: 138 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.180172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:1.0:1788361757.180177:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:1.0:1788361757.180183:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361757.180187:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d13715c400, rc 0) 00000100:00100000:1.0:1788361757.180247:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+138:73623:x1875230407096320:12345-192.168.204.35@tcp:101:dd.0 Request processed in 344us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.180256:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1498 00000100:00100000:2.0:1788361757.180310:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407096448 00000100:00100000:2.0:1788361757.180317:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407096448 00000100:00100000:3.0:1788361757.180343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.180365:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4978 00000100:00100000:2.0:1788361757.180374:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+37:73622:x1875230407096448:12345-192.168.204.35@tcp:101:dd.0 00000100:00100000:3.0:1788361757.180381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788361757.180391:0:26165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.180412:0:26165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4fdd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71140b expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.180437:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407096704 00000100:00100000:1.0:1788361757.180444:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407096704 00002000:00010000:2.0:1788361757.180456:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x791:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:2.0:1788361757.180481:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=2797s v=(0 0) 00000100:00100000:1.0:1788361757.180486:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1499 00010000:00010000:2.0:1788361757.180491:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361757.180503:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4fdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71140b expref: 38 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.180511:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+138:73624:x1875230407096704:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.180530:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.180539:0:26165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4fdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71140b expref: 38 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180545:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe4fe4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711404 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.180549:0:26165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1231bfe00, rc 0) 00010000:00000080:2.0:1788361757.180561:0:26165:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed7800 x1875230407096448/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.180617:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:73622:x1875230407096448:12345-192.168.204.35@tcp:101:dd.0 Request processed in 244us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.180624:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4978 00000100:00100000:2.0:1788361757.180655:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407096960 00000100:00100000:2.0:1788361757.180660:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407096960 00010000:00010000:1.0:1788361757.180689:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.180692:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 280 00010000:00010000:1.0:1788361757.180707:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.180708:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+140:73621:x1875230407096960:12345-192.168.204.35@tcp:35:dd.0 00010000:00010000:1.0:1788361757.180732:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180750:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180758:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180766:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180860:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4ff9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180869:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4ff9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180876:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4ff9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361757.180899:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:1.0:1788361757.180991:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.180997:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181002:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181007:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181015:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715dc00 already unused, calling callback (ffffffffc18294f0) 00000100:00100000:2.0:1788361757.181023:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+142:73621:x1875230407096960:12345-192.168.204.35@tcp:35:dd.0 Request processed in 315us (640us total) trans 124554051718 rc 0/0 00010000:00010000:1.0:1788361757.181024:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.181054:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 280 00010000:00010000:1.0:1788361757.181056:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181074:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:1.0:1788361757.181077:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361757.181082:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181089:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715dc00/0x1b69fa8920fe4feb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181102:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181119:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181125:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181130:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715ce00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:1.0:1788361757.181133:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181140:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181149:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff99d112cabc00) 00010000:00010000:1.0:1788361757.181151:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361757.181154:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181161:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715ce00/0x1b69fa8920fe4ff2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181203:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d13715da00/0x1b69fa8920fe4fe4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711404 expref: 142 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181216:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4ff9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711404 expref: 141 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.181224:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:1.0:1788361757.181226:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361757.181235:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d139db5600, rc 0) 00000100:00100000:1.0:1788361757.181273:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+141:73624:x1875230407096704:12345-192.168.204.35@tcp:101:dd.0 Request processed in 768us (932us total) trans 124554051719 rc 0/0 00000100:00100000:1.0:1788361757.181281:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1499 00000100:00100000:0.0:1788361757.181696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.181966:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407097216 00000100:00100000:3.0:1788361757.181974:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407097216 00000100:00100000:3.0:1788361757.182015:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1500 00000100:00100000:3.0:1788361757.182025:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+141:73623:x1875230407097216:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788361757.182064:0:66128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361757.182087:0:66128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe4fba lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113f6 expref: 141 pid: 66127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.182106:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:3.0:1788361757.182111:0:66128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.182247:0:66128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.182264:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.182277:0:66128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361757.182323:0:66128:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051720 00000004:00010000:3.0:1788361757.182341:0:66128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000470bb1c1 reply state 00000000f5019653 transno 124554051721 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.182352:0:66128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.182357:0:66128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:3.0:1788361757.182359:0:66128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.182362:0:66128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.182536:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+143:73623:x1875230407097216:12345-192.168.204.35@tcp:36:dd.0 Request processed in 512us (839us total) trans 124554051721 rc 0/0 00000100:00100000:3.0:1788361757.182543:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1500 00000020:00080000:3.0:1788361757.182548:0:66128:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.182664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.182863:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407097344 00000100:00100000:2.0:1788361757.182878:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407097344 00002000:00010000:2.0:1788361757.182905:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:2.0:1788361757.182909:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe1f80 with x1875230407097344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788361757.182919:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe1f80. 00000100:00100000:2.0:1788361757.182948:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 617 00000100:00100000:2.0:1788361757.182957:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2410:x1875230407097344:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:2.0:1788361757.183096:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788361757.183100:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:2.0:1788361757.183102:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:2.0:1788361757.183104:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:2.0:1788361757.183107:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788361757.183116:0:24842:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe1f80 x1875230407097344/t4294968790(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.183162:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2410:x1875230407097344:12345-192.168.204.35@tcp:10:dd.0 Request processed in 207us (501us total) trans 4294968790 rc 0/0 00000100:00100000:2.0:1788361757.183170:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 617 00002000:00010000:2.0:1788361757.183173:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:2.0:1788361757.183176:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe1f80 with x1875230407097344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788361757.183180:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe1f80. 00000100:00100000:1.0:1788361757.183305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.183340:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407097472 00000100:00100000:2.0:1788361757.183344:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407097472 00000100:00100000:2.0:1788361757.183383:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1501 00000100:00100000:1.0:1788361757.183392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.183396:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+143:73624:x1875230407097472:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.183417:0:66901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788361757.183423:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407097728 00000100:00100000:1.0:1788361757.183429:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407097728 00010000:00010000:2.0:1788361757.183440:0:66901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe500e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711412 expref: -99 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.183464:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1502 00000100:00100000:1.0:1788361757.183474:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+145:73626:x1875230407097728:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.183484:0:67579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.183499:0:67579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe5015 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711419 expref: -99 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.183520:0:66901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d005168400/0x1b69fa8920fe501c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.183535:0:66901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d005168400/0x1b69fa8920fe501c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.183545:0:66901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d005168400/0x1b69fa8920fe501c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.183664:0:66901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231be200/0x1b69fa8920fe500e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711412 expref: 147 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.183665:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.183686:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.183694:0:66901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d005168400/0x1b69fa8920fe501c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711412 expref: 146 pid: 66901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.183697:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.183715:0:66901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:2.0:1788361757.183720:0:66901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.183726:0:66901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d005168400, rc 0) 00010000:00010000:1.0:1788361757.183726:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.183737:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.183745:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361757.183760:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+146:73624:x1875230407097472:12345-192.168.204.35@tcp:101:dd.0 Request processed in 368us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.183770:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1501 00010000:00010000:0.0:1788361757.184008:0:67579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe5031 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184020:0:67579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe5031 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184030:0:67579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe5031 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361757.184042:0:67579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:0.0:1788361757.184132:0:67579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184141:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184149:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184157:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184165:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012eb000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.184170:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184179:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184192:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99d105584c00) 00010000:00010000:0.0:1788361757.184195:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.184201:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361757.184208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:0.0:1788361757.184220:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eb000/0x1b69fa8920fe5023 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184233:0:67579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184238:0:67579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184245:0:67579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184250:0:67579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1012ea600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:0.0:1788361757.184253:0:67579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184259:0:67579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184275:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff99d112cab400) 00010000:00010000:0.0:1788361757.184278:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361757.184281:0:67579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184288:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012ea600/0x1b69fa8920fe502a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361757.184333:0:67579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1012eaa00/0x1b69fa8920fe5015 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711419 expref: 147 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.184358:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407097856 00010000:00010000:0.0:1788361757.184361:0:67579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe5031 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711419 expref: 146 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.184365:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407097856 00010000:00010000:0.0:1788361757.184373:0:67579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:0.0:1788361757.184376:0:67579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361757.184379:0:67579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c08000, rc 0) 00000100:00100000:3.0:1788361757.184411:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4979 00000100:00100000:3.0:1788361757.184423:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:73623:x1875230407097856:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.184432:0:26169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.184455:0:26169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff359fd/0x1b69fa8920fe503f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711420 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361757.184478:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+146:73626:x1875230407097728:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1004us (1086us total) trans 124554051722 rc 0/0 00000100:00100000:0.0:1788361757.184487:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1502 00002000:00010000:3.0:1788361757.184538:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x792:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.184556:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.184563:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.184574:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff359fd/0x1b69fa8920fe503f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711420 expref: 40 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.184590:0:26169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bff359fd/0x1b69fa8920fe503f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711420 expref: 40 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.184604:0:26169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458dc00, rc 0) 00010000:00000080:3.0:1788361757.184613:0:26169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b58380 x1875230407097856/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.184651:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:73623:x1875230407097856:12345-192.168.204.35@tcp:101:dd.0 Request processed in 232us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.184658:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4979 00000100:00100000:1.0:1788361757.185592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.185646:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098112 00000100:00100000:2.0:1788361757.185656:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098112 00000100:00100000:2.0:1788361757.185707:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1503 00000100:00100000:2.0:1788361757.185717:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+146:73624:x1875230407098112:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:2.0:1788361757.185763:0:80345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361757.185800:0:80345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5600/0x1b69fa8920fe4ff9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711404 expref: 146 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.185847:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:2.0:1788361757.185853:0:80345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361757.186014:0:80345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.186028:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.186038:0:80345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361757.186100:0:80345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051723 00000004:00010000:2.0:1788361757.186126:0:80345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c52f11f3 reply state 00000000dceaef82 transno 124554051724 ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.186139:0:80345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.186147:0:80345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:2.0:1788361757.186149:0:80345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788361757.186153:0:80345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361757.186230:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+148:73624:x1875230407098112:12345-192.168.204.35@tcp:36:dd.0 Request processed in 514us (639us total) trans 124554051724 rc 0/0 00000100:00100000:2.0:1788361757.186238:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1503 00000020:00080000:2.0:1788361757.186243:0:80345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.186338:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.186442:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098368 00000100:00100000:2.0:1788361757.186447:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098368 00000100:00100000:2.0:1788361757.186477:0:81013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 281 00000100:00100000:2.0:1788361757.186482:0:81013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+148:73622:x1875230407098368:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:2.0:1788361757.186923:0:81013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+149:73622:x1875230407098368:12345-192.168.204.35@tcp:35:dd.0 Request processed in 439us (585us total) trans 124554051725 rc 0/0 00000100:00100000:2.0:1788361757.186932:0:81013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 281 00000100:00100000:1.0:1788361757.186942:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.186979:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098496 00000100:00100000:1.0:1788361757.186984:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098496 00000100:00100000:2.0:1788361757.187063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.187172:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098624 00000100:00100000:3.0:1788361757.187178:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098624 00002000:00010000:3.0:1788361757.187199:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:3.0:1788361757.187203:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d14109b480 with x1875230407098624 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.187212:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d14109b480. 00000100:00100000:3.0:1788361757.187236:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 618 00000100:00100000:3.0:1788361757.187244:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:2409:x1875230407098624:12345-192.168.204.35@tcp:10:dd.0 00000100:00100000:2.0:1788361757.187329:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1504 00000100:00100000:2.0:1788361757.187337:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+149:73626:x1875230407098496:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788361757.187345:0:66126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361757.187359:0:66126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d005168c00/0x1b69fa8920fe504d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711427 expref: -99 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.187386:0:66126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169e00/0x1b69fa8920fe5054 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.187398:0:66126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169e00/0x1b69fa8920fe5054 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361757.187407:0:66126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169e00/0x1b69fa8920fe5054 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.187422:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788361757.187427:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:3.0:1788361757.187437:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:3.0:1788361757.187439:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:3.0:1788361757.187442:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788361757.187453:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109b480 x1875230407098624/t4294968791(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.187473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788361757.187487:0:66126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d005168c00/0x1b69fa8920fe504d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711427 expref: 151 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361757.187496:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:2409:x1875230407098624:12345-192.168.204.35@tcp:10:dd.0 Request processed in 251us (430us total) trans 4294968791 rc 0/0 00000100:00100000:3.0:1788361757.187505:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 618 00010000:00010000:2.0:1788361757.187508:0:66126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169e00/0x1b69fa8920fe5054 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711427 expref: 150 pid: 66126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.187510:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:3.0:1788361757.187517:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d14109b480 with x1875230407098624 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361757.187526:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d14109b480. 00010000:00010000:2.0:1788361757.187526:0:66126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:2.0:1788361757.187531:0:66126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361757.187541:0:66126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d005169e00, rc 0) 00000100:00100000:2.0:1788361757.187570:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+150:73626:x1875230407098496:12345-192.168.204.35@tcp:101:dd.0 Request processed in 233us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.187577:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1504 00000100:00100000:1.0:1788361757.187616:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098752 00000100:00100000:1.0:1788361757.187622:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098752 00000100:00100000:1.0:1788361757.187665:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4980 00000100:00100000:1.0:1788361757.187674:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:73624:x1875230407098752:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788361757.187681:0:26172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361757.187692:0:26172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe505b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae71142e expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361757.187706:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x793:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:1.0:1788361757.187719:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:1.0:1788361757.187724:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361757.187733:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe505b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71142e expref: 42 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.187749:0:26172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe505b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71142e expref: 42 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361757.187765:0:26172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea200, rc 0) 00010000:00000080:1.0:1788361757.187770:0:26172:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe3800 x1875230407098752/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.187879:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:73624:x1875230407098752:12345-192.168.204.35@tcp:101:dd.0 Request processed in 206us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.187886:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4980 00000100:00100000:3.0:1788361757.189396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.189556:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098880 00000100:00100000:1.0:1788361757.189561:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098880 00002000:00010000:1.0:1788361757.189583:0:8445:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.189586:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed6300 with x1875230407098880 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.189593:0:8445:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed6300. 00000100:00100000:1.0:1788361757.189628:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 619 00000100:00100000:1.0:1788361757.189638:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:2409:x1875230407098880:12345-192.168.204.35@tcp:10:dd.0 00000100:00100000:3.0:1788361757.189748:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00010000:1.0:1788361757.189759:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.189763:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.189765:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.189768:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.189770:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.189778:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed6300 x1875230407098880/t4294968792(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.189862:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:2409:x1875230407098880:12345-192.168.204.35@tcp:10:dd.0 Request processed in 225us (469us total) trans 4294968792 rc 0/0 00000100:00100000:1.0:1788361757.189871:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 619 00002000:00010000:1.0:1788361757.189874:0:8445:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.189877:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed6300 with x1875230407098880 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.189882:0:8445:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed6300. 00000100:00100000:2.0:1788361757.189974:0:66129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407099136 00000100:00100000:2.0:1788361757.189979:0:66129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407099136 00000100:00100000:2.0:1788361757.190012:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 282 00000100:00100000:2.0:1788361757.190020:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+150:73623:x1875230407099136:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:3.0:1788361757.190050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.190073:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407099392 00000100:00100000:3.0:1788361757.190078:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407099392 00000100:00100000:3.0:1788361757.190189:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1505 00000100:00100000:3.0:1788361757.190199:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+152:73626:x1875230407099392:12345-192.168.204.35@tcp:36:dd.0 00000100:00100000:2.0:1788361757.190225:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+152:73623:x1875230407099136:12345-192.168.204.35@tcp:35:dd.0 Request processed in 204us (544us total) trans 124554051726 rc 0/0 00010000:00010000:3.0:1788361757.190227:0:66127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361757.190235:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 282 00010000:00010000:3.0:1788361757.190252:0:66127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c08000/0x1b69fa8920fe5031 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711419 expref: 151 pid: 67579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.190268:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:3.0:1788361757.190273:0:66127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361757.190533:0:66127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.190561:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.190570:0:66127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361757.190605:0:66127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051727 00000004:00010000:3.0:1788361757.190625:0:66127:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b029d4bc reply state 0000000007a11ed3 transno 124554051728 ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.190637:0:66127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.190644:0:66127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:3.0:1788361757.190646:0:66127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788361757.190649:0:66127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361757.190899:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+153:73626:x1875230407099392:12345-192.168.204.35@tcp:36:dd.0 Request processed in 701us (849us total) trans 124554051728 rc 0/0 00000100:00100000:3.0:1788361757.190908:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1505 00000020:00080000:3.0:1788361757.190913:0:66127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361757.191607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.191736:0:81013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407099648 00000100:00100000:2.0:1788361757.191750:0:81013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407099648 00000100:00100000:1.0:1788361757.191865:0:66129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 283 00000100:00100000:1.0:1788361757.191889:0:66129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+153:73624:x1875230407099648:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:1.0:1788361757.192023:0:66129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+154:73624:x1875230407099648:12345-192.168.204.35@tcp:35:dd.0 Request processed in 142us (418us total) trans 124554051729 rc 0/0 00000100:00100000:1.0:1788361757.192028:0:66129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 283 00000100:00100000:2.0:1788361757.192525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.192599:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407099776 00000100:00100000:3.0:1788361757.192607:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407099776 00000100:00100000:3.0:1788361757.192649:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4981 00000100:00100000:3.0:1788361757.192658:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:73626:x1875230407099776:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788361757.192670:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361757.192690:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe5069 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeb09878fae711435 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361757.192714:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x795:0x0] initial LVB size: 0, mtime: 0x6a983c17, atime: 0x6a983c17, ctime: 0x6a983c17, blocks: 0x0 00010000:00010000:3.0:1788361757.192740:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=2797s v=(0 0) 00010000:00010000:3.0:1788361757.192746:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361757.192754:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe5069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711435 expref: 44 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.192770:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe5069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711435 expref: 44 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361757.192782:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d00458d600, rc 0) 00010000:00000080:3.0:1788361757.192803:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109b800 x1875230407099776/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 328/400 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.193015:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:73626:x1875230407099776:12345-192.168.204.35@tcp:101:dd.0 Request processed in 358us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.193022:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4981 00000100:00100000:2.0:1788361757.195764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.195864:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407099904 00000100:00100000:1.0:1788361757.195872:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407099904 00002000:00010000:1.0:1788361757.195914:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.195919:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d14109ad80 with x1875230407099904 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.195931:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d14109ad80. 00000100:00100000:1.0:1788361757.195956:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 620 00000100:00100000:1.0:1788361757.195970:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:2409:x1875230407099904:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:1.0:1788361757.196097:0:24837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361757.196100:0:24837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb mtime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.196102:0:24837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb atime from disk: 1788361751 -> 1788361751 00002000:00010000:1.0:1788361757.196104:0:24837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb ctime from disk: 1788361751 -> 1788361756 00002000:00010000:1.0:1788361757.196105:0:24837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788361757.196111:0:24837:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109ad80 x1875230407099904/t4294968793(0) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.196167:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2409:x1875230407099904:12345-192.168.204.35@tcp:10:dd.0 Request processed in 197us (412us total) trans 4294968793 rc 0/0 00000100:00100000:1.0:1788361757.196174:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 620 00002000:00010000:1.0:1788361757.196178:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:1.0:1788361757.196181:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d14109ad80 with x1875230407099904 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361757.196186:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d14109ad80. 00000100:00100000:0.0:1788361757.199102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.199180:0:66130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100160 00000100:00100000:1.0:1788361757.199219:0:66130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100160 00000100:00100000:1.0:1788361757.199279:0:66130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 284 00000100:00100000:1.0:1788361757.199289:0:66130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+154:73626:x1875230407100160:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:1.0:1788361757.199622:0:66130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+155:73626:x1875230407100160:12345-192.168.204.35@tcp:35:dd.0 Request processed in 333us (542us total) trans 124554051730 rc 0/0 00000100:00100000:1.0:1788361757.199630:0:66130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 284 00000100:00100000:1.0:1788361757.526089:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361757.526115:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429914624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788361757.526192:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361757.526243:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914624 00000100:00100000:2.0:1788361757.526253:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914624 00000100:00100000:2.0:1788361757.526312:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4233 00000100:00100000:2.0:1788361757.526324:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429914624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788361757.526361:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1788361757.526431:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429914624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.526440:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4233 00000100:00100000:0.0:1788361757.526542:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d12cfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429914624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788361757.575801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.575802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.575861:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100416 00000100:00100000:1.0:1788361757.575872:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100416 00000100:00100000:1.0:1788361757.575936:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4982 00000100:00100000:1.0:1788361757.575946:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2409:x1875230407100416:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:3.0:1788361757.576106:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100288 00000100:00100000:3.0:1788361757.576111:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100288 00002000:00100000:3.0:1788361757.576137:0:24839:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff99d12cfe2680 x1875230407100288/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.576148:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe2680 with x1875230407100288 ext(0->1023) 00002000:00010000:3.0:1788361757.576155:0:24839:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe2680 00000100:00100000:3.0:1788361757.576181:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 621 00000100:00100000:3.0:1788361757.576188:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+46:2409:x1875230407100288:12345-192.168.204.35@tcp:4:dd.0 00000001:00080000:2.0:1788361757.576222:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968793 is committed 00010000:00000080:2.0:1788361757.576299:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109a680 x1875230407100416/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.576353:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2409:x1875230407100416:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 409us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.576361:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4982 00010000:00000080:3.0:1788361757.577965:0:24839:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe2680 x1875230407100288/t4294968794(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.578019:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2409:x1875230407100288:12345-192.168.204.35@tcp:4:dd.0 Request processed in 1827us (2233us total) trans 4294968794 rc 0/0 00000100:00100000:3.0:1788361757.578030:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 621 00002000:00100000:3.0:1788361757.578040:0:24839:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff99d12cfe2680 x1875230407100288/t4294968794(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.578056:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe2680 with x1875230407100288 ext(0->1023) 00002000:00010000:3.0:1788361757.578062:0:24839:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe2680 00000100:00100000:2.0:1788361757.581119:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.581156:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100672 00000100:00100000:0.0:1788361757.581167:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100672 00000100:00100000:2.0:1788361757.581172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.581202:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100544 00000100:00100000:3.0:1788361757.581208:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100544 00000100:00100000:0.0:1788361757.581226:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4983 00000100:00100000:0.0:1788361757.581237:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:2410:x1875230407100672:12345-192.168.204.35@tcp:16:kworker.0 00002000:00100000:3.0:1788361757.581261:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff99d14109bb80 x1875230407100544/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.581273:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d14109bb80 with x1875230407100544 ext(0->1023) 00002000:00010000:3.0:1788361757.581279:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d14109bb80 00010000:00000080:0.0:1788361757.581289:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d141098e00 x1875230407100672/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.581302:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 622 00000100:00100000:3.0:1788361757.581312:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:2409:x1875230407100544:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:3.0:1788361757.581660:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d14109bb80 x1875230407100544/t4294968795(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.582025:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2409:x1875230407100544:12345-192.168.204.35@tcp:4:dd.0 Request processed in 713us (853us total) trans 4294968795 rc 0/0 00000100:00100000:3.0:1788361757.582037:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 622 00002000:00100000:3.0:1788361757.582046:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff99d14109bb80 x1875230407100544/t4294968795(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.582054:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d14109bb80 with x1875230407100544 ext(0->1023) 00002000:00010000:3.0:1788361757.582058:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d14109bb80 00000100:00100000:0.0:1788361757.582120:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2410:x1875230407100672:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 790us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.582131:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4983 00000100:00100000:2.0:1788361757.584295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.584334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.584375:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100800 00000100:00100000:0.0:1788361757.584385:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100800 00002000:00100000:0.0:1788361757.584426:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff99d141099c00 x1875230407100800/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.584438:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d141099c00 with x1875230407100800 ext(0->1023) 00002000:00010000:0.0:1788361757.584443:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d141099c00 00000100:00100000:0.0:1788361757.584469:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 623 00000100:00100000:0.0:1788361757.584478:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2412:x1875230407100800:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:3.0:1788361757.584670:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100928 00000100:00100000:3.0:1788361757.584675:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100928 00000100:00100000:3.0:1788361757.584705:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4984 00000100:00100000:3.0:1788361757.584713:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2412:x1875230407100928:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:3.0:1788361757.584754:0:26162:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d141098000 x1875230407100928/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.584818:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2412:x1875230407100928:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 105us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.584849:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4984 00010000:00000080:0.0:1788361757.585196:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d141099c00 x1875230407100800/t4294968796(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.585374:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+31:2412:x1875230407100800:12345-192.168.204.35@tcp:4:dd.0 Request processed in 895us (1086us total) trans 4294968796 rc 0/0 00000100:00100000:0.0:1788361757.585383:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 623 00002000:00100000:0.0:1788361757.585391:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff99d141099c00 x1875230407100800/t4294968796(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.585399:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d141099c00 with x1875230407100800 ext(0->1023) 00002000:00010000:0.0:1788361757.585403:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d141099c00 00000100:00100000:0.0:1788361757.586942:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.586977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.587007:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101056 00000100:00100000:1.0:1788361757.587011:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101184 00000100:00100000:0.0:1788361757.587015:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101056 00000100:00100000:1.0:1788361757.587018:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101184 00002000:00100000:0.0:1788361757.587052:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff99d12cfe3480 x1875230407101056/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.587062:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe3480 with x1875230407101056 ext(0->1023) 00002000:00010000:0.0:1788361757.587066:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe3480 00000100:00100000:0.0:1788361757.587094:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 624 00000100:00100000:0.0:1788361757.587102:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:2409:x1875230407101056:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:1.0:1788361757.587273:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4985 00000100:00100000:1.0:1788361757.587283:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:2410:x1875230407101184:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:1.0:1788361757.587315:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe0a80 x1875230407101184/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.587368:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2410:x1875230407101184:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 86us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.587377:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4985 00010000:00000080:0.0:1788361757.587382:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe3480 x1875230407101056/t4294968797(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.587412:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:2409:x1875230407101056:12345-192.168.204.35@tcp:4:dd.0 Request processed in 311us (436us total) trans 4294968797 rc 0/0 00000100:00100000:0.0:1788361757.587436:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 624 00002000:00100000:0.0:1788361757.587444:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff99d12cfe3480 x1875230407101056/t4294968797(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.587452:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe3480 with x1875230407101056 ext(0->1023) 00002000:00010000:0.0:1788361757.587456:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe3480 00000100:00100000:0.0:1788361757.589844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.589870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.589879:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101440 00000100:00100000:0.0:1788361757.589887:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101312 00000100:00100000:3.0:1788361757.589889:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101440 00000100:00100000:0.0:1788361757.589890:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101312 00002000:00100000:0.0:1788361757.589944:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff99d136b58000 x1875230407101312/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.589953:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4986 00002000:00100000:0.0:1788361757.589955:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b58000 with x1875230407101312 ext(0->1023) 00002000:00010000:0.0:1788361757.589961:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b58000 00000100:00100000:3.0:1788361757.589963:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2411:x1875230407101440:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:0.0:1788361757.589979:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 625 00000100:00100000:0.0:1788361757.589984:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2411:x1875230407101312:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:3.0:1788361757.590007:0:26159:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe1880 x1875230407101440/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.590058:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2411:x1875230407101440:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.590065:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4986 00010000:00000080:0.0:1788361757.590474:0:24841:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b58000 x1875230407101312/t4294968798(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.590553:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:2411:x1875230407101312:12345-192.168.204.35@tcp:4:dd.0 Request processed in 567us (685us total) trans 4294968798 rc 0/0 00000100:00100000:0.0:1788361757.590568:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 625 00002000:00100000:0.0:1788361757.590575:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff99d136b58000 x1875230407101312/t4294968798(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.590583:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b58000 with x1875230407101312 ext(0->1023) 00002000:00010000:0.0:1788361757.590587:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b58000 00000100:00100000:3.0:1788361757.592226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.592227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.592281:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101696 00000100:00100000:3.0:1788361757.592291:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101696 00000100:00100000:3.0:1788361757.592365:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4987 00000100:00100000:3.0:1788361757.592379:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:2410:x1875230407101696:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:3.0:1788361757.592456:0:15123:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed5f80 x1875230407101696/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.593472:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101568 00000100:00100000:1.0:1788361757.593484:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101568 00002000:00100000:1.0:1788361757.593531:0:24840:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff99d117281180 x1875230407101568/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.593553:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d117281180 with x1875230407101568 ext(0->1023) 00002000:00010000:1.0:1788361757.593560:0:24840:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d117281180 00000100:00100000:3.0:1788361757.593567:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:2410:x1875230407101696:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 1182us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.593582:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4987 00000100:00100000:1.0:1788361757.593601:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 626 00000100:00100000:1.0:1788361757.593616:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:2410:x1875230407101568:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:1.0:1788361757.594032:0:24840:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d117281180 x1875230407101568/t4294968799(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.594103:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+37:2410:x1875230407101568:12345-192.168.204.35@tcp:4:dd.0 Request processed in 492us (1903us total) trans 4294968799 rc 0/0 00000100:00100000:1.0:1788361757.594112:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 626 00002000:00100000:1.0:1788361757.594135:0:24840:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff99d117281180 x1875230407101568/t4294968799(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.594144:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d117281180 with x1875230407101568 ext(0->1023) 00002000:00010000:1.0:1788361757.594148:0:24840:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d117281180 00000100:00100000:2.0:1788361757.595394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.595443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.595450:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101824 00000100:00100000:3.0:1788361757.595459:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101824 00000100:00100000:2.0:1788361757.595471:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101952 00000100:00100000:2.0:1788361757.595476:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101952 00002000:00100000:3.0:1788361757.595502:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff99d117282300 x1875230407101824/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.595513:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4988 00002000:00100000:3.0:1788361757.595515:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d117282300 with x1875230407101824 ext(0->1023) 00002000:00010000:3.0:1788361757.595522:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d117282300 00000100:00100000:2.0:1788361757.595523:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2411:x1875230407101952:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:3.0:1788361757.595550:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 627 00000100:00100000:3.0:1788361757.595562:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2412:x1875230407101824:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:2.0:1788361757.595564:0:26165:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d117282680 x1875230407101952/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.595616:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2411:x1875230407101952:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.595623:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4988 00010000:00000080:3.0:1788361757.595940:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d117282300 x1875230407101824/t4294968800(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.596029:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2412:x1875230407101824:12345-192.168.204.35@tcp:4:dd.0 Request processed in 470us (638us total) trans 4294968800 rc 0/0 00000100:00100000:3.0:1788361757.596036:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 627 00002000:00100000:3.0:1788361757.596043:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff99d117282300 x1875230407101824/t4294968800(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.596051:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d117282300 with x1875230407101824 ext(0->1023) 00002000:00010000:3.0:1788361757.596055:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d117282300 00000100:00100000:0.0:1788361757.598168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.598209:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.598235:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102208 00000100:00100000:2.0:1788361757.598244:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102208 00000100:00100000:2.0:1788361757.598301:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4989 00000100:00100000:2.0:1788361757.598312:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2410:x1875230407102208:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:2.0:1788361757.598370:0:26169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe2300 x1875230407102208/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.598413:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2410:x1875230407102208:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.598421:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4989 00000100:00100000:0.0:1788361757.598469:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102080 00000100:00100000:0.0:1788361757.598474:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102080 00002000:00100000:0.0:1788361757.598497:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff99d136b5b100 x1875230407102080/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.598507:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b5b100 with x1875230407102080 ext(0->1023) 00002000:00010000:0.0:1788361757.598517:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b5b100 00000100:00100000:0.0:1788361757.598543:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 628 00000100:00100000:0.0:1788361757.598552:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2409:x1875230407102080:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:0.0:1788361757.598928:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b5b100 x1875230407102080/t4294968801(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.598971:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:2409:x1875230407102080:12345-192.168.204.35@tcp:4:dd.0 Request processed in 421us (767us total) trans 4294968801 rc 0/0 00000100:00100000:0.0:1788361757.598979:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 628 00002000:00100000:0.0:1788361757.598985:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff99d136b5b100 x1875230407102080/t4294968801(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.598993:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b5b100 with x1875230407102080 ext(0->1023) 00002000:00010000:0.0:1788361757.598996:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b5b100 00000100:00100000:3.0:1788361757.600612:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.600612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.600654:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102464 00000100:00100000:1.0:1788361757.600661:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102464 00000100:00100000:0.0:1788361757.600709:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102336 00000100:00100000:0.0:1788361757.600715:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102336 00000100:00100000:1.0:1788361757.600719:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4990 00000100:00100000:1.0:1788361757.600729:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:2411:x1875230407102464:12345-192.168.204.35@tcp:16:kworker.0 00002000:00100000:0.0:1788361757.600751:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff99d136ed4e00 x1875230407102336/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.600762:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed4e00 with x1875230407102336 ext(0->1023) 00002000:00010000:0.0:1788361757.600769:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed4e00 00010000:00000080:1.0:1788361757.600796:0:26172:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b5a680 x1875230407102464/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.600863:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:2411:x1875230407102464:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 135us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.600881:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4990 00000100:00100000:0.0:1788361757.601120:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 629 00000100:00100000:0.0:1788361757.601126:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:2411:x1875230407102336:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:0.0:1788361757.601438:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ed4e00 x1875230407102336/t4294968802(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.601485:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:2411:x1875230407102336:12345-192.168.204.35@tcp:4:dd.0 Request processed in 358us (883us total) trans 4294968802 rc 0/0 00000100:00100000:0.0:1788361757.601492:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 629 00002000:00100000:0.0:1788361757.601499:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff99d136ed4e00 x1875230407102336/t4294968802(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.601507:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136ed4e00 with x1875230407102336 ext(0->1023) 00002000:00010000:0.0:1788361757.601511:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136ed4e00 00000100:00100000:3.0:1788361757.603657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.603657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.603718:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102592 00000100:00100000:1.0:1788361757.603732:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102592 00000100:00100000:2.0:1788361757.603813:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102720 00000100:00100000:2.0:1788361757.603817:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102720 00000100:00100000:2.0:1788361757.603889:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4991 00000100:00100000:2.0:1788361757.603901:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:2412:x1875230407102720:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:2.0:1788361757.603949:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007352300 x1875230407102720/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.604005:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:2412:x1875230407102720:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.604013:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4991 00002000:00100000:1.0:1788361757.604479:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff99d12cfe0000 x1875230407102592/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.604490:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe0000 with x1875230407102592 ext(0->1023) 00002000:00010000:1.0:1788361757.604496:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe0000 00000100:00100000:1.0:1788361757.604527:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 630 00000100:00100000:1.0:1788361757.604536:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:2412:x1875230407102592:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:1.0:1788361757.605029:0:24837:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe0000 x1875230407102592/t4294968803(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.605080:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2412:x1875230407102592:12345-192.168.204.35@tcp:4:dd.0 Request processed in 545us (1436us total) trans 4294968803 rc 0/0 00000100:00100000:1.0:1788361757.605088:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 630 00002000:00100000:1.0:1788361757.605095:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff99d12cfe0000 x1875230407102592/t4294968803(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.605104:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe0000 with x1875230407102592 ext(0->1023) 00002000:00010000:1.0:1788361757.605108:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe0000 00000100:00100000:2.0:1788361757.607297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.607298:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.607374:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102976 00000100:00100000:1.0:1788361757.607382:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102976 00000100:00100000:1.0:1788361757.607437:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4992 00000100:00100000:1.0:1788361757.607449:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2409:x1875230407102976:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:1.0:1788361757.607499:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d117281c00 x1875230407102976/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.607617:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2409:x1875230407102976:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 171us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.607624:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4992 00000100:00100000:1.0:1788361757.607652:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102848 00000100:00100000:1.0:1788361757.607656:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102848 00002000:00100000:1.0:1788361757.607678:0:24839:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff99d007350e00 x1875230407102848/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.607686:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007350e00 with x1875230407102848 ext(0->1023) 00002000:00010000:1.0:1788361757.607691:0:24839:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007350e00 00000100:00100000:1.0:1788361757.607710:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 631 00000100:00100000:1.0:1788361757.607717:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2410:x1875230407102848:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:1.0:1788361757.608139:0:24839:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007350e00 x1875230407102848/t4294968804(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.608170:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+47:2410:x1875230407102848:12345-192.168.204.35@tcp:4:dd.0 Request processed in 452us (876us total) trans 4294968804 rc 0/0 00000100:00100000:1.0:1788361757.608178:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 631 00002000:00100000:1.0:1788361757.608185:0:24839:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff99d007350e00 x1875230407102848/t4294968804(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.608192:0:24839:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d007350e00 with x1875230407102848 ext(0->1023) 00002000:00010000:1.0:1788361757.608196:0:24839:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d007350e00 00000100:00100000:3.0:1788361757.610446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.610489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.610520:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103104 00000100:00100000:3.0:1788361757.610528:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103104 00002000:00100000:3.0:1788361757.610567:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff99d0038dca80 x1875230407103104/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.610590:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d0038dca80 with x1875230407103104 ext(0->1023) 00002000:00010000:3.0:1788361757.610595:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d0038dca80 00000100:00100000:3.0:1788361757.610621:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 632 00000100:00100000:3.0:1788361757.610630:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+47:2412:x1875230407103104:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:0.0:1788361757.610696:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103232 00000100:00100000:0.0:1788361757.610701:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103232 00000100:00100000:0.0:1788361757.610736:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4993 00000100:00100000:0.0:1788361757.610742:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+48:2411:x1875230407103232:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:0.0:1788361757.610769:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d007351180 x1875230407103232/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.610902:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d007351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+48:2411:x1875230407103232:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 158us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.610911:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4993 00010000:00000080:3.0:1788361757.610976:0:24842:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038dca80 x1875230407103104/t4294968805(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.611005:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+49:2412:x1875230407103104:12345-192.168.204.35@tcp:4:dd.0 Request processed in 376us (516us total) trans 4294968805 rc 0/0 00000100:00100000:3.0:1788361757.611012:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 632 00002000:00100000:3.0:1788361757.611018:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff99d0038dca80 x1875230407103104/t4294968805(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.611026:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d0038dca80 with x1875230407103104 ext(0->1023) 00002000:00010000:3.0:1788361757.611030:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d0038dca80 00000100:00100000:3.0:1788361757.613168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.613183:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.613215:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103360 00000100:00100000:0.0:1788361757.613224:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103360 00002000:00100000:0.0:1788361757.613260:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff99d117281880 x1875230407103360/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.613270:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d117281880 with x1875230407103360 ext(0->1023) 00002000:00010000:0.0:1788361757.613275:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d117281880 00000100:00100000:1.0:1788361757.613297:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103488 00000100:00100000:1.0:1788361757.613303:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103488 00000100:00100000:0.0:1788361757.613309:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 633 00000100:00100000:0.0:1788361757.613321:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2411:x1875230407103360:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:1.0:1788361757.613388:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4994 00000100:00100000:1.0:1788361757.613399:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2411:x1875230407103488:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:1.0:1788361757.613434:0:26167:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038ded80 x1875230407103488/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.613517:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2411:x1875230407103488:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.613525:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4994 00010000:00000080:0.0:1788361757.613606:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d117281880 x1875230407103360/t4294968806(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.613634:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407103360:12345-192.168.204.35@tcp:4:dd.0 Request processed in 317us (454us total) trans 4294968806 rc 0/0 00000100:00100000:0.0:1788361757.613639:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 633 00002000:00100000:0.0:1788361757.613644:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff99d117281880 x1875230407103360/t4294968806(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361757.613650:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d117281880 with x1875230407103360 ext(0->1023) 00002000:00010000:0.0:1788361757.613653:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d117281880 00000100:00100000:0.0:1788361757.616079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.616122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.616125:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103616 00000100:00100000:1.0:1788361757.616134:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103616 00000100:00100000:0.0:1788361757.616162:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103744 00000100:00100000:0.0:1788361757.616172:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103744 00002000:00100000:1.0:1788361757.616174:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff99d12cfe2a00 x1875230407103616/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.616186:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe2a00 with x1875230407103616 ext(0->1023) 00002000:00010000:1.0:1788361757.616192:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe2a00 00000100:00100000:0.0:1788361757.616205:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4995 00000100:00100000:1.0:1788361757.616220:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 634 00000100:00100000:0.0:1788361757.616221:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2412:x1875230407103744:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:1.0:1788361757.616244:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2412:x1875230407103616:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:0.0:1788361757.616263:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1411d5880 x1875230407103744/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361757.616312:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1411d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2412:x1875230407103744:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 99us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361757.616318:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4995 00010000:00000080:1.0:1788361757.616577:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d12cfe2a00 x1875230407103616/t4294968807(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.616607:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+53:2412:x1875230407103616:12345-192.168.204.35@tcp:4:dd.0 Request processed in 379us (533us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1788361757.616615:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 634 00002000:00100000:1.0:1788361757.616622:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff99d12cfe2a00 x1875230407103616/t4294968807(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.616631:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d12cfe2a00 with x1875230407103616 ext(0->1023) 00002000:00010000:1.0:1788361757.616635:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d12cfe2a00 00000100:00100000:0.0:1788361757.619251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.619300:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103872 00000100:00100000:2.0:1788361757.619308:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103872 00002000:00100000:2.0:1788361757.619346:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff99d1172c2a00 x1875230407103872/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361757.619357:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1172c2a00 with x1875230407103872 ext(0->1023) 00002000:00010000:2.0:1788361757.619361:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d1172c2a00 00000100:00100000:2.0:1788361757.619388:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 635 00000100:00100000:2.0:1788361757.619397:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1172c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+53:2409:x1875230407103872:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:2.0:1788361757.619694:0:24841:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d1172c2a00 x1875230407103872/t4294968808(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.619815:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1172c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+55:2409:x1875230407103872:12345-192.168.204.35@tcp:4:dd.0 Request processed in 418us (581us total) trans 4294968808 rc 0/0 00000100:00100000:2.0:1788361757.619846:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 635 00002000:00100000:2.0:1788361757.619854:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff99d1172c2a00 x1875230407103872/t4294968808(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361757.619869:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d1172c2a00 with x1875230407103872 ext(0->1023) 00000100:00100000:0.0:1788361757.619869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00010000:2.0:1788361757.619875:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d1172c2a00 00000100:00100000:1.0:1788361757.619943:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104000 00000100:00100000:1.0:1788361757.619947:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104000 00000100:00100000:1.0:1788361757.619992:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4996 00000100:00100000:1.0:1788361757.620001:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+55:2409:x1875230407104000:12345-192.168.204.35@tcp:16:kworker.0 00000001:00080000:0.0:1788361757.620688:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968808 is committed 00010000:00000080:3.0:1788361757.621047:0:8535:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ef1500 x1875230407104000/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.621101:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2409:x1875230407104000:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 1101us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361757.621109:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4996 00000100:00100000:3.0:1788361757.623797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361757.623797:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.623885:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104128 00000100:00100000:1.0:1788361757.623894:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104128 00002000:00100000:1.0:1788361757.623938:0:24840:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff99d0038dea00 x1875230407104128/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.623949:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d0038dea00 with x1875230407104128 ext(0->1023) 00002000:00010000:1.0:1788361757.623955:0:24840:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d0038dea00 00000100:00100000:1.0:1788361757.623985:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 636 00000100:00100000:1.0:1788361757.623994:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2412:x1875230407104128:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:1.0:1788361757.624342:0:24840:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038dea00 x1875230407104128/t4294968809(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.624406:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2412:x1875230407104128:12345-192.168.204.35@tcp:4:dd.0 Request processed in 412us (626us total) trans 4294968809 rc 0/0 00000100:00100000:1.0:1788361757.624414:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 636 00002000:00100000:1.0:1788361757.624420:0:24840:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff99d0038dea00 x1875230407104128/t4294968809(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.624429:0:24840:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d0038dea00 with x1875230407104128 ext(0->1023) 00002000:00010000:1.0:1788361757.624432:0:24840:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d0038dea00 00000100:00100000:1.0:1788361757.624455:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104256 00000100:00100000:1.0:1788361757.624459:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104256 00000100:00100000:1.0:1788361757.624490:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4997 00000100:00100000:1.0:1788361757.624497:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2411:x1875230407104256:12345-192.168.204.35@tcp:16:kworker.0 00000001:00080000:3.0:1788361757.625024:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968809 is committed 00010000:00000080:1.0:1788361757.625082:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136ef1f80 x1875230407104256/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.625131:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2411:x1875230407104256:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 634us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.625138:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4997 00000100:00100000:1.0:1788361757.627303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.627347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.627389:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104512 00000100:00100000:2.0:1788361757.627399:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104512 00000100:00100000:2.0:1788361757.627449:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4998 00000100:00100000:2.0:1788361757.627460:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2411:x1875230407104512:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:2.0:1788361757.627509:0:26171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b59180 x1875230407104512/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.627560:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2411:x1875230407104512:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.627568:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4998 00000100:00100000:3.0:1788361757.627669:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104384 00000100:00100000:3.0:1788361757.627675:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104384 00002000:00100000:3.0:1788361757.627709:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff99d136b5b800 x1875230407104384/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.627719:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b5b800 with x1875230407104384 ext(0->1023) 00002000:00010000:3.0:1788361757.627725:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b5b800 00000100:00100000:3.0:1788361757.627754:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 637 00000100:00100000:3.0:1788361757.627761:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2412:x1875230407104384:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:3.0:1788361757.628254:0:24842:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b5b800 x1875230407104384/t4294968810(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361757.628301:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2412:x1875230407104384:12345-192.168.204.35@tcp:4:dd.0 Request processed in 540us (954us total) trans 4294968810 rc 0/0 00000100:00100000:3.0:1788361757.628309:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 637 00002000:00100000:3.0:1788361757.628318:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff99d136b5b800 x1875230407104384/t4294968810(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361757.628327:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b5b800 with x1875230407104384 ext(0->1023) 00002000:00010000:3.0:1788361757.628332:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b5b800 00000100:00100000:1.0:1788361757.629511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.629675:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104640 00000100:00100000:2.0:1788361757.629684:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104640 00002000:00100000:2.0:1788361757.629722:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff99d136b59c00 x1875230407104640/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.629736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00002000:00100000:2.0:1788361757.629737:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b59c00 with x1875230407104640 ext(0->1023) 00002000:00010000:2.0:1788361757.629744:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b59c00 00000100:00100000:2.0:1788361757.629791:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 638 00000100:00100000:2.0:1788361757.629801:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2409:x1875230407104640:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:2.0:1788361757.630125:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b59c00 x1875230407104640/t4294968811(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.630182:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2409:x1875230407104640:12345-192.168.204.35@tcp:4:dd.0 Request processed in 382us (674us total) trans 4294968811 rc 0/0 00000100:00100000:2.0:1788361757.630190:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 638 00002000:00100000:2.0:1788361757.630196:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff99d136b59c00 x1875230407104640/t4294968811(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361757.630204:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b59c00 with x1875230407104640 ext(0->1023) 00002000:00010000:2.0:1788361757.630208:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b59c00 00000100:00100000:2.0:1788361757.630230:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104768 00000100:00100000:2.0:1788361757.630234:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104768 00000100:00100000:2.0:1788361757.630265:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4999 00000100:00100000:2.0:1788361757.630272:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2409:x1875230407104768:12345-192.168.204.35@tcp:16:kworker.0 00000001:00080000:3.0:1788361757.630589:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968811 is committed 00010000:00000080:2.0:1788361757.630890:0:26169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b58e00 x1875230407104768/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.630924:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2409:x1875230407104768:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 652us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361757.630931:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4999 00000100:00100000:1.0:1788361757.633302:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361757.633306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.633345:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105024 00000100:00100000:2.0:1788361757.633347:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104896 00000100:00100000:1.0:1788361757.633353:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105024 00000100:00100000:2.0:1788361757.633354:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104896 00002000:00100000:2.0:1788361757.633407:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff99d136b5aa00 x1875230407104896/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.633412:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5000 00000100:00100000:1.0:1788361757.633424:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2412:x1875230407105024:12345-192.168.204.35@tcp:16:kworker.0 00002000:00100000:2.0:1788361757.633438:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b5aa00 with x1875230407104896 ext(0->1023) 00002000:00010000:2.0:1788361757.633444:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b5aa00 00010000:00000080:1.0:1788361757.633465:0:26172:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038dd880 x1875230407105024/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.633474:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 639 00000100:00100000:2.0:1788361757.633486:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2412:x1875230407104896:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:1.0:1788361757.633518:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2412:x1875230407105024:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 96us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.633526:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5000 00010000:00000080:2.0:1788361757.633855:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b5aa00 x1875230407104896/t4294968812(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.633906:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2412:x1875230407104896:12345-192.168.204.35@tcp:4:dd.0 Request processed in 422us (615us total) trans 4294968812 rc 0/0 00000100:00100000:2.0:1788361757.633913:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 639 00002000:00100000:2.0:1788361757.633921:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff99d136b5aa00 x1875230407104896/t4294968812(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361757.633930:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b5aa00 with x1875230407104896 ext(0->1023) 00002000:00010000:2.0:1788361757.633934:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b5aa00 00000100:00100000:3.0:1788361757.635174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361757.635205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361757.635263:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105280 00000100:00100000:2.0:1788361757.635270:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105280 00000100:00100000:2.0:1788361757.635309:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5001 00000100:00100000:2.0:1788361757.635318:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d0038df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2410:x1875230407105280:12345-192.168.204.35@tcp:16:kworker.0 00010000:00000080:2.0:1788361757.635357:0:26164:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d0038df100 x1875230407105280/t0(0) o16->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 440/432 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.635362:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105152 00000100:00100000:1.0:1788361757.635368:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105152 00002000:00100000:1.0:1788361757.635394:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff99d136b59f80 x1875230407105152/t0(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/0 e 0 to 0 dl 1788361768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361757.635405:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d0038df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:2410:x1875230407105280:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 85us (232us total) trans 0 rc 0/0 00002000:00100000:1.0:1788361757.635407:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b59f80 with x1875230407105152 ext(0->1023) 00002000:00010000:1.0:1788361757.635416:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b59f80 00000100:00100000:2.0:1788361757.635420:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5001 00000100:00100000:1.0:1788361757.635443:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 640 00000100:00100000:1.0:1788361757.635461:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2410:x1875230407105152:12345-192.168.204.35@tcp:4:dd.0 00010000:00000080:1.0:1788361757.635726:0:24837:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99d136b59f80 x1875230407105152/t4294968813(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361757.635768:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2410:x1875230407105152:12345-192.168.204.35@tcp:4:dd.0 Request processed in 310us (575us total) trans 4294968813 rc 0/0 00000100:00100000:1.0:1788361757.635786:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 640 00002000:00100000:1.0:1788361757.635793:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff99d136b59f80 x1875230407105152/t4294968813(0) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:63/0 lens 1512/448 e 0 to 0 dl 1788361768 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361757.635801:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d136b59f80 with x1875230407105152 ext(0->1023) 00002000:00010000:1.0:1788361757.635804:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d136b59f80 00010000:00010000:2.0:1788361757.783167:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361758.011217:0:95832:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788361758.011272:0:95832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361758.011289:0:95832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361758.011304:0:95832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361758.011312:0:95832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361758.011331:0:95832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361758.011336:0:95832:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788361758.011378:0:95832:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361758.011382:0:95832:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361758.011397:0:95832:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361758.011422:0:95832:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361758.011468:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429914752:0@lo:39:umount.0 00010000:00010000:3.0:1788361758.011487:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361758.011496:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.011506:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d101493200 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:3.0:1788361758.011510:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.011533:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361758.011539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788361758.011548:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361758.011555:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361758.011558:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361758.011560:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788361758.011589:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914752 00010000:00010000:3.0:1788361758.011590:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.011599:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788361758.011599:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914752 00010000:00010000:3.0:1788361758.011628:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.011635:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d101493200/0x1b69fa8920fe468a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe4691 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.011646:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361758.011648:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361758.011650:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361758.011659:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361758.011669:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429914880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361758.011705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361758.011734:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429914880 00000100:00100000:1.0:1788361758.011739:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429914880 00000100:00080000:3.0:1788361758.011748:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361758.011798:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788361758.011808:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3653:x1875230429914880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361758.011841:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361758.011858:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d13715cc00/0x1b69fa8920fe4691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe468a expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361758.011875:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361758.011895:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1788361758.011905:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429914752:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788361758.011920:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3653:x1875230429914880:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000020:00000080:2.0:1788361758.011925:0:66128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe429a 00000100:00100000:1.0:1788361758.011931:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00080000:2.0:1788361758.011940:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d104f3a800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361758.011988:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361758.011989:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3649:x1875230429914752:12345-0@lo:39:umount.0 Request processed in 87us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361758.011996:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000020:00000080:2.0:1788361758.012005:0:66128:0:(genops.c:906:class_export_put()) final put ffff99d104f38000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:1.0:1788361758.012035:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d13fd14800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361758.012046:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429914752:0@lo:39:umount.0 00000100:00080000:1.0:1788361758.012067:0:95832:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361758.012131:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429914880:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788361758.012222:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d104f38000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1788361758.012254:0:95832:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361758.012260:0:95832:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361758.012269:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d104f3a800 for lustre-MDT0000 00000100:00080000:1.0:1788361758.013156:0:95832:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788361758.013160:0:95832:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361758.013162:0:95832:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788361758.013173:0:95832:0:(import.c:65:import_set_state_nolock()) ffff99d137d1b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788361758.013278:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875230429915008:0@lo:39:umount.0 00000100:00100000:2.0:1788361758.013313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361758.013366:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915008 00000100:00100000:1.0:1788361758.013376:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915008 00000100:00100000:1.0:1788361758.013418:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1788361758.013426:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875230429915008:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788361758.013442:0:66901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fddb3e 00000100:00080000:1.0:1788361758.013459:0:66901:0:(import.c:65:import_set_state_nolock()) ffff99d10f773000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788361758.013470:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788361758.013490:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361758.013511:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+1:3649:x1875230429915008:12345-0@lo:39:umount.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361758.013517:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00080000:2.0:1788361758.013522:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d137d1b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1788361758.013525:0:66901:0:(genops.c:906:class_export_put()) final put ffff99d10f775000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00100000:2.0:1788361758.013539:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875230429915008:0@lo:39:umount.0 00000020:00000080:0.0:1788361758.013573:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d10f775000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788361758.013623:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d10f773000 for lustre-MDT0001 00000100:00080000:3.0:1788361758.013752:0:95832:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788361758.013755:0:95832:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788361758.013759:0:95832:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788361758.015360:0:95832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015375:0:95832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015382:0:95832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015389:0:95832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015411:0:95832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361758.015418:0:95832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015425:0:95832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015431:0:95832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015437:0:95832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.015457:0:95832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788361758.015472:0:95832:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1788361758.015513:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:3.0:1788361758.015515:0:95832:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788361758.015521:0:95832:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:0.0:1788361758.015522:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788361758.015527:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788361758.015534:0:95832:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:0.0:1788361758.015535:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d13715d400 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361758.015541:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015553:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361758.015562:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361758.015581:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361758.015584:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788361758.015586:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788361758.015617:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015624:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361758.015649:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015656:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d13715d400/0x1b69fa8920fe4698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe469f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361758.015675:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429915136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361758.015679:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361758.015684:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015690:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139916a00 already unused, calling callback (ffffffffc1218c20) 10000000:00010000:0.0:1788361758.015694:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015701:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361758.015708:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361758.015714:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788361758.015716:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788361758.015718:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1788361758.015731:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361758.015752:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015758:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361758.015788:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015795:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d139916a00/0x1b69fa8920fe4269 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b69fa8920fe4270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.015807:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361758.015809:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361758.015811:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915136 00010000:00010000:0.0:1788361758.015812:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361758.015817:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915136 00000100:00100000:0.0:1788361758.015853:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429915264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361758.015882:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788361758.015891:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:3653:x1875230429915136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361758.015897:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361758.015906:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361758.015923:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d137c21800/0x1b69fa8920fe469f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe4698 expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361758.015937:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361758.015968:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915264 00000100:00100000:1.0:1788361758.015973:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3653:x1875230429915136:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361758.015974:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915264 00000100:00100000:1.0:1788361758.015984:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1788361758.016008:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788361758.016016:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:3650:x1875230429915264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361758.016025:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361758.016037:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139db4e00/0x1b69fa8920fe4270 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b69fa8920fe4269 expref: 22 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361758.016046:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361758.016050:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3653:1875230429915136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361758.016092:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3650:x1875230429915264:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361758.016099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788361758.016121:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429915264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361758.016347:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:3.0:1788361758.018407:0:95832:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1788361758.018450:0:95832:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:0.0:1788361758.018872:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968813 is committed 00000020:00000080:3.0:1788361758.019570:0:95832:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1788361758.019580:0:95832:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff99d13fd9f000 f1e400d1-472b-42d1-b5e7-e80dc701272a 192.168.204.35@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294968813 stale:0 00000020:00080000:3.0:1788361758.019589:0:95832:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff99d002ffe800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968769 stale:0 00000020:00080000:3.0:1788361758.019594:0:95832:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff99d136774000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968741 stale:0 00000020:00080000:3.0:1788361758.019600:0:95832:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff99d105318000) has exports, disconnecting them 00000020:00080000:3.0:1788361758.019605:0:95832:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.35@tcp (ffff99d13fd9f000), last request at 1788361757 00000020:00000080:3.0:1788361758.019613:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe42e0 00000020:00010000:3.0:1788361758.019623:0:95832:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d13fd9f000: total 0 00000100:00080000:3.0:1788361758.019628:0:95832:0:(import.c:65:import_set_state_nolock()) ffff99d13fd9e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788361758.019655:0:95832:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.35@tcp (ffff99d13fd9f000): rc 0 00000020:00080000:3.0:1788361758.019659:0:95832:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff99d002ffe800), last request at 1788361752 00000020:00000080:3.0:1788361758.019662:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fe417b 00000100:00080000:3.0:1788361758.019666:0:95832:0:(import.c:65:import_set_state_nolock()) ffff99d002ffc800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788361758.019686:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d13fd9f000: total 0 00010000:00010000:3.0:1788361758.019715:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d13fd9f000, canceled 0 locks, left on hash table 20. 00002000:00010000:3.0:1788361758.019745:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.019750:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.019784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007643093a/0x1b69fa8920fe4fdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71140b expref: 21 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361758.019806:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361758.019812:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.019853:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.019867:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc82d920/0x1b69fa8920fe4f7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113da expref: 20 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.019887:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.019889:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.019895:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f598cb/0x1b69fa8920fe4c9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112ec expref: 19 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.019908:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.019910:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.019916:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f85bd1/0x1b69fa8920fe4c10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112bb expref: 18 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020179:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020183:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020194:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001437b739/0x1b69fa8920fe4e86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71138d expref: 17 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020211:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020214:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020221:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf4ab3f3/0x1b69fa8920fe5069 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711435 expref: 16 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020236:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020249:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80e26b2/0x1b69fa8920fe4d8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711339 expref: 15 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020283:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020286:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014c50f03/0x1b69fa8920fe4e16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711378 expref: 14 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020307:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020310:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020316:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234abb59/0x1b69fa8920fe4f04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113b7 expref: 13 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020331:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020333:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020340:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009583fbcd/0x1b69fa8920fe4c8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112e5 expref: 12 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020354:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020356:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020362:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3aa77d/0x1b69fa8920fe4d21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711324 expref: 11 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020386:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020389:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020516:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009448a39f/0x1b69fa8920fe4e08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711363 expref: 10 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020542:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020545:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020554:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9aecb92/0x1b69fa8920fe4ec5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113a2 expref: 9 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020569:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020572:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020579:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff359fd/0x1b69fa8920fe503f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711420 expref: 8 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020592:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020595:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020602:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bfb09ad/0x1b69fa8920fe4f90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113ef expref: 7 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020616:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020619:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020625:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ddfa47/0x1b69fa8920fe505b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71142e expref: 6 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020643:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020645:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020652:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc404cb2/0x1b69fa8920fe4c4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7112d0 expref: 5 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020682:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020685:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020692:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c691d0/0x1b69fa8920fe4d13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71130f expref: 4 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020707:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020709:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020716:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041089204/0x1b69fa8920fe4dc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71134e expref: 3 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361758.020731:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361758.020734:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788361758.020740:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10ab071/0x1b69fa8920fe4f82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7113e1 expref: 2 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361758.020755:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d13fd9f000, canceled 20 locks, left on hash table 0. 00000020:00080000:1.0:1788361758.021196:0:95832:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d002ffe800): rc 0 00000020:00000080:1.0:1788361758.021200:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d002ffe800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1788361758.021216:0:95832:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff99d136774000), last request at 1788361756 00000020:00000080:1.0:1788361758.021229:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920fddab2 00000100:00080000:1.0:1788361758.021236:0:95832:0:(import.c:65:import_set_state_nolock()) ffff99d10f55d800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788361758.021246:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002ffe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00010000:00010000:2.0:1788361758.021276:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361758.021289:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d002ffc800 for lustre-OST0000 00000020:00080000:1.0:1788361758.021505:0:95832:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d136774000): rc 0 00000020:00000080:1.0:1788361758.021508:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d136774000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788361758.021535:0:48377:0:(genops.c:865:class_export_destroy()) destroying export ffff99d136774000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00080000:1.0:1788361758.021539:0:95832:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff99d105318000) has no exports 00000020:00000080:0.0:1788361758.021579:0:48377:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d10f55d800 for lustre-OST0000 00000020:00000080:3.0:1788361758.024558:0:6512:0:(genops.c:906:class_export_put()) final put ffff99d13fd9f000/f1e400d1-472b-42d1-b5e7-e80dc701272a 00010000:00010000:3.0:1788361758.024627:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361758.024630:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361758.024633:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361758.024718:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd9f000/f1e400d1-472b-42d1-b5e7-e80dc701272a for lustre-OST0000 00000020:00000080:2.0:1788361758.024783:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd9e800 for lustre-OST0000 00000020:01000000:1.0:1788361758.026250:0:95832:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d002fc8540 - data ffff99d12cb01288/ffff99d13a3a6c00 00000020:01000000:1.0:1788361758.026446:0:95832:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99d0020e04e0 - data ffff99d12ca6e5e8/ffff99d141663c00 00000100:00100000:0.0:1788361758.038010:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361758.038035:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429915392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361758.038107:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361758.038143:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429915520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361758.038180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361758.038230:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915520 00000100:00100000:0.0:1788361758.038237:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915520 00000100:00100000:0.0:1788361758.038304:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1788361758.038314:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429915520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361758.038343:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788361758.038393:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429915520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361758.038401:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1788361758.038671:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429915520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361758.039578:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915392 00000100:00100000:3.0:1788361758.039586:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915392 00000100:00100000:3.0:1788361758.039625:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4234 00000100:00100000:3.0:1788361758.039634:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429915392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788361758.039666:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:1.0:1788361758.039727:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429915648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361758.039754:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429915392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361758.039766:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4234 00000100:00100000:1.0:1788361758.039778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361758.039802:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361758.039893:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915648 00000100:00100000:0.0:1788361758.039899:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915648 00000100:00100000:3.0:1788361758.039901:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429915392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788361758.039926:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1788361758.039933:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3653:x1875230429915648:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788361758.039939:0:8441:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788361758.039996:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429915776:0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040032:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361758.040056:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361758.040062:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429915904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040084:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361758.040111:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915776 00000100:00100000:3.0:1788361758.040115:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915776 00000100:00100000:3.0:1788361758.040150:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429915904 00000100:00100000:3.0:1788361758.040154:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429915904 00000100:00100000:3.0:1788361758.040177:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1788361758.040183:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429915776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040219:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875230429915776:12345-0@lo:400:kworker.0 Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361758.040225:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1788361758.040237:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1788361758.040243:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429915904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040269:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429915904:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361758.040275:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:3.0:1788361758.040291:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788361758.040293:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361758.040310:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429915904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040328:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875230429915776:0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040368:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429916032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040396:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361758.040426:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916032 00000100:00100000:3.0:1788361758.040430:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916032 00000100:00100000:3.0:1788361758.040454:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5002 00000100:00100000:3.0:1788361758.040458:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3652:x1875230429916032:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788361758.040464:0:26170:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788361758.040489:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3652:x1875230429916032:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361758.040495:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5002 00000100:00080000:3.0:1788361758.040519:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361758.040524:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361758.040528:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788361758.040539:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788361758.040541:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361758.040545:0:3652:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2176 00000100:00080000:3.0:1788361758.040551:0:3652:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99d108bef800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361758.040574:0:3652:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d002d56a00 x1875230429916160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361758.040594:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429916032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361758.040615:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429916160:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1788361758.040640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361758.040668:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916160 00000100:00100000:3.0:1788361758.040678:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916160 00000100:00100000:3.0:1788361758.040699:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5003 00000100:00100000:3.0:1788361758.040709:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3649:x1875230429916160:12345-0@lo:8:ptlrpcd_00_02.0 00010000:02000000:3.0:1788361758.040726:0:26162:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788361758.041248:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3653:x1875230429915648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1311us (1480us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361758.041259:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1788361758.041340:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429916672:0@lo:400:kworker.0 00000100:02020000:1.0:1788361758.041360:0:3653:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788361758.041365:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788361758.041373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361758.041402:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361758.041408:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429916288:0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361758.041463:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916288 00000100:00100000:0.0:1788361758.041467:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916288 00000100:00100000:0.0:1788361758.041506:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1788361758.041508:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916672 00000100:00100000:0.0:1788361758.041514:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429916288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361758.041515:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916672 00000100:00100000:0.0:1788361758.041560:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429916288:12345-0@lo:400:kworker.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361758.041567:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1788361758.041591:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429916288:0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041613:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429916544:0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361758.041651:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361758.041656:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429916416:0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361758.041678:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1788361758.041692:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916544 00000100:00100000:2.0:1788361758.041693:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429916672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041697:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916544 00000100:00100000:0.0:1788361758.041727:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4235 00000100:00100000:0.0:1788361758.041733:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429916544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361758.041745:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875230429916672:12345-0@lo:400:kworker.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361758.041753:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1788361758.041788:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916416 00000100:00100000:0.0:1788361758.041789:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429916544:12345-0@lo:400:kworker.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361758.041793:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916416 00000100:00100000:0.0:1788361758.041799:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4235 00000100:00100000:2.0:1788361758.041845:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1788361758.041854:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429916416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041868:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429916544:0@lo:400:kworker.0 00000100:00100000:0.0:1788361758.041958:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875230429916416:0@lo:400:kworker.0 00000100:00100000:2.0:1788361758.041962:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875230429916416:12345-0@lo:400:kworker.0 Request processed in 107us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361758.041971:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1788361758.041982:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875230429916672:0@lo:400:kworker.0 00000100:00080000:0.0:1788361758.042033:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361758.042199:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361758.042206:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788361758.042249:0:3653:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788361758.042252:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361758.042256:0:3653:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2772 00000100:00080000:1.0:1788361758.042262:0:3653:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d005034000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788361758.042282:0:3653:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d104299500 x1875230429916800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361758.042334:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429916800:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1788361758.042362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361758.042415:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916800 00000100:00100000:1.0:1788361758.042419:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916800 00000100:00100000:1.0:1788361758.042444:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5004 00000100:00100000:1.0:1788361758.042457:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875230429916800:12345-0@lo:8:ptlrpcd_00_03.0 00010000:02000000:1.0:1788361758.042472:0:26159:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788361758.042511:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875230429916800:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 54us (147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361758.042518:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5004 00000100:00080000:0.0:1788361758.042528:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361758.042535:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361758.042539:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429916800:0@lo:8:ptlrpcd_00_03.0 00100000:10000000:0.0:1788361758.045330:0:95832:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000100:00100000:3.0:1788361758.047381:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3649:x1875230429916160:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 6663us (6732us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361758.047396:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5003 00000100:00080000:2.0:1788361758.047498:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361758.047505:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361758.047509:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429916160:0@lo:8:ptlrpcd_00_02.0 00000020:00000080:1.0:1788361758.050852:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920f9dd37 00000020:00000080:1.0:1788361758.050863:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d001c6c000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788361758.050920:0:95832:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d137d28000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788361758.050925:0:95832:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d137d28000 2 00000020:01000004:1.0:1788361758.050929:0:95832:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99d137d28000 from lustre-OST0000 00000020:00000080:1.0:1788361758.050954:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361758.050970:0:95832:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788361758.050973:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d001c6e000/lustre-OST0000_UUID 00000020:00000080:1.0:1788361758.050977:0:95832:0:(genops.c:865:class_export_destroy()) destroying export ffff99d001c6e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788361758.050984:0:95832:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788361758.051041:0:95832:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1788361758.051049:0:95832:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788361758.051053:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361758.051059:0:95832:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788361758.051066:0:95832:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99d00209c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361758.051072:0:95832:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff99d12e07cd40) has exports, disconnecting them 00000020:00080000:1.0:1788361758.051077:0:95832:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99d00209c800), last request at 1788359200 00000020:00000080:1.0:1788361758.051081:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920f9dd61 00000020:00080000:1.0:1788361758.051091:0:95832:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d00209c800): rc 0 00000020:00000080:1.0:1788361758.051095:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d00209c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788361758.051157:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d001c6c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788361758.051730:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d00209c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788361758.054867:0:95832:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788361758.054879:0:95832:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361758.054883:0:95832:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788361758.054892:0:95832:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361758.054974:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d13fd14800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788361758.055048:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361758.055130:0:95832:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788361758.055136:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d13fd12000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788361758.055141:0:95832:0:(genops.c:865:class_export_destroy()) destroying export ffff99d13fd12000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788361758.055147:0:95832:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788361758.055247:0:95832:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788361758.055251:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361758.055258:0:95832:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361758.055264:0:95832:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99d001c6c800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361758.055276:0:95832:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff99d12e07b380) has exports, disconnecting them 00000020:00080000:2.0:1788361758.055283:0:95832:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99d001c6c800), last request at 1788359200 00000020:00000080:2.0:1788361758.055297:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920f9dd76 00000020:00080000:2.0:1788361758.055311:0:95832:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d001c6c800): rc 0 00000020:00000080:2.0:1788361758.055316:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d001c6c800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788361758.055377:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d001c6c800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788361758.056915:0:95832:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788361758.056921:0:95832:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788361758.056925:0:95832:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361758.056931:0:95832:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361758.056962:0:29104:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d137d1b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788361758.057082:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361758.057092:0:95832:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788361758.057096:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d002098000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788361758.057099:0:95832:0:(genops.c:865:class_export_destroy()) destroying export ffff99d002098000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788361758.057103:0:95832:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788361758.057237:0:95832:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d137d28000 1 00000020:00000080:3.0:1788361758.057243:0:95832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1b69fa8920f9dcff 00000020:00000080:3.0:1788361758.057253:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d137ea1800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788361758.057262:0:95832:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788361758.057270:0:29104:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137ea1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788361758.057279:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361758.057285:0:95832:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788361758.057289:0:95832:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff99d137c00000) has no exports 00000020:00000080:3.0:1788361758.080163:0:95832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361758.080182:0:95832:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788361758.080197:0:95832:0:(genops.c:906:class_export_put()) final put ffff99d137d2b800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788361758.080202:0:95832:0:(genops.c:865:class_export_destroy()) destroying export ffff99d137d2b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788361758.080214:0:95832:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788361758.080323:0:95832:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99d137d28800 00000020:02000400:3.0:1788361758.080365:0:95832:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788361758.808229:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361759.831084:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788361760.087096:0:94202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051730 is committed 00010000:00010000:2.0:1788361760.087150:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087166:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087174:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087181:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aace00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087187:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087196:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087216:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d00720b200) 00010000:00010000:2.0:1788361760.087220:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087225:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087239:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aace00/0x1b69fa8920fe4b1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087261:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087267:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087281:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087287:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aadc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087290:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087296:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087304:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25319aaf (ffff99d00720b200) 00010000:00010000:2.0:1788361760.087306:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087308:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087314:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aadc00/0x1b69fa8920fe4b53 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25319aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087335:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087341:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087347:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087352:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087354:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087441:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087453:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99d105584b00) 00010000:00010000:2.0:1788361760.087455:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087459:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087464:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308600/0x1b69fa8920fe4bd8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087479:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087485:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087495:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087501:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aac800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087503:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087510:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087517:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99d105584000) 00010000:00010000:2.0:1788361760.087519:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087522:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087539:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aac800/0x1b69fa8920fe4c17 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087552:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087558:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087563:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087568:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087571:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087577:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087585:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99d004359400) 00010000:00010000:2.0:1788361760.087587:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087590:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087596:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308800/0x1b69fa8920fe4c56 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087605:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087610:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087621:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087626:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087629:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087635:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087643:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99d105584600) 00010000:00010000:2.0:1788361760.087645:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087648:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087654:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d004308e00/0x1b69fa8920fe4c95 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087665:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087671:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087677:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087682:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087684:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087701:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087709:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99d105584700) 00010000:00010000:2.0:1788361760.087711:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087715:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087720:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917400/0x1b69fa8920fe4d05 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087745:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087751:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087757:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087761:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087764:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087770:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087777:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99d105584d00) 00010000:00010000:2.0:1788361760.087779:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087782:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087798:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917000/0x1b69fa8920fe4d0c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087811:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087817:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087864:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087870:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139917600 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087873:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087879:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087889:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99d009c1d300) 00010000:00010000:2.0:1788361760.087892:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087896:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087902:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139917600/0x1b69fa8920fe4d60 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087914:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087920:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087931:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087936:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09400 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087939:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087945:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087952:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99d105584400) 00010000:00010000:2.0:1788361760.087955:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.087958:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087963:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09400/0x1b69fa8920fe4d9f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087975:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087980:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087986:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.087991:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.087994:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088009:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088017:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99d105584300) 00010000:00010000:2.0:1788361760.088019:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088022:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088028:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030800/0x1b69fa8920fe4dd0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088041:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088046:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088052:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088057:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bfc00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088060:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088066:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088073:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99d004359f00) 00010000:00010000:2.0:1788361760.088075:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088078:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088092:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bfc00/0x1b69fa8920fe4e0f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088104:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088110:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088116:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088121:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088124:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088130:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088138:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99d12172df00) 00010000:00010000:2.0:1788361760.088141:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088143:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088149:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09200/0x1b69fa8920fe4e4e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088159:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088164:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088176:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088181:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088184:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088190:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088199:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99d004359300) 00010000:00010000:2.0:1788361760.088202:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088205:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088211:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d104c09e00/0x1b69fa8920fe4e8d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088223:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088235:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088241:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088247:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d117aad000 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088250:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088267:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088275:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99d009c1d400) 00010000:00010000:2.0:1788361760.088278:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088281:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088286:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d117aad000/0x1b69fa8920fe4ecc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088299:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088305:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088311:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088316:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100031200 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088319:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088326:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088333:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99d009c1d500) 00010000:00010000:2.0:1788361760.088336:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088339:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088353:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100031200/0x1b69fa8920fe4f2e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088367:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088373:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088379:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088384:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d139db5e00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088387:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088393:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088402:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99d004359b00) 00010000:00010000:2.0:1788361760.088405:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088408:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088414:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d139db5e00/0x1b69fa8920fe4f43 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088425:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088432:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088445:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088451:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d100030c00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088453:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088460:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088468:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99d009c1d900) 00010000:00010000:2.0:1788361760.088471:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088474:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088480:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d100030c00/0x1b69fa8920fe4f89 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088492:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088497:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088503:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088508:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d1231bf800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088511:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088526:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088535:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99d009c1d600) 00010000:00010000:2.0:1788361760.088537:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088540:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088545:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d1231bf800/0x1b69fa8920fe4fc8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088563:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088569:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088575:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088579:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458ca00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088582:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088588:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088596:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99d009c1de00) 00010000:00010000:2.0:1788361760.088598:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088601:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088617:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458ca00/0x1b69fa8920fe5007 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088631:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088637:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088643:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088647:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d005169800 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088650:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088656:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088664:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99d12172d100) 00010000:00010000:2.0:1788361760.088666:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088669:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088674:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d005169800/0x1b69fa8920fe5046 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088685:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088691:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088702:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088707:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d00458de00 already unused, calling callback (ffffffffc18294f0) 00010000:00010000:2.0:1788361760.088710:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088716:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088724:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99d12172dd00) 00010000:00010000:2.0:1788361760.088726:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361760.088739:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361760.088746:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d00458de00/0x1b69fa8920fe5062 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66127 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788361760.843275:0:96177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:2.0:1788361760.854959:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361761.621981:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361761.622005:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429916928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361761.622085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361761.622133:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429916928 00000100:00100000:1.0:1788361761.622147:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429916928 00000100:00100000:1.0:1788361761.622203:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788361761.622212:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429916928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361761.622256:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788361761.622303:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875230429916928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361761.622309:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788361761.622365:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875230429916928:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788361761.622399:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361761.878107:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788361762.183724:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720f850 x1875230407105408 msgsize 224 00000100:00100000:3.0:1788361762.183741:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00000040:3.0:1788361762.183744:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361762.183783:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d57480 x1875230407105664 msgsize 224 00000100:00100000:3.0:1788361762.183789:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361762.183795:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105408 00000100:00100000:1.0:1788361762.183807:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105408 00000020:00000040:1.0:1788361762.183811:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4293 00000020:00000040:1.0:1788361762.183816:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0074c0800 refcount=10 00000100:00100000:0.0:1788361762.183859:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105664 00000100:00100000:0.0:1788361762.183865:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105664 00000100:00000040:3.0:1788361762.183867:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d56680 x1875230407105920 msgsize 224 00000020:00000040:0.0:1788361762.183867:0:66128:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe373a 00000100:00000040:1.0:1788361762.183869:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000040:0.0:1788361762.183873:0:66128:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d1054f4000 refcount=11 00000100:00100000:3.0:1788361762.183879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000020:00000040:0.0:1788361762.183887:0:66128:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 10 - evictor 00000100:00100000:1.0:1788361762.183904:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 171 00000100:00000040:0.0:1788361762.183908:0:66128:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1788361762.183909:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d0074c0800 : new rpc_count 1 00000100:00000040:3.0:1788361762.183910:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d55180 x1875230407105536 msgsize 224 00000100:00000040:1.0:1788361762.183920:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720f850 x1875230407105408/t0(0) o400->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:68/0 lens 224/0 e 0 to 0 dl 1788361773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.183922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361762.183938:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407105408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361762.183943:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 974 00000100:00000040:0.0:1788361762.183947:0:66128:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d1054f4000 : new rpc_count 1 00000100:00000040:0.0:1788361762.183952:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d57480 x1875230407105664/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:68/0 lens 224/0 e 0 to 0 dl 1788361773 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788361762.183958:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230407105408 00000100:00100000:0.0:1788361762.183964:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2412:x1875230407105664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00000040:3.0:1788361762.183966:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d55c00 x1875230407105792 msgsize 224 00000100:00000040:1.0:1788361762.183969:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00100000:3.0:1788361762.183977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00000040:0.0:1788361762.183979:0:66128:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411473, transno 0, xid 1875230407105664 00000100:00000040:1.0:1788361762.183980:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361762.183984:0:66128:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.183988:0:66128:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361762.184024:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.184024:0:66128:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00100000:3.0:1788361762.184028:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105920 00000100:00000040:1.0:1788361762.184033:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720f850 x1875230407105408/t0(0) o400->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:68/0 lens 224/224 e 0 to 0 dl 1788361773 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361762.184033:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d57480 x1875230407105664/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:68/0 lens 224/224 e 0 to 0 dl 1788361773 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.184034:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105920 00000020:00000040:3.0:1788361762.184039:0:8535:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42e7 00000020:00000040:3.0:1788361762.184045:0:8535:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d003827800 refcount=7 00000100:00100000:1.0:1788361762.184051:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407105408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 116us (409us total) trans 0 rc 0/0 00000020:00000040:3.0:1788361762.184057:0:8535:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00100000:0.0:1788361762.184064:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2412:x1875230407105664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361762.184071:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 171 00000100:00100000:0.0:1788361762.184071:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 974 00000100:00000040:3.0:1788361762.184073:0:8535:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:1.0:1788361762.184074:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d0074c0800 : new rpc_count 0 00000100:00000040:0.0:1788361762.184075:0:66128:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d1054f4000 : new rpc_count 0 00000020:00000040:1.0:1788361762.184087:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d0074c0800 : new refcount 9 00000020:00000040:0.0:1788361762.184088:0:66128:0:(genops.c:900:class_export_put()) PUTting export ffff99d1054f4000 : new refcount 10 00000100:00100000:3.0:1788361762.184095:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105792 00000100:00100000:0.0:1788361762.184099:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105536 00000100:00100000:3.0:1788361762.184100:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105792 00000020:00000040:3.0:1788361762.184104:0:8535:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42e0 00000100:00100000:0.0:1788361762.184105:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105536 00000020:00000040:0.0:1788361762.184109:0:66128:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4120 00000020:00000040:0.0:1788361762.184112:0:66128:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d116c04000 refcount=51 00000020:00000040:0.0:1788361762.184121:0:66128:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 14 - evictor 00000100:00100000:1.0:1788361762.184130:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1949 00000100:00000040:0.0:1788361762.184130:0:66128:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1788361762.184133:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d003827800 : new rpc_count 1 00000100:00000040:1.0:1788361762.184138:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d56680 x1875230407105920/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:68/0 lens 224/0 e 0 to 0 dl 1788361773 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.184143:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5005 00000100:00100000:0.0:1788361762.184152:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 975 00000100:00000040:3.0:1788361762.184153:0:8535:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d55c00 x1875230407105792/t0(0) o400->@:68/0 lens 224/0 e 0 to 0 dl 1788361773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361762.184157:0:66128:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d116c04000 : new rpc_count 1 00000100:00100000:1.0:1788361762.184158:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2412:x1875230407105920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00000040:0.0:1788361762.184165:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d55180 x1875230407105536/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:68/0 lens 224/0 e 0 to 0 dl 1788361773 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788361762.184173:0:8437:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230407105920 00000100:00000040:1.0:1788361762.184181:0:8437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00100000:3.0:1788361762.184182:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2411:x1875230407105792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361762.184183:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407105536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00000040:1.0:1788361762.184185:0:8437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00010000:00000040:0.0:1788361762.184198:0:66128:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875230407105536 00000100:00000040:1.0:1788361762.184200:0:8437:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.184204:0:66128:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361762.184209:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d56680 x1875230407105920/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:68/0 lens 224/224 e 0 to 0 dl 1788361773 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361762.184210:0:66128:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000020:00080000:3.0:1788361762.184216:0:8535:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.35@tcp 00000100:00100000:1.0:1788361762.184223:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2412:x1875230407105920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361762.184223:0:66128:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.184228:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d55180 x1875230407105536/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:68/0 lens 224/224 e 0 to 0 dl 1788361773 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361762.184229:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1949 00000100:00000040:1.0:1788361762.184232:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d003827800 : new rpc_count 0 00000100:00000040:3.0:1788361762.184234:0:8535:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000020:00000040:1.0:1788361762.184241:0:8437:0:(genops.c:900:class_export_put()) PUTting export ffff99d003827800 : new refcount 6 00000100:00000040:3.0:1788361762.184243:0:8535:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00100000:0.0:1788361762.184244:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407105536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 60us (330us total) trans 0 rc 0/0 00000100:00000040:3.0:1788361762.184253:0:8535:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00100000:0.0:1788361762.184269:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 975 00000100:00080000:1.0:1788361762.184273:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788361762.184277:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99d001c619c0) now 14 - evictor 00000100:00000040:0.0:1788361762.184278:0:66128:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d116c04000 : new rpc_count 0 00000100:00080000:1.0:1788361762.184281:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788361762.184282:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00080000:1.0:1788361762.184286:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788361762.184287:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99d001c64d40) now 10 - evictor 00000020:00000040:0.0:1788361762.184295:0:66128:0:(genops.c:900:class_export_put()) PUTting export ffff99d116c04000 : new refcount 50 00000100:00000040:3.0:1788361762.184336:0:8535:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361762.184342:0:8535:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d55c00 x1875230407105792/t0(0) o400->@:68/0 lens 224/224 e 0 to 0 dl 1788361773 ref 1 fl Interpret:/200/0 rc -107/-107 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.184351:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2411:x1875230407105792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 173us (384us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361762.184358:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5005 00000100:00000040:3.0:1788361762.187116:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d54380 x1875230407106048 msgsize 520 00000100:00100000:3.0:1788361762.187130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361762.187246:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106048 00000100:00100000:0.0:1788361762.187256:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106048 00000020:00000040:0.0:1788361762.187259:0:26171:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42e0 00000100:00100000:0.0:1788361762.187338:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5006 00000100:00000040:0.0:1788361762.187346:0:26171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d54380 x1875230407106048/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361762.187357:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2408:x1875230407106048:12345-192.168.204.35@tcp:8:ptlrpcd_01_00.0 00010000:00020000:0.0:1788361762.187386:0:26171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.35@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1788361762.187408:0:26171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.187413:0:26171:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.187418:0:26171:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361762.187462:0:26171:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361762.187466:0:26171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d54380 x1875230407106048/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788361782 ref 1 fl Interpret:/200/0 rc -19/-19 job:'ptlrpcd_01_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361762.187473:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2408:x1875230407106048:12345-192.168.204.35@tcp:8:ptlrpcd_01_00.0 Request processed in 116us (358us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361762.187478:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5006 00000020:00000040:0.0:1788361762.645989:0:94218:0:(genops.c:1231:class_import_get()) import ffff99d12c4e1000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1788361762.646099:0:94218:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000478479ff] to pc [ptlrpcd_00_00+0] req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361762.646218:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.646235:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429917056:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1788361762.646272:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361778 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361762.646281:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361762.646330:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d56300 x1875230429917056 msgsize 224 00000100:00100000:3.0:1788361762.646335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361762.646408:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917056 00000100:00000040:3.0:1788361762.646412:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361778 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361762.646418:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917056 00000020:00000040:0.0:1788361762.646423:0:23939:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe415f 00000020:00000040:0.0:1788361762.646427:0:23939:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002ffa000 refcount=5 00000100:00000040:3.0:1788361762.646428:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 973 usecs (1 jiffies) 00000100:00000040:0.0:1788361762.646457:0:23939:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788361762.646510:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4236 00000100:00000040:3.0:1788361762.646515:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d002ffa000 : new rpc_count 1 00000100:00000040:3.0:1788361762.646521:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d56300 x1875230429917056/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:68/0 lens 224/0 e 0 to 0 dl 1788361773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.646557:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429917056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788361762.646599:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00010000:00000040:3.0:1788361762.646612:0:8449:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429917056 00000100:00000040:3.0:1788361762.646622:0:8449:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:3.0:1788361762.646626:0:8449:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361762.646645:0:8449:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361778 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361762.646667:0:8449:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:3.0:1788361762.646697:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d56300 x1875230429917056/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:68/0 lens 224/368 e 0 to 0 dl 1788361773 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361762.646707:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429917056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (374us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361762.646721:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00100000:3.0:1788361762.646724:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4236 00000100:00000040:3.0:1788361762.646729:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d002ffa000 : new rpc_count 0 00000100:00000040:0.0:1788361762.646730:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361762.646746:0:8449:0:(genops.c:900:class_export_put()) PUTting export ffff99d002ffa000 : new refcount 4 00000004:00000040:0.0:1788361762.646750:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352854 avail=317151 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:0.0:1788361762.646761:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361778 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361762.646769:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429917056:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1788361762.646777:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef3800 x1875230429917056/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361778 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361762.646787:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d12c4e1000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1788361762.904116:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1788361763.157984:0:94222:0:(genops.c:1231:class_import_get()) import ffff99d117299000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788361763.158018:0:94222:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000013e6ee5d] to pc [ptlrpcd_00_01+1] req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158069:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8a6f36d-efb9-41cf-af98-5917323f2b0d->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1788361763.158079:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00100000:3.0:1788361763.158083:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1788361763.158096:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c8a6f36d-efb9-41cf-af98-5917323f2b0d->MGS req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361763.158111:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158115:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000478479ff] to pc [ptlrpcd_00_02+2] req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361763.158161:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429917184:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788361763.158177:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1788361763.158186:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.158187:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d002dff000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1788361763.158201:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361763.158207:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361779 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.158246:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361763.158269:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002a9ca275] to pc [ptlrpcd_00_03+3] req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361763.158270:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429917312:0@lo:400:kworker.0 00000100:00000040:0.0:1788361763.158286:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1788361763.158293:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d002dfb000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1788361763.158304:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361763.158307:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d57100 x1875230429917184 msgsize 224 00000100:00100000:3.0:1788361763.158318:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361763.158319:0:3652:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.158344:0:3652:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361763.158357:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158364:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a11331d3] to pc [ptlrpcd_00_00+0] req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.158374:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.158392:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720d850 x1875230429917312 msgsize 224 00000100:00100000:1.0:1788361763.158421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361763.158431:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1788361763.158432:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1788361763.158435:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429917440:0@lo:400:kworker.0 00000020:00000040:0.0:1788361763.158455:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d106904000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788361763.158461:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 4196 usecs (5 jiffies) 00000100:00000040:2.0:1788361763.158465:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158471:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788361763.158472:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.158484:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158547:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001557b196] to pc [ptlrpcd_00_01+1] req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361763.158556:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429917568:0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.158572:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:0.0:1788361763.158581:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361763.158586:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788361763.158590:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1788361763.158595:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361763.158601:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917312 00000100:00080000:0.0:1788361763.158602:0:29104:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2798 00000100:00000040:2.0:1788361763.158606:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d117280700 x1875230429917440 msgsize 224 00000100:00100000:1.0:1788361763.158616:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917312 00000100:00080000:0.0:1788361763.158618:0:29104:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000020:00000040:1.0:1788361763.158627:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000100:00100000:2.0:1788361763.158634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361763.158635:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1788361763.158638:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=21 00000100:00000040:0.0:1788361763.158643:0:29104:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 50 to 0@lo 00000100:00000040:0.0:1788361763.158650:0:29104:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 51 to 0@lo 00000020:00000040:0.0:1788361763.158653:0:29104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fdda9d 00000020:00000040:0.0:1788361763.158657:0:29104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136ca7800 refcount=4 00000100:00000040:0.0:1788361763.158662:0:29104:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 50 to 0@lo 00000100:00000040:0.0:1788361763.158666:0:29104:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 51 to 0@lo 00000020:00000040:0.0:1788361763.158680:0:29104:0:(genops.c:900:class_export_put()) PUTting export ffff99d136ca7800 : new refcount 3 00000100:00000040:3.0:1788361763.158681:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d57800 x1875230429917568 msgsize 224 00000100:00000040:1.0:1788361763.158682:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00080000:0.0:1788361763.158689:0:29104:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99d108bef800 using connection 192.168.204.135@tcp/0@lo 00000100:00000040:2.0:1788361763.158690:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.158707:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d108bef800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1788361763.158710:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 3471 usecs (4 jiffies) 00000100:00100000:1.0:1788361763.158719:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00000040:1.0:1788361763.158724:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00100000:0.0:1788361763.158725:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788361763.158732:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.158733:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720d850 x1875230429917312/t0(0) o400->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158749:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000753492c8] to pc [ptlrpcd_rcv+-1] req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.158757:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429917696:0@lo:400:kworker.0 00000100:00100000:3.0:1788361763.158759:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361763.158776:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3652:x1875230429917312:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.158786:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.158791:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1788361763.158796:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:1.0:1788361763.158797:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429917312 00000100:00000040:3.0:1788361763.158801:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.158807:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d136773800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788361763.158816:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361763.158847:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff99d117283100 x1875230429917696 msgsize 224 00000100:00100000:2.0:1788361763.158856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361763.158863:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788361763.158880:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000093d26178] to pc [ptlrpcd_00_02+2] req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.158881:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361763.158886:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.158904:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 3796 usecs (4 jiffies) 00000100:00000040:2.0:1788361763.158910:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2683757 usecs (2684 jiffies) 00000100:00000040:0.0:1788361763.158915:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1788361763.158918:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.158925:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d10f770000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1788361763.158947:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361763.158957:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917440 00000100:00000040:1.0:1788361763.158963:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00100000:2.0:1788361763.158964:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917440 00000020:00000040:2.0:1788361763.158968:0:80345:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42a1 00000020:00000040:2.0:1788361763.158972:0:80345:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d104f3e000 refcount=5 00000100:00000040:0.0:1788361763.158975:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f9281a9f] to pc [ptlrpcd_00_03+3] req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.158976:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720d850 x1875230429917312/t0(0) o400->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.158989:0:80345:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 14 - evictor 00000100:00000040:0.0:1788361763.159016:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1788361763.159023:0:80345:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1788361763.159025:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:3652:x1875230429917312:12345-0@lo:400:kworker.0 Request processed in 249us (625us total) trans 0 rc 0/0 00000020:00000040:0.0:1788361763.159026:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d12c4e1000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00100000:1.0:1788361763.159044:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00000040:0.0:1788361763.159047:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788361763.159052:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00100000:2.0:1788361763.159068:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917568 00000100:00000040:0.0:1788361763.159068:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db5cad22] to pc [ptlrpcd_00_00+0] req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.159075:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917568 00000020:00000040:1.0:1788361763.159076:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 20 00000020:00000040:2.0:1788361763.159079:0:80345:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddb45 00000020:00000040:2.0:1788361763.159086:0:80345:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d10f777800 refcount=5 00000020:00000040:2.0:1788361763.159102:0:80345:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 10 - evictor 00000100:00080000:0.0:1788361763.159115:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361763.159122:0:29104:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788361763.159127:0:29104:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361763.159137:0:29104:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2798 00000100:00080000:0.0:1788361763.159142:0:29104:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:0.0:1788361763.159156:0:29104:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 50 to 0@lo 00000100:00000040:0.0:1788361763.159162:0:29104:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 51 to 0@lo 00000020:00000040:0.0:1788361763.159167:0:29104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4166 00000100:00100000:2.0:1788361763.159172:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000020:00000040:0.0:1788361763.159173:0:29104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0055d6800 refcount=4 00000100:00000040:0.0:1788361763.159183:0:29104:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 50 to 0@lo 00000100:00000040:2.0:1788361763.159187:0:80345:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d104f3e000 : new rpc_count 1 00000100:00000040:0.0:1788361763.159192:0:29104:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 51 to 0@lo 00000020:00000040:0.0:1788361763.159197:0:29104:0:(genops.c:900:class_export_put()) PUTting export ffff99d0055d6800 : new refcount 3 00000100:00000040:2.0:1788361763.159199:0:80345:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117280700 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361763.159205:0:29104:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d005034000 using connection 192.168.204.135@tcp/0@lo 00000020:00000040:0.0:1788361763.159217:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d005034000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1788361763.159223:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429917440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361763.159235:0:29104:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1788361763.159244:0:75531:0:(genops.c:1231:class_import_get()) import ffff99d106904000 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00010000:00000040:2.0:1788361763.159245:0:80345:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429917440 00000100:00000040:0.0:1788361763.159247:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fa877251] to pc [ptlrpcd_rcv+-1] req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.159260:0:80345:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361763.159267:0:80345:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361763.159268:0:29104:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1788361763.159279:0:29104:0:(genops.c:1231:class_import_get()) import ffff99d10f55a000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1788361763.159280:0:75531:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004e9454f5] to pc [ptlrpcd_00_01+1] req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.159285:0:80345:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.159292:0:29104:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788361763.159358:0:29104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000060a4b5f] to pc [ptlrpcd_00_02+2] req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.159369:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.159370:0:80345:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:0.0:1788361763.159372:0:29104:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (2808) 00000100:00000040:2.0:1788361763.159391:0:80345:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117280700 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361763.159396:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429918080:0@lo:400:kworker.0 00000100:00100000:0.0:1788361763.159409:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917184 00000100:00100000:0.0:1788361763.159415:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917184 00000100:00100000:2.0:1788361763.159417:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875230429917440:12345-0@lo:400:kworker.0 Request processed in 199us (809us total) trans 0 rc 0/0 00000020:00000040:0.0:1788361763.159421:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4189 00000100:00000040:3.0:1788361763.159427:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.159428:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d00541d000 refcount=5 00000100:00100000:2.0:1788361763.159438:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000020:00000040:0.0:1788361763.159446:0:8441:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00000040:2.0:1788361763.159448:0:80345:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d104f3e000 : new rpc_count 0 00000100:00000040:3.0:1788361763.159463:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1788361763.159472:0:80345:0:(genops.c:900:class_export_put()) PUTting export ffff99d104f3e000 : new refcount 4 00000100:00000040:0.0:1788361763.159475:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00000040:3.0:1788361763.159491:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d56a00 x1875230429918080 msgsize 224 00000100:00100000:2.0:1788361763.159494:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00000040:2.0:1788361763.159503:0:80345:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d10f777800 : new rpc_count 1 00000100:00100000:3.0:1788361763.159504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361763.159510:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00000040:2.0:1788361763.159515:0:80345:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d57800 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.159516:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d00541d000 : new rpc_count 1 00000100:00000040:3.0:1788361763.159532:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.159534:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d57100 x1875230429917184/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.159535:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429917568:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788361763.159566:0:80345:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429917568 00000100:00000040:3.0:1788361763.159577:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 57476 usecs (58 jiffies) 00000100:00000040:2.0:1788361763.159581:0:80345:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00100000:0.0:1788361763.159585:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429917184:12345-0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1788361763.159594:0:80345:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00002000:00000024:0.0:1788361763.159618:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1788361763.159629:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1875230429917184 00000100:00000040:3.0:1788361763.159630:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788361763.159631:0:80345:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.159642:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.159644:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 53 to 0@lo 00000100:00000040:0.0:1788361763.159667:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361763.159719:0:80345:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:0.0:1788361763.159720:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.159728:0:80345:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d57800 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.159739:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429917568:12345-0@lo:400:kworker.0 Request processed in 212us (1056us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361763.159745:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00100000:2.0:1788361763.159748:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00000040:2.0:1788361763.159756:0:80345:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d10f777800 : new rpc_count 0 00000100:00000040:0.0:1788361763.159757:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d57100 x1875230429917184/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:69/0 lens 224/368 e 0 to 0 dl 1788361774 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.159764:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.159770:0:80345:0:(genops.c:900:class_export_put()) PUTting export ffff99d10f777800 : new refcount 4 00000100:00100000:2.0:1788361763.159787:0:80345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918080 00000100:00100000:0.0:1788361763.159789:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429917184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361763.159798:0:80345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918080 00000100:00100000:3.0:1788361763.159803:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875230429917440:0@lo:400:kworker.0 00000020:00000040:2.0:1788361763.159805:0:80345:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42a8 00000020:00000040:2.0:1788361763.159812:0:80345:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d104f3b800 refcount=5 00000100:00100000:0.0:1788361763.159818:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00000040:0.0:1788361763.159857:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d00541d000 : new rpc_count 0 00000100:00000040:3.0:1788361763.159860:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef1880 x1875230429917440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.159870:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99d00541d000 : new refcount 4 00000020:00000040:3.0:1788361763.159876:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d002dff000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788361763.159883:0:80345:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788361763.159900:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:3.0:1788361763.159915:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.159923:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00000040:0.0:1788361763.159934:0:66127:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d104f3b800 : new rpc_count 1 00000100:00100000:3.0:1788361763.159942:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429917952:0@lo:400:kworker.0 00000100:00000040:0.0:1788361763.159944:0:66127:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d56a00 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361763.159950:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1788361763.159957:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00080000:2.0:1788361763.159963:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000040:3.0:1788361763.159968:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.159969:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99d001c64d40) now 10 - evictor 00000100:00100000:0.0:1788361763.159969:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429918080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361763.159983:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1788361763.159993:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99d001c619c0) now 14 - evictor 00010000:00000040:0.0:1788361763.160004:0:66127:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429918080 00000100:00000040:3.0:1788361763.160024:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361763.160024:0:66127:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361763.160031:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.160039:0:66127:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1788361763.160053:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429918464:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1788361763.160055:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef1880 x1875230429917952 msgsize 224 00000100:00000040:0.0:1788361763.160072:0:66127:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361763.160074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361763.160089:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361779 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160100:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.160112:0:66127:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:2.0:1788361763.160129:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361763.160132:0:66127:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d56a00 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160158:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 2633 usecs (3 jiffies) 00000100:00000040:2.0:1788361763.160162:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff99d117281f80 x1875230429918464 msgsize 224 00000100:00100000:0.0:1788361763.160165:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429918080:12345-0@lo:400:kworker.0 Request processed in 202us (672us total) trans 0 rc 0/0 00000100:00000040:3.0:1788361763.160172:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.160181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361763.160204:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:3.0:1788361763.160210:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429918592:0@lo:400:kworker.0 00000100:00000040:0.0:1788361763.160213:0:66127:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d104f3b800 : new rpc_count 0 00000100:00000040:2.0:1788361763.160219:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.160227:0:66127:0:(genops.c:900:class_export_put()) PUTting export ffff99d104f3b800 : new refcount 4 00000100:00000040:3.0:1788361763.160236:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.160244:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2683757 usecs (2684 jiffies) 00000100:00100000:2.0:1788361763.160256:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:0.0:1788361763.160257:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.160272:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160295:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788361763.160319:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429917824:0@lo:8:kworker.0 00000100:00100000:2.0:1788361763.160320:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429918208:0@lo:400:kworker.0 00000100:00000040:3.0:1788361763.160325:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d110549500 x1875230429918592 msgsize 224 00000100:00100000:3.0:1788361763.160339:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361763.160348:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361778 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.160354:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160361:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.160372:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361763.160400:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361763.160403:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 4007 usecs (5 jiffies) 00000100:00000040:0.0:1788361763.160407:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185ea300 x1875230429917824 msgsize 520 00000100:00100000:0.0:1788361763.160419:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361763.160429:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff99d117283800 x1875230429918208 msgsize 224 00000100:00000040:3.0:1788361763.160436:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00100000:2.0:1788361763.160443:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361763.160448:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.160450:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361778 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.160469:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160501:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.160511:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2657 usecs (3 jiffies) 00000100:00000040:2.0:1788361763.160518:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 957 usecs (1 jiffies) 00000100:00000040:0.0:1788361763.160531:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361763.160536:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429918080:0@lo:400:kworker.0 00000100:00100000:2.0:1788361763.160547:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917952 00000100:00100000:2.0:1788361763.160555:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917952 00000020:00000040:2.0:1788361763.160559:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddace 00000020:00000040:2.0:1788361763.160563:0:26169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d005030000 refcount=5 00000100:00000040:3.0:1788361763.160564:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185e8700 x1875230429918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.160565:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429918336:0@lo:8:kworker.0 00000020:00000040:2.0:1788361763.160580:0:26169:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00000040:0.0:1788361763.160597:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361778 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361763.160600:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d10f770000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1788361763.160616:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361763.160617:0:26169:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:0.0:1788361763.160647:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e9180 x1875230429918336 msgsize 520 00000100:00100000:2.0:1788361763.160648:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917824 00000100:00100000:2.0:1788361763.160653:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917824 00000020:00000040:2.0:1788361763.160658:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddab2 00000100:00100000:3.0:1788361763.160662:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:0.0:1788361763.160664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361763.160685:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d005030000 : new rpc_count 1 00000100:00000040:3.0:1788361763.160703:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef1880 x1875230429917952/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.160705:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918336 00000100:00100000:2.0:1788361763.160713:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918336 00000100:00000040:0.0:1788361763.160718:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361778 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.160723:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe417b 00000100:00100000:3.0:1788361763.160734:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429917952:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1788361763.160737:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4817 usecs (5 jiffies) 00000100:00100000:2.0:1788361763.160755:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007 00010000:00000040:3.0:1788361763.160757:0:8440:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968754, transno 0, xid 1875230429917952 00000100:00000040:2.0:1788361763.160762:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185ea300 x1875230429917824/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160770:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00100000:0.0:1788361763.160776:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429917696 00000100:00100000:0.0:1788361763.160785:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429917696 00000100:00000040:3.0:1788361763.160794:0:8440:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1788361763.160795:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3649:x1875230429917824:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1788361763.160796:0:23938:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4119 00000020:00000040:0.0:1788361763.160802:0:23938:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d116c07800 refcount=7 00000100:00000040:3.0:1788361763.160858:0:8440:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:2.0:1788361763.160858:0:26169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1788361763.160877:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 53 to 0@lo 00000100:00000040:0.0:1788361763.160883:0:23938:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1788361763.160890:0:26169:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 53 to 0@lo 00000100:00000040:2.0:1788361763.160909:0:26169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788361763.160913:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918464 00000100:00100000:0.0:1788361763.160918:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918464 00000020:00000040:0.0:1788361763.160921:0:23938:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4119 00000020:00000040:0.0:1788361763.160924:0:23938:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d116c07800 refcount=8 00000100:00000040:3.0:1788361763.160937:0:8440:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361763.160943:0:26169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361778 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.160948:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef1880 x1875230429917952/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.160949:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918208 00000100:00100000:0.0:1788361763.160959:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918208 00000020:00000040:0.0:1788361763.160965:0:23938:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe415f 00000020:00000040:0.0:1788361763.160974:0:23938:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002ffa000 refcount=5 00000100:00100000:3.0:1788361763.160994:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429917952:12345-0@lo:400:kworker.0 Request processed in 262us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361763.161008:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00000040:3.0:1788361763.161013:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d005030000 : new rpc_count 0 00000100:00100000:0.0:1788361763.161017:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4237 00000100:00000040:2.0:1788361763.161020:0:26169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:0.0:1788361763.161024:0:23938:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d116c07800 : new rpc_count 1 00000100:00000040:2.0:1788361763.161028:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185ea300 x1875230429917824/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788361783 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.161031:0:23938:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117283100 x1875230429917696/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361763.161034:0:8440:0:(genops.c:900:class_export_put()) PUTting export ffff99d005030000 : new refcount 4 00000100:00100000:2.0:1788361763.161060:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3649:x1875230429917824:12345-0@lo:8:kworker.0 Request processed in 270us (648us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361763.161063:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5008 00000100:00100000:0.0:1788361763.161071:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1875230429917696:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1788361763.161076:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e9180 x1875230429918336/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.161088:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007 00010000:00000040:0.0:1788361763.161097:0:23938:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875230429917696 00000100:00100000:3.0:1788361763.161099:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1875230429918336:12345-0@lo:8:kworker.0 00000100:00000040:0.0:1788361763.161113:0:23938:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:0.0:1788361763.161121:0:23938:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00020000:3.0:1788361763.161126:0:8440:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361763.161135:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4238 00000100:00000040:2.0:1788361763.161140:0:8448:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d116c07800 : new rpc_count 2 00000100:00000040:3.0:1788361763.161144:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 53 to 0@lo 00000100:00000040:0.0:1788361763.161152:0:23938:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161153:0:8448:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117281f80 x1875230429918464/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.161154:0:8440:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 53 to 0@lo 00000100:00000040:3.0:1788361763.161174:0:8440:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361763.161209:0:8440:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361778 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.161211:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1875230429918464:12345-0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788361763.161219:0:23938:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:0.0:1788361763.161240:0:23938:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117283100 x1875230429917696/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361763.161258:0:8440:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000004:00000024:2.0:1788361763.161259:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:0.0:1788361763.161268:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1875230429917696:12345-0@lo:400:kworker.0 Request processed in 205us (2440us total) trans 0 rc 0/0 00000100:00000040:3.0:1788361763.161275:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9180 x1875230429918336/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788361783 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788361763.161278:0:8448:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875230429918464 00000100:00100000:0.0:1788361763.161280:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4237 00000100:00000040:0.0:1788361763.161291:0:23938:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d116c07800 : new rpc_count 1 00000100:00000040:2.0:1788361763.161296:0:8448:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00100000:3.0:1788361763.161308:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1875230429918336:12345-0@lo:8:kworker.0 Request processed in 207us (656us total) trans 0 rc -19/-19 00000100:00000040:2.0:1788361763.161309:0:8448:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1788361763.161310:0:23938:0:(genops.c:900:class_export_put()) PUTting export ffff99d116c07800 : new refcount 7 00000100:00100000:3.0:1788361763.161324:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5008 00000100:00100000:0.0:1788361763.161337:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4239 00000100:00000040:0.0:1788361763.161342:0:23938:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d002ffa000 : new rpc_count 1 00000100:00000040:2.0:1788361763.161347:0:8448:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.161350:0:23938:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117283800 x1875230429918208/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.161382:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429918208:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.161388:0:8448:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00010000:00000040:0.0:1788361763.161393:0:23938:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429918208 00000100:00000040:2.0:1788361763.161397:0:8448:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117281f80 x1875230429918464/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:69/0 lens 224/368 e 0 to 0 dl 1788361774 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.161402:0:23938:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:0.0:1788361763.161410:0:23938:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1788361763.161425:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429918464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361763.161434:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4238 00000100:00000040:0.0:1788361763.161434:0:23938:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161440:0:8448:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d116c07800 : new rpc_count 0 00000020:00000040:2.0:1788361763.161451:0:8448:0:(genops.c:900:class_export_put()) PUTting export ffff99d116c07800 : new refcount 6 00000100:00000040:0.0:1788361763.161459:0:23938:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:0.0:1788361763.161466:0:23938:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117283800 x1875230429918208/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.161476:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429918208:12345-0@lo:400:kworker.0 Request processed in 102us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361763.161483:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4239 00000100:00000040:0.0:1788361763.161486:0:23938:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d002ffa000 : new rpc_count 0 00000020:00000040:0.0:1788361763.161495:0:23938:0:(genops.c:900:class_export_put()) PUTting export ffff99d002ffa000 : new refcount 4 00000100:00080000:2.0:1788361763.161519:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361763.161522:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918592 00000020:00000040:2.0:1788361763.161526:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00100000:0.0:1788361763.161527:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918592 00000020:00000040:0.0:1788361763.161532:0:66128:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42af 00000020:00000040:0.0:1788361763.161546:0:66128:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136ca0800 refcount=5 00000100:00000040:0.0:1788361763.161562:0:66128:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:2.0:1788361763.161563:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361778 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361763.161577:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361763.161586:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1788361763.161592:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361778 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.161598:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00000040:0.0:1788361763.161604:0:66128:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136ca0800 : new rpc_count 1 00000100:00100000:2.0:1788361763.161609:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429917824:0@lo:8:kworker.0 00000100:00000040:0.0:1788361763.161613:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110549500 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:69/0 lens 224/0 e 0 to 0 dl 1788361774 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.161630:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429918592:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.161637:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361778 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1788361763.161641:0:66128:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429918592 00000100:00080000:2.0:1788361763.161650:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00000040:0.0:1788361763.161651:0:66128:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00080000:2.0:1788361763.161657:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:0.0:1788361763.161660:0:66128:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361763.161666:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361778 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.161689:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429918336:0@lo:8:kworker.0 00000100:00000040:0.0:1788361763.161697:0:66128:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161700:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef0700 x1875230429917824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361778 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.161726:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d108bef800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1788361763.161730:0:66128:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:0.0:1788361763.161739:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110549500 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:69/0 lens 224/224 e 0 to 0 dl 1788361774 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161746:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185e8000 x1875230429918336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361778 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.161753:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429918592:12345-0@lo:400:kworker.0 Request processed in 126us (1423us total) trans 0 rc 0/0 00000020:00000040:2.0:1788361763.161757:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d005034000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1788361763.161766:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00000040:0.0:1788361763.161769:0:66128:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136ca0800 : new rpc_count 0 00000020:00000040:0.0:1788361763.161778:0:66128:0:(genops.c:900:class_export_put()) PUTting export ffff99d136ca0800 : new refcount 4 00000100:00000040:2.0:1788361763.161790:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788361763.161796:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161804:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.161809:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429918208:0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.161819:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:2.0:1788361763.161851:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788361763.161860:0:3651:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352762 avail=317059 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023568 state=0: rc = 0 00000100:00000040:2.0:1788361763.161872:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.161876:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361763.161880:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d002d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429918464:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788361763.161896:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.161903:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429917312:0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.161913:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:0.0:1788361763.161918:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef3800 x1875230429917312/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161923:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.161950:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.161952:0:3652:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000100:00100000:2.0:1788361763.161964:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429917696:0@lo:400:kworker.0 00000100:00000040:2.0:1788361763.161970:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185eb800 x1875230429918208/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.161995:0:3651:0:(genops.c:1244:class_import_put()) import ffff99d12c4e1000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1788361763.162000:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788361763.162009:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d002d56d80 x1875230429918464/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361763.162014:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361763.162022:0:3651:0:(genops.c:1244:class_import_put()) import ffff99d106904000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788361763.162030:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361763.162039:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef1180 x1875230429917696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.162040:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429917568:0@lo:400:kworker.0 00000020:00000040:2.0:1788361763.162055:0:3651:0:(genops.c:1244:class_import_put()) import ffff99d106904000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788361763.162064:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:0.0:1788361763.162075:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788361763.162084:0:3650:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1788361763.162087:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261733 state=0: rc = 0 00000100:00000040:0.0:1788361763.162100:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361763.162108:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429917184:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788361763.162118:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef3b80 x1875230429917568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.162126:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d002dfb000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1788361763.162139:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117280380 x1875230429917184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361763.162153:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d117299000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788361763.162612:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968754 00000100:00000040:1.0:1788361763.162621:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.162632:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361763.162641:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429917952:0@lo:400:kworker.0 00000100:00000040:1.0:1788361763.162681:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788361763.162688:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361763.162697:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361763.162705:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429918592:0@lo:400:kworker.0 00000100:00000040:1.0:1788361763.162715:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef2d80 x1875230429917952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361763.162723:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d136773800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788361763.162730:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185e8380 x1875230429918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361779 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361763.162737:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d10f55a000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00010000:00010000:2.0:1788361763.926108:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361764.950118:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361765.676905:0:96771:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361765.676908:0:96771:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788361765.676909:0:96771:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788361765.677015:0:96771:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d139ff5800 00000020:01000004:0.0:1788361765.677035:0:96771:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788361765.677051:0:96771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788361765.677064:0:96771:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99d10531cd40) 00000020:00000040:0.0:1788361765.677072:0:96771:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d1069b8000 with handle 0x1b69fa8920fe5070 to hash 00000020:00000040:0.0:1788361765.677078:0:96771:0:(genops.c:900:class_export_put()) PUTting export ffff99d1069b8000 : new refcount 1 00000020:00000040:0.0:1788361765.677086:0:96771:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99d10531cd40) now 2 - obd_device_list 00000020:00000080:0.0:1788361765.677091:0:96771:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:3.0:1788361765.871919:0:96771:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:3.0:1788361765.876268:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788361765.877377:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788361765.877411:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788361765.877441:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788361765.877469:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788361765.877501:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788361765.877528:0:96771:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788361765.877972:0:96771:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:3.0:1788361765.878181:0:96771:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99d10531cd40) now 3 - setup 00000020:00000080:3.0:1788361765.878186:0:96771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788361765.878198:0:96771:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000040:3.0:1788361765.878205:0:96771:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d0057f1800 with handle 0x1b69fa8920fe5077 to hash 00000020:00000040:3.0:1788361765.878212:0:96771:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99d10531cd40) now 4 - export 00000020:00000040:3.0:1788361765.878215:0:96771:0:(genops.c:900:class_export_put()) PUTting export ffff99d0057f1800 : new refcount 1 00000020:00000080:3.0:1788361765.878217:0:96771:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b69fa8920fe5077 00000020:00000040:3.0:1788361765.878220:0:96771:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe5077 00000020:00000040:3.0:1788361765.878223:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0057f1800 refcount=2 00000020:01000004:3.0:1788361765.878228:0:96771:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788361765.878251:0:96771:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788361765.878254:0:96771:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788361765.878260:0:96771:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788361765.878288:0:96771:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788361765.878292:0:96771:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:3.0:1788361765.879086:0:96771:0:(genops.c:889:class_export_get()) GET export ffff99d1069b8000 refcount=2 00000040:00000040:3.0:1788361765.879092:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 00000040:00000040:3.0:1788361765.880114:0:96771:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d0043d89c0 : new refcount 1 00000040:01000000:3.0:1788361765.880119:0:96771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 10000000:00000040:3.0:1788361765.880121:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 10000000:00000040:3.0:1788361765.880123:0:96771:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d0043d89c0 : new refcount 1 00000020:00000040:3.0:1788361765.880126:0:96771:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.135@tcp (ffff99d1349b4d40) now 6 - mgc_fs 00000020:01000004:3.0:1788361765.880160:0:96771:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788361765.880164:0:96771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361765.880166:0:96771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361765.880167:0:96771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361765.880169:0:96771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361765.880170:0:96771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361765.880171:0:96771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361765.880173:0:96771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361765.880174:0:96771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361765.880175:0:96771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361765.880178:0:96771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788361765.880180:0:96771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361765.880181:0:96771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361765.880182:0:96771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361765.880183:0:96771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361765.880184:0:96771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361765.880185:0:96771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361765.880187:0:96771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361765.880188:0:96771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361765.880189:0:96771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:3.0:1788361765.880194:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 10000000:01000000:3.0:1788361765.880217:0:96771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1788361765.880233:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.880246:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429918720:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1788361765.880273:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.880281:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.880328:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720e450 x1875230429918720 msgsize 4848 00000100:00100000:3.0:1788361765.880332:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.880334:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361765.880426:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.880455:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0043d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.880505:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918720 00000100:00100000:1.0:1788361765.880518:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918720 00000020:00000040:1.0:1788361765.880520:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.880524:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=21 00000100:00000040:1.0:1788361765.880546:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.880707:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00000040:1.0:1788361765.880713:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.880718:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720e450 x1875230429918720/t0(0) o253->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 4848/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.880732:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:96771:x1875230429918720:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361765.880766:0:94211:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788361765.880769:0:94211:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788361765.880773:0:94211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:0.0:1788361765.881140:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429918720 00000100:00000040:0.0:1788361765.881150:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:0.0:1788361765.881154:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.881176:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.881203:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:0.0:1788361765.881209:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720e450 x1875230429918720/t0(0) o253->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 4848/4768 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.881220:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:96771:x1875230429918720:12345-0@lo:253:mount.lustre.0 Request processed in 490us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361765.881229:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00000040:0.0:1788361765.881233:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:3.0:1788361765.881244:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.881245:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 20 00000100:00000040:3.0:1788361765.881260:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.881268:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429918720:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1788361765.881278:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788361765.881289:0:96771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788361765.881292:0:96771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361765.881294:0:96771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361765.881295:0:96771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361765.881296:0:96771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361765.881297:0:96771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361765.881298:0:96771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361765.881300:0:96771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361765.881301:0:96771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361765.881302:0:96771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:3.0:1788361765.881305:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054aa00 x1875230429918720/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.881316:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000020:01000004:3.0:1788361765.881335:0:96771:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99d139ff5800 from lustre-OST0000 10000000:01000000:3.0:1788361765.881358:0:96771:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788361765.881362:0:96771:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:3.0:1788361765.881370:0:96771:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff99d109033200) refs 5 10000000:01000000:3.0:1788361765.881373:0:96771:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99d1349b4d40 local copy 00000020:00000040:3.0:1788361765.881377:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d101492000 refcount=2 00010000:00010000:3.0:1788361765.881385:0:96771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1788361765.881408:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d117862d80 : new refcount 2 10000000:00000040:3.0:1788361765.881410:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 10000000:00000040:3.0:1788361765.881419:0:96771:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.135@tcp: copy local log lustre-sptlrpc 00000020:00000040:3.0:1788361765.881451:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.881455:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361765.881474:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.881483:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429918848:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788361765.881498:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.881516:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.881535:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720cc50 x1875230429918848 msgsize 512 00000100:00100000:3.0:1788361765.881540:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.881541:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361765.881565:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.881584:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102f50e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.881675:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918848 00000100:00100000:1.0:1788361765.881680:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918848 00000020:00000040:1.0:1788361765.881682:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.881685:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=21 00000100:00000040:1.0:1788361765.881696:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.881760:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00000040:1.0:1788361765.881763:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.881768:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720cc50 x1875230429918848/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 512/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.881780:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:96771:x1875230429918848:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1788361765.881793:0:94209:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:1.0:1788361765.881796:0:94209:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.881818:0:94209:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.881839:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429918848 00000100:00000040:1.0:1788361765.881845:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.881849:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.881866:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.881898:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.881903:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720cc50 x1875230429918848/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 512/272 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.881913:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:96771:x1875230429918848:12345-0@lo:501:mount.lustre.0 Request processed in 135us (376us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361765.881921:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00000040:1.0:1788361765.881923:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361765.881931:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 20 00000100:00000040:3.0:1788361765.881934:0:96771:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.881946:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.883093:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.883106:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429918848:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788361765.883116:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.883128:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361765.883132:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054aa00 x1875230429918848/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.883154:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:01000000:3.0:1788361765.883163:0:96771:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788361765.883190:0:96771:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:3.0:1788361765.883195:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d101492000 refcount=3 00010000:00010000:3.0:1788361765.883201:0:96771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361765.883210:0:96771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361765.883245:0:96771:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99d139ff5800 10000000:01000000:3.0:1788361765.883250:0:96771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:3.0:1788361765.883255:0:96771:0:(genops.c:889:class_export_get()) GET export ffff99d109072800 refcount=18 10000000:00000040:3.0:1788361765.883258:0:96771:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff99d1080b3e00) refs 4 10000000:01000000:3.0:1788361765.883260:0:96771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788361765.883263:0:96771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1788361765.883265:0:96771:0:(genops.c:889:class_export_get()) GET export ffff99d109072800 refcount=19 10000000:01000000:3.0:1788361765.883269:0:96771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788361765.883272:0:96771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:3.0:1788361765.883277:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00010000:00000040:3.0:1788361765.883295:0:96771:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d122d96f00 count: 8 00000020:00000040:3.0:1788361765.883303:0:96771:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d100030400 with handle 0x1b69fa8920fe507e to hash 00010000:00010000:3.0:1788361765.883309:0:96771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361765.883316:0:96771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361765.883325:0:96771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788361765.883346:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.883356:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429918976:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788361765.883374:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.883382:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.883412:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720c050 x1875230429918976 msgsize 328 00000100:00100000:3.0:1788361765.883418:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.883420:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361765.883449:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.883472:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102f50e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361765.883488:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429918976 00000100:00100000:2.0:1788361765.883495:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429918976 00000020:00000040:2.0:1788361765.883497:0:94208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:2.0:1788361765.883500:0:94208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=21 00000100:00000040:2.0:1788361765.883517:0:94208:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788361765.883546:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00000040:2.0:1788361765.883549:0:94208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:2.0:1788361765.883554:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720c050 x1875230429918976/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.883565:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+21:96771:x1875230429918976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361765.883577:0:94208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1788361765.883595:0:94208:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d112cab200 count: 10 00000020:00000040:2.0:1788361765.883601:0:94208:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d005168200 with handle 0x1b69fa8920fe5085 to hash 00010000:00010000:2.0:1788361765.883605:0:94208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d005168200/0x1b69fa8920fe5085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe507e expref: -99 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883613:0:94208:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99d007453000 : new locks_count 16 00000020:00000040:2.0:1788361765.883627:0:94208:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=22 00010000:00000040:2.0:1788361765.883645:0:94208:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99d112cab200) refcount = 10 00010000:00000040:2.0:1788361765.883648:0:94208:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788361765.883658:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715d200/0x1b69fa8920fe46ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe46a6 expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883666:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe4683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe467c expref: 22 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883673:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d00458d800/0x1b69fa8920fe4675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe466e expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883679:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d137c21a00/0x1b69fa8920fe4667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4660 expref: 22 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883685:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d00458c000/0x1b69fa8920fe4659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4652 expref: 22 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883690:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe464b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4644 expref: 22 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883695:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe463d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4636 expref: 22 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883704:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715d600/0x1b69fa8920fe462f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71113a expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.883710:0:94208:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe4628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711133 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.883717:0:94208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d005168200/0x1b69fa8920fe5085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe507e expref: 22 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.883728:0:94208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d005168200/0x1b69fa8920fe5085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe507e expref: 22 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.883737:0:94208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d005168200, rc 0) 00010000:00000040:2.0:1788361765.883744:0:94208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429918976 00000100:00000040:2.0:1788361765.883750:0:94208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361765.883755:0:94208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.883774:0:94208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.883801:0:94208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:2.0:1788361765.883806:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720c050 x1875230429918976/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/344 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.883814:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429918976:12345-0@lo:101:mount.lustre.0 Request processed in 250us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361765.883820:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00000040:2.0:1788361765.883842:0:94208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:2.0:1788361765.883850:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 21 00000100:00000040:2.0:1788361765.885882:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.885896:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.885902:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429918976:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788361765.885908:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.885920:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100030400 refcount=4 00010000:00000040:2.0:1788361765.885925:0:96771:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99d100030400, remote cookie: 0x1b69fa8920fe5085, flags: 0x0 00010000:00000040:2.0:1788361765.885931:0:96771:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99d122d96f00) refcount = 8 00010000:00000040:2.0:1788361765.885934:0:96771:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788361765.885936:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.885957:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4683 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.885961:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4675 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.885964:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4667 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.885967:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4659 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.885971:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe464b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.885974:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe463d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.885977:0:96771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe5085 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.885983:0:96771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe5085 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361765.885989:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054aa00 x1875230429918976/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.885997:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:00000040:2.0:1788361765.886005:0:96771:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff99d001cca600) refs 2 00000020:00000040:2.0:1788361765.886008:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100030400 refcount=3 10000000:00000040:2.0:1788361765.886039:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d117862d80 : new refcount 2 10000000:00000040:2.0:1788361765.886048:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 10000000:00000040:2.0:1788361765.886051:0:96771:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.135@tcp: copy local log lustre-OST0000 00000040:00080000:2.0:1788361765.886206:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788361765.886517:0:96771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361765.890512:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788361765.890564:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788361765.890580:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788361765.890593:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788361765.890607:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788361765.890634:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788361765.890663:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788361765.890670:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:2.0:1788361765.890728:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.890734:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.890772:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.890785:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919104:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788361765.890809:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.890816:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.890888:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720fc50 x1875230429919104 msgsize 512 00000100:00100000:2.0:1788361765.890894:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.890896:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.890923:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.890941:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919104 00000100:00100000:3.0:1788361765.890949:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919104 00000100:00100000:2.0:1788361765.890950:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a99c0 going to sleep for 11 seconds 00000020:00000040:3.0:1788361765.890953:0:94207:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:3.0:1788361765.890967:0:94207:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=22 00000100:00000040:3.0:1788361765.890988:0:94207:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788361765.891016:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00000040:3.0:1788361765.891021:0:94207:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:3.0:1788361765.891027:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720fc50 x1875230429919104/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 512/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.891045:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919104:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1788361765.891069:0:94207:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:3.0:1788361765.891072:0:94207:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:3.0:1788361765.891137:0:94207:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00000020:00000040:3.0:1788361765.891146:0:94207:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=23 00000020:00000040:3.0:1788361765.891149:0:94207:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00010000:00000040:3.0:1788361765.891160:0:94207:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919104 00000100:00000040:3.0:1788361765.891170:0:94207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:3.0:1788361765.891175:0:94207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.891195:0:94207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.891223:0:94207:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:3.0:1788361765.891228:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720fc50 x1875230429919104/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 512/272 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.891236:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919104:12345-0@lo:501:mount.lustre.0 Request processed in 198us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361765.891243:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00000040:3.0:1788361765.891246:0:94207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:3.0:1788361765.891254:0:94207:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 21 00000100:00000040:2.0:1788361765.891282:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.891355:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.891370:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919104:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788361765.891377:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.891388:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.891392:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919104/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.891400:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.891409:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.891412:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.891424:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.891433:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919232:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788361765.891458:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.891464:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.891476:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d11720d050 x1875230429919232 msgsize 272 00000100:00100000:2.0:1788361765.891478:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.891479:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1788361765.891674:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919232 00000100:00000040:2.0:1788361765.891675:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.891682:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919232 00000020:00000040:0.0:1788361765.891686:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000100:00100000:2.0:1788361765.891687:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a99c0 going to sleep for 11 seconds 00000020:00000040:0.0:1788361765.891690:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=22 00000100:00000040:0.0:1788361765.891711:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788361765.891732:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00000040:0.0:1788361765.891735:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:0.0:1788361765.891741:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11720d050 x1875230429919232/t0(0) o503->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.891768:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919232:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1788361765.891791:0:94211:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:0.0:1788361765.891819:0:94211:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:0.0:1788361765.891846:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919232 00000100:00000040:0.0:1788361765.891851:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:0.0:1788361765.891855:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.891877:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.891901:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:0.0:1788361765.891907:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11720d050 x1875230429919232/t0(0) o503->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8416 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.891917:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.891920:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919232:12345-0@lo:503:mount.lustre.0 Request processed in 153us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361765.891934:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00000040:0.0:1788361765.891937:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:2.0:1788361765.891938:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.891943:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 21 00000100:00100000:2.0:1788361765.891962:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919232:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788361765.891971:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.891983:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919232/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.891995:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.892000:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:2.0:1788361765.892340:0:96771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1788361765.892382:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.892387:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.892404:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.892415:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919360:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788361765.892438:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.892446:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.892462:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d137fd9050 x1875230429919360 msgsize 272 00000100:00100000:2.0:1788361765.892465:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.892467:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.892484:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.892503:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.892526:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919360 00000100:00100000:1.0:1788361765.892531:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919360 00000020:00000040:1.0:1788361765.892534:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.892536:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=22 00000100:00000040:1.0:1788361765.892550:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.892573:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00000040:1.0:1788361765.892576:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.892581:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137fd9050 x1875230429919360/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.892599:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919360:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788361765.892633:0:94209:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.892913:0:94209:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.892917:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919360 00000100:00000040:1.0:1788361765.892921:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.892924:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.892940:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.892962:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.892966:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137fd9050 x1875230429919360/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.892981:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919360:12345-0@lo:502:mount.lustre.0 Request processed in 384us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.892988:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00000040:1.0:1788361765.892991:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361765.892999:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 21 00000100:00000040:2.0:1788361765.893015:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.893026:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.893045:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919360:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788361765.893052:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.893063:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919360/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.893075:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.893087:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:2.0:1788361765.893211:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788361765.893233:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788361765.893250:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788361765.893265:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788361765.893278:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788361765.893301:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788361765.893317:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788361765.893331:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788361765.893344:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788361765.893358:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788361765.893373:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788361765.893388:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:2.0:1788361765.893395:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.893399:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.893414:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.893423:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919488:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788361765.893443:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.893450:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.893470:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d137fdb450 x1875230429919488 msgsize 272 00000100:00100000:2.0:1788361765.893474:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.893476:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1788361765.893575:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919488 00000100:00000040:2.0:1788361765.893580:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.893581:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919488 00000020:00000040:1.0:1788361765.893585:0:94208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.893590:0:94208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=22 00000100:00100000:2.0:1788361765.893603:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a9540 going to sleep for 11 seconds 00000100:00000040:1.0:1788361765.893606:0:94208:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.893645:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00000040:1.0:1788361765.893649:0:94208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.893653:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137fdb450 x1875230429919488/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.893665:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919488:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788361765.893682:0:94208:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.893707:0:94208:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.893709:0:94208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919488 00000100:00000040:1.0:1788361765.893714:0:94208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.893729:0:94208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.893751:0:94208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.893770:0:94208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.893774:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137fdb450 x1875230429919488/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.893783:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919488:12345-0@lo:502:mount.lustre.0 Request processed in 120us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.893798:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00000040:2.0:1788361765.893801:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.893802:0:94208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361765.893812:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 21 00000100:00000040:2.0:1788361765.893815:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.893844:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919488:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788361765.893852:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.893864:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919488/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.893877:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.893882:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:2.0:1788361765.893901:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788361765.893907:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:2.0:1788361765.894088:0:96771:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d117862d80 : new refcount 1 00000020:00000040:2.0:1788361765.894091:0:96771:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:0.0:1788361765.894578:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361765.894586:0:96775:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788361765.894592:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.894595:0:96775:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788361765.894602:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361765.894630:0:96775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99d105318000) 00000020:00000040:0.0:1788361765.894637:0:96775:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d137f10800 with handle 0x1b69fa8920fe508c to hash 00000020:00000040:0.0:1788361765.894643:0:96775:0:(genops.c:900:class_export_put()) PUTting export ffff99d137f10800 : new refcount 1 00000020:00000040:0.0:1788361765.894658:0:96775:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 2 - obd_device_list 00000020:00000080:0.0:1788361765.894662:0:96775:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:0.0:1788361765.894667:0:96775:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:0.0:1788361765.894676:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788361765.894739:0:96775:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d139ff5800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788361765.894746:0:96775:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000040:0.0:1788361765.894750:0:96775:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d137f15000 with handle 0x1b69fa8920fe5093 to hash 00000020:00000040:0.0:1788361765.894754:0:96775:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99d10531cd40) now 5 - export 00000020:00000040:0.0:1788361765.894757:0:96775:0:(genops.c:900:class_export_put()) PUTting export ffff99d137f15000 : new refcount 1 00000020:00000080:0.0:1788361765.894759:0:96775:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b69fa8920fe5093 00000020:00000040:0.0:1788361765.894761:0:96775:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe5093 00000020:00000040:0.0:1788361765.894762:0:96775:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d137f15000 refcount=2 00010000:00010000:0.0:1788361765.898209:0:96775:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:0.0:1788361765.898219:0:96775:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 343, crc32c 2411, adler 387, t10ip512 2735, t10ip4k 3995, t10crc512 605, t10crc4k 621 00002000:00000040:0.0:1788361765.898258:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:0.0:1788361765.898326:0:96775:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968751: rc = 0 00000001:00000040:0.0:1788361765.898331:0:96775:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:0.0:1788361765.898338:0:96775:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968741, last_xid = 1875230429458432, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1788361765.898343:0:96775:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968741 srv lr: 4294968751 lx: 1875230429458432 gen 0 00000020:00000040:0.0:1788361765.898352:0:96775:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d13fd7a000 with handle 0x1b69fa8920fe509a to hash 00000020:00000040:0.0:1788361765.898371:0:96775:0:(genops.c:889:class_export_get()) GET export ffff99d13fd7a000 refcount=3 00000020:00000040:0.0:1788361765.898376:0:96775:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 3 - export 00000001:00000040:0.0:1788361765.898379:0:96775:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:0.0:1788361765.898383:0:96775:0:(genops.c:900:class_export_put()) PUTting export ffff99d13fd7a000 : new refcount 2 00000001:00000040:0.0:1788361765.898387:0:96775:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968769, last_xid = 1875230429912576, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1788361765.898391:0:96775:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968769 srv lr: 4294968751 lx: 1875230429912576 gen 0 00000020:00000040:0.0:1788361765.898396:0:96775:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d13fd79000 with handle 0x1b69fa8920fe50a1 to hash 00000020:00000040:0.0:1788361765.898407:0:96775:0:(genops.c:889:class_export_get()) GET export ffff99d13fd79000 refcount=3 00000020:00000040:0.0:1788361765.898409:0:96775:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 4 - export 00000001:00000040:0.0:1788361765.898418:0:96775:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:0.0:1788361765.898421:0:96775:0:(genops.c:900:class_export_put()) PUTting export ffff99d13fd79000 : new refcount 2 00000001:00000040:0.0:1788361765.898426:0:96775:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = f1e400d1-472b-42d1-b5e7-e80dc701272a, last_transno = 4294968773, last_xid = 1875230407074560, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1788361765.898430:0:96775:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f1e400d1-472b-42d1-b5e7-e80dc701272a idx: 2 lr: 4294968773 srv lr: 4294968751 lx: 1875230407074560 gen 0 00000020:00000040:0.0:1788361765.898435:0:96775:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d136e1b800 with handle 0x1b69fa8920fe50a8 to hash 00000020:00000040:0.0:1788361765.898446:0:96775:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=3 00000020:00000040:0.0:1788361765.898449:0:96775:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 5 - export 00000001:00000040:0.0:1788361765.898451:0:96775:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID 'f1e400d1-472b-42d1-b5e7-e80dc701272a' added, generation 0 00000020:00000040:0.0:1788361765.898454:0:96775:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 2 00000001:00000040:0.0:1788361765.898458:0:96775:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:0.0:1788361765.898461:0:96775:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:0.0:1788361765.898465:0:96775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968773 00000001:00000040:0.0:1788361765.898508:0:96775:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968773: rc = 0 00000001:00000040:0.0:1788361765.898522:0:96775:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968773: rc = 0 00002000:00000040:0.0:1788361765.898533:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:0.0:1788361765.898569:0:96775:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:0.0:1788361765.898637:0:96775:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:0.0:1788361765.898646:0:96775:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:0.0:1788361765.898652:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:0.0:1788361765.898693:0:96775:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:0.0:1788361765.898701:0:96775:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:0.0:1788361765.898745:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:0.0:1788361765.898762:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:0.0:1788361765.898800:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:0.0:1788361765.898861:0:96775:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:0.0:1788361765.898886:0:96775:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:0.0:1788361765.899072:0:96775:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:0.0:1788361765.899298:0:96775:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:0.0:1788361765.900309:0:96775:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 6 - setup 00000020:00000080:0.0:1788361765.900313:0:96775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788361765.900323:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361765.900329:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.900331:0:96775:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788361765.900334:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361765.900337:0:96775:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788361765.900338:0:96775:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361765.900339:0:96775:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361765.900341:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361765.900343:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.900345:0:96775:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361765.900347:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361765.900351:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.900352:0:96775:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788361765.900355:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788361765.900357:0:96775:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788361765.900359:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361765.900361:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.900362:0:96775:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788361765.900364:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361765.900366:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.900367:0:96775:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788361765.900371:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788361765.900394:0:96775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361765.900397:0:96775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.900398:0:96775:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788361765.900401:0:96775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788361765.900561:0:96771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788361765.900594:0:96771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:2.0:1788361765.900609:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100030400 refcount=3 00010000:00010000:2.0:1788361765.900625:0:96771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe5085 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.900636:0:96771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe5085 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361765.900652:0:96771:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99d139ff5800 from 1 10000000:01000000:2.0:1788361765.900655:0:96771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:2.0:1788361765.900662:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00010000:00000040:2.0:1788361765.900686:0:96771:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d12172db00 count: 4 00000020:00000040:2.0:1788361765.900694:0:96771:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d005169000 with handle 0x1b69fa8920fe50af to hash 00010000:00010000:2.0:1788361765.900701:0:96771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.900708:0:96771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.900719:0:96771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361765.900742:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.900756:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919616:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788361765.900781:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.900790:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.900862:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d137fd9850 x1875230429919616 msgsize 328 00000100:00100000:2.0:1788361765.900868:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.900870:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.900894:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.900918:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919616 00000100:00100000:2.0:1788361765.900924:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361765.900927:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919616 00000020:00000040:3.0:1788361765.900932:0:94207:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:3.0:1788361765.900937:0:94207:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=22 00000100:00000040:3.0:1788361765.900956:0:94207:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788361765.900992:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00000040:3.0:1788361765.900997:0:94207:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:3.0:1788361765.901004:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137fd9850 x1875230429919616/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.901020:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:96771:x1875230429919616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361765.901035:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1788361765.901045:0:94207:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d009c1d200 count: 5 00000020:00000040:3.0:1788361765.901052:0:94207:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d100030e00 with handle 0x1b69fa8920fe50b6 to hash 00010000:00010000:3.0:1788361765.901057:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe50b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe50af expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788361765.901076:0:94207:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99d007453000 : new locks_count 17 00000020:00000040:3.0:1788361765.901079:0:94207:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=23 00010000:00000040:3.0:1788361765.901100:0:94207:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff99d009c1d200) refcount = 5 00010000:00000040:3.0:1788361765.901104:0:94207:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788361765.901111:0:94207:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d004308000/0x1b69fa8920fe44bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110d1 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788361765.901120:0:94207:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d1012ea000/0x1b69fa8920fe4246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe423f expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788361765.901127:0:94207:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d1012ea800/0x1b69fa8920fe421c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4215 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788361765.901133:0:94207:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d137c21400/0x1b69fa8920fe41a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe419e expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361765.901139:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe50b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe50af expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361765.901150:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d100030e00/0x1b69fa8920fe50b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe50af expref: 23 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361765.901161:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d100030e00, rc 0) 00010000:00000040:3.0:1788361765.901165:0:94207:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919616 00000100:00000040:3.0:1788361765.901175:0:94207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:3.0:1788361765.901181:0:94207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.901221:0:94207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.901245:0:94207:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:3.0:1788361765.901251:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137fd9850 x1875230429919616/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/344 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.901278:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429919616:12345-0@lo:101:mount.lustre.0 Request processed in 261us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361765.901287:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00000040:2.0:1788361765.901288:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.901291:0:94207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:3.0:1788361765.901301:0:94207:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00000040:2.0:1788361765.901317:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.901326:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919616:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788361765.901335:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.901345:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d005169000 refcount=4 00010000:00000040:2.0:1788361765.901350:0:96771:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99d005169000, remote cookie: 0x1b69fa8920fe50b6, flags: 0x0 00010000:00000040:2.0:1788361765.901355:0:96771:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff99d12172db00) refcount = 4 00010000:00000040:2.0:1788361765.901358:0:96771:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788361765.901361:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d139916200/0x1b69fa8920fe423f lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4246 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.901369:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d139917200/0x1b69fa8920fe4215 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe421c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.901376:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d1012eb400/0x1b69fa8920fe419e lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe41a5 expref: -99 pid: 94201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.901382:0:96771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe50b6 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.901392:0:96771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe50b6 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361765.901401:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919616/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.901412:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:00000040:2.0:1788361765.901421:0:96771:0:(mgc_request.c:108:config_log_get()) log params (ffff99d001ccae00) refs 2 00000020:00000040:2.0:1788361765.901430:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d005169000 refcount=3 10000000:00000040:2.0:1788361765.901458:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d117862d80 : new refcount 2 10000000:00000040:2.0:1788361765.901462:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 10000000:00000040:2.0:1788361765.901465:0:96771:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.135@tcp: copy local log params 00000040:00080000:2.0:1788361765.901631:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788361765.901905:0:96771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361765.902068:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788361765.902093:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788361765.902113:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788361765.902120:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1788361765.902153:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.902157:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.902179:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.902189:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919744:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788361765.902205:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.902214:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.902239:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d137fdac50 x1875230429919744 msgsize 504 00000100:00100000:2.0:1788361765.902244:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.902246:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.902267:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.902289:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919744 00000100:00100000:2.0:1788361765.902293:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.902296:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919744 00000020:00000040:1.0:1788361765.902300:0:94208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.902303:0:94208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00000040:1.0:1788361765.902318:0:94208:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.902346:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00000040:1.0:1788361765.902349:0:94208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.902355:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137fdac50 x1875230429919744/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 504/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.902367:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429919744:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1788361765.902382:0:94208:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:1.0:1788361765.902386:0:94208:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.902429:0:94208:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.902436:0:94208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919744 00000100:00000040:1.0:1788361765.902444:0:94208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.902447:0:94208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.902464:0:94208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.902488:0:94208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.902493:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137fdac50 x1875230429919744/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 504/272 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.902503:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429919744:12345-0@lo:501:mount.lustre.0 Request processed in 137us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.902510:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00000040:2.0:1788361765.902516:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.902521:0:94208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:2.0:1788361765.902530:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.902532:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00100000:2.0:1788361765.902543:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919744:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788361765.902558:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.902568:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.902571:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919744/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.902579:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.902586:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.902589:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.902601:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.902611:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919872:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788361765.902648:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.902656:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.902673:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d137fdb850 x1875230429919872 msgsize 272 00000100:00100000:2.0:1788361765.902677:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.902679:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.902697:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.902708:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.902717:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429919872 00000100:00100000:1.0:1788361765.902722:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429919872 00000020:00000040:1.0:1788361765.902724:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.902726:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00000040:1.0:1788361765.902735:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.902762:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00000040:1.0:1788361765.902765:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.902769:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137fdb850 x1875230429919872/t0(0) o503->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.902779:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429919872:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1788361765.902798:0:94209:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.902843:0:94209:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.902848:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429919872 00000100:00000040:1.0:1788361765.902864:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.902868:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.902886:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.902907:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.902913:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137fdb850 x1875230429919872/t0(0) o503->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8416 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.902923:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429919872:12345-0@lo:503:mount.lustre.0 Request processed in 144us (247us total) trans 0 rc 0/0 00000100:00000040:2.0:1788361765.902927:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.902933:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00000040:1.0:1788361765.902940:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:2.0:1788361765.902948:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.902949:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00100000:2.0:1788361765.902960:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429919872:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788361765.902967:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.902986:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429919872/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.903003:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.903009:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:2.0:1788361765.903326:0:96771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1788361765.903370:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.903375:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.903392:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.903402:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920000:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788361765.903425:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.903434:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.903454:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d137fd8c50 x1875230429920000 msgsize 272 00000100:00100000:2.0:1788361765.903458:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.903459:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.903481:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.903505:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920000 00000100:00100000:2.0:1788361765.903507:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361765.903512:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920000 00000020:00000040:3.0:1788361765.903516:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:3.0:1788361765.903519:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00000040:3.0:1788361765.903530:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788361765.903555:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00000040:3.0:1788361765.903558:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:3.0:1788361765.903563:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137fd8c50 x1875230429920000/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.903574:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429920000:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1788361765.903601:0:94211:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:3.0:1788361765.903647:0:94211:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:3.0:1788361765.903650:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920000 00000100:00000040:3.0:1788361765.903655:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:3.0:1788361765.903658:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.903677:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.903694:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:3.0:1788361765.903699:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137fd8c50 x1875230429920000/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.903707:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429920000:12345-0@lo:502:mount.lustre.0 Request processed in 135us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361765.903722:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00000040:3.0:1788361765.903725:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:3.0:1788361765.903731:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00000040:3.0:1788361765.903920:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.903932:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.903939:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920000:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.903946:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.903958:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117282d80 x1875230429920000/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.903973:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.903980:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:3.0:1788361765.904163:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788361765.904191:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788361765.904207:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788361765.904226:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788361765.904240:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:3.0:1788361765.904246:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.904250:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361765.904266:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.904273:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920128:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.904295:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.904311:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.904332:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d103ac9050 x1875230429920128 msgsize 272 00000100:00100000:3.0:1788361765.904337:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.904339:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361765.904365:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.904385:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102f500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.904510:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920128 00000100:00100000:1.0:1788361765.904522:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920128 00000020:00000040:1.0:1788361765.904524:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.904527:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00000040:1.0:1788361765.904539:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.904566:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00000040:1.0:1788361765.904569:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.904573:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d103ac9050 x1875230429920128/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.904585:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429920128:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788361765.904604:0:94209:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.904646:0:94209:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.904649:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920128 00000100:00000040:1.0:1788361765.904654:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.904658:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.904678:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.904708:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.904713:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d103ac9050 x1875230429920128/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.904721:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429920128:12345-0@lo:502:mount.lustre.0 Request processed in 138us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.904727:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00000040:1.0:1788361765.904730:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361765.904736:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00000040:2.0:1788361765.904765:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.904776:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.904785:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110549180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920128:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788361765.904792:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.904816:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d110549180 x1875230429920128/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.904860:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:2.0:1788361765.904866:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:2.0:1788361765.904898:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788361765.904908:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:2.0:1788361765.905248:0:96771:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d117862d80 : new refcount 1 00000020:00000040:2.0:1788361765.905264:0:96771:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:0.0:1788361765.906012:0:96779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361765.906022:0:96779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.906025:0:96779:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361765.906033:0:96779:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d139ff5800 00000020:00000080:0.0:1788361765.906041:0:96779:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361765.906051:0:96779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361765.906053:0:96779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.906054:0:96779:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361765.906057:0:96779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361765.906060:0:96779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.906062:0:96779:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361765.906065:0:96779:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99d139ff5800 00000020:00000080:0.0:1788361765.906068:0:96779:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361765.906119:0:96779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361765.906123:0:96779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361765.906125:0:96779:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788361765.906128:0:96779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:2.0:1788361765.906249:0:96771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788361765.906276:0:96771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:2.0:1788361765.906320:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d005169000 refcount=3 00010000:00010000:2.0:1788361765.906328:0:96771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe50b6 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.906339:0:96771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d005169000/0x1b69fa8920fe50af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe50b6 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361765.906390:0:96771:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788361765.906392:0:96771:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d139ff5800 10000000:01000000:2.0:1788361765.906395:0:96771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d139ff5800 10000000:01000000:2.0:1788361765.906399:0:96771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1788361765.906402:0:96771:0:(genops.c:889:class_export_get()) GET export ffff99d109072800 refcount=20 10000000:01000000:2.0:1788361765.906405:0:96771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99d139ff5800 from 1 10000000:01000000:2.0:1788361765.906407:0:96771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:2.0:1788361765.906412:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00010000:00000040:2.0:1788361765.906429:0:96771:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d122d96f00 count: 9 00000020:00000040:2.0:1788361765.906435:0:96771:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d005168a00 with handle 0x1b69fa8920fe50bd to hash 00010000:00010000:2.0:1788361765.906441:0:96771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.906454:0:96771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.906463:0:96771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361765.906480:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.906493:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920256:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788361765.906525:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.906534:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.906566:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d103ac9c50 x1875230429920256 msgsize 328 00000100:00100000:2.0:1788361765.906570:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.906572:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788361765.906600:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.906643:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0045a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.906697:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920256 00000100:00100000:1.0:1788361765.906710:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920256 00000020:00000040:1.0:1788361765.906713:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.906716:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00000040:1.0:1788361765.906732:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.906764:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00000040:1.0:1788361765.906767:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.906771:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d103ac9c50 x1875230429920256/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.906779:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:96771:x1875230429920256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361765.906790:0:94211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788361765.906797:0:94211:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d112cab200 count: 11 00000020:00000040:1.0:1788361765.906802:0:94211:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d1012ea200 with handle 0x1b69fa8920fe50c4 to hash 00010000:00010000:1.0:1788361765.906806:0:94211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe50c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe50bd expref: -99 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906813:0:94211:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99d007453000 : new locks_count 18 00000020:00000040:1.0:1788361765.906815:0:94211:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=24 00010000:00000040:1.0:1788361765.906856:0:94211:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99d112cab200) refcount = 11 00010000:00000040:1.0:1788361765.906861:0:94211:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788361765.906864:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d005168200/0x1b69fa8920fe5085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe507e expref: 24 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906872:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715d200/0x1b69fa8920fe46ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe46a6 expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906879:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715ca00/0x1b69fa8920fe4683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe467c expref: 24 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906886:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d00458d800/0x1b69fa8920fe4675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe466e expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906893:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d137c21a00/0x1b69fa8920fe4667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4660 expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906900:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d00458c000/0x1b69fa8920fe4659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4652 expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906916:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715c200/0x1b69fa8920fe464b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4644 expref: 24 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906924:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d00458c200/0x1b69fa8920fe463d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe4636 expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906934:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715d600/0x1b69fa8920fe462f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71113a expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.906941:0:94211:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d13715c800/0x1b69fa8920fe4628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae711133 expref: 9 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.906948:0:94211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe50c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe50bd expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.906959:0:94211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea200/0x1b69fa8920fe50c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe50bd expref: 24 pid: 94211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.906968:0:94211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea200, rc 0) 00010000:00000040:1.0:1788361765.906972:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920256 00000100:00000040:1.0:1788361765.906980:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.906985:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.907006:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.907033:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.907038:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d103ac9c50 x1875230429920256/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/344 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.907047:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920256:12345-0@lo:101:mount.lustre.0 Request processed in 269us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.907064:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00000040:1.0:1788361765.907067:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361765.907078:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:0.0:1788361765.907104:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.907115:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.907123:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920256:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1788361765.907130:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.907141:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d005168a00 refcount=4 00010000:00000040:0.0:1788361765.907146:0:96771:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99d005168a00, remote cookie: 0x1b69fa8920fe50c4, flags: 0x0 00010000:00000040:0.0:1788361765.907152:0:96771:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99d122d96f00) refcount = 9 00010000:00000040:0.0:1788361765.907154:0:96771:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788361765.907157:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d100030400/0x1b69fa8920fe507e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe5085 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907165:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101492000/0x1b69fa8920fe46a6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe46ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907182:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101493800/0x1b69fa8920fe467c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4683 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907189:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d13715c000/0x1b69fa8920fe466e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4675 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907195:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101493400/0x1b69fa8920fe4660 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4667 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907201:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101492800/0x1b69fa8920fe4652 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe4659 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907207:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101493a00/0x1b69fa8920fe4644 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe464b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.907213:0:96771:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d101492400/0x1b69fa8920fe4636 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe463d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.907219:0:96771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe50c4 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.907228:0:96771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe50c4 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788361765.907248:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117280e00 x1875230429920256/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.907259:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:00000040:0.0:1788361765.907265:0:96771:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff99d13664cc00) refs 2 00000020:00000040:0.0:1788361765.907269:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d005168a00 refcount=3 10000000:00000040:0.0:1788361765.907294:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d117862d80 : new refcount 2 10000000:00000040:0.0:1788361765.907303:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 10000000:00000040:0.0:1788361765.907306:0:96771:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.135@tcp: copy local log lustre-client 00000040:00080000:0.0:1788361765.907457:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788361765.907725:0:96771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361765.907950:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788361765.907982:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788361765.908001:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788361765.908020:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788361765.908039:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788361765.908058:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788361765.908075:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788361765.908091:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788361765.908106:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788361765.908121:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788361765.908137:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788361765.908151:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788361765.908167:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788361765.908185:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788361765.908201:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788361765.908217:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788361765.908232:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788361765.908248:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788361765.908269:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788361765.908288:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788361765.908305:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788361765.908319:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788361765.908333:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788361765.908352:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788361765.908368:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788361765.908378:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788361765.908386:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788361765.908395:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788361765.908402:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788361765.908427:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788361765.908443:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788361765.908456:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788361765.908471:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788361765.908484:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788361765.908501:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788361765.908520:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788361765.908539:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788361765.908569:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788361765.908578:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:0.0:1788361765.908645:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:0.0:1788361765.908650:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:0.0:1788361765.908678:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.908688:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920384:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788361765.908713:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.908722:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.908759:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d103aca450 x1875230429920384 msgsize 512 00000100:00100000:0.0:1788361765.908764:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361765.908766:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788361765.908793:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.908816:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.908892:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920384 00000100:00100000:1.0:1788361765.908899:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920384 00000020:00000040:1.0:1788361765.908906:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.908911:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:1.0:1788361765.908929:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.908958:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:1.0:1788361765.908963:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.908969:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d103aca450 x1875230429920384/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 512/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.908982:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920384:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1788361765.909001:0:94209:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:1.0:1788361765.909004:0:94209:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.909070:0:94209:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00000020:00000040:1.0:1788361765.909079:0:94209:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=25 00000020:00000040:1.0:1788361765.909083:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 24 00010000:00000040:1.0:1788361765.909087:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920384 00000100:00000040:1.0:1788361765.909097:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.909102:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.909122:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.909148:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.909154:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d103aca450 x1875230429920384/t0(0) o501->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 512/272 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.909165:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920384:12345-0@lo:501:mount.lustre.0 Request processed in 184us (403us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361765.909179:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.909186:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:1.0:1788361765.909192:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:0.0:1788361765.909199:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.909204:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00100000:0.0:1788361765.909212:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920384:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788361765.909228:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.909239:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:0.0:1788361765.909243:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185eaa00 x1875230429920384/t0(0) o501->MGC192.168.204.135@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.909252:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000040:0.0:1788361765.909261:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:0.0:1788361765.909264:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:0.0:1788361765.909278:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.909286:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920512:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1788361765.909314:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.909322:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.909339:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d103ac9850 x1875230429920512 msgsize 272 00000100:00100000:0.0:1788361765.909344:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361765.909346:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788361765.909364:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.909384:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d137c966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361765.909395:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920512 00000100:00100000:1.0:1788361765.909400:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920512 00000020:00000040:1.0:1788361765.909403:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.909406:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:1.0:1788361765.909423:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.909445:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:1.0:1788361765.909448:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.909454:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d103ac9850 x1875230429920512/t0(0) o503->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.909467:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920512:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1788361765.909488:0:94211:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.909517:0:94211:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.909520:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920512 00000100:00000040:1.0:1788361765.909525:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.909528:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.909548:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.909571:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.909580:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d103ac9850 x1875230429920512/t0(0) o503->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8416 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.909589:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920512:12345-0@lo:503:mount.lustre.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.909596:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:1.0:1788361765.909599:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:0.0:1788361765.909613:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.909614:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:0.0:1788361765.909640:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.909647:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920512:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1788361765.909655:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.909676:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185eaa00 x1875230429920512/t0(0) o503->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.909692:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:0.0:1788361765.909698:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:0.0:1788361765.910085:0:96771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1788361765.910125:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:0.0:1788361765.910131:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:0.0:1788361765.910146:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.910153:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920640:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788361765.910174:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.910181:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.910204:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d103ac8850 x1875230429920640 msgsize 272 00000100:00100000:0.0:1788361765.910209:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361765.910211:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788361765.910230:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.910247:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361765.910883:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920640 00000100:00100000:2.0:1788361765.910890:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920640 00000020:00000040:2.0:1788361765.910892:0:94207:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:2.0:1788361765.910896:0:94207:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:2.0:1788361765.910915:0:94207:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788361765.910938:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:2.0:1788361765.910942:0:94207:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:2.0:1788361765.910948:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d103ac8850 x1875230429920640/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.910962:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920640:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1788361765.910994:0:94207:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:2.0:1788361765.911038:0:94207:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:2.0:1788361765.911043:0:94207:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920640 00000100:00000040:2.0:1788361765.911049:0:94207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361765.911054:0:94207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.911081:0:94207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.911109:0:94207:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:2.0:1788361765.911115:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d103ac8850 x1875230429920640/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.911124:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920640:12345-0@lo:502:mount.lustre.0 Request processed in 164us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361765.911131:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:2.0:1788361765.911133:0:94207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:2.0:1788361765.911140:0:94207:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:3.0:1788361765.911234:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.911245:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.911253:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920640:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.911262:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.911275:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185eaa00 x1875230429920640/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.911292:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.911300:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:3.0:1788361765.911477:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788361765.911512:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788361765.911533:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788361765.911550:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788361765.911567:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788361765.911581:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788361765.911595:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788361765.911612:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788361765.911648:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788361765.911673:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788361765.911702:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788361765.911720:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788361765.911738:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788361765.911754:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788361765.911777:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788361765.911796:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788361765.911811:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788361765.911914:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788361765.911936:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788361765.911951:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788361765.911967:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788361765.911982:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788361765.911996:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788361765.912011:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788361765.912024:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788361765.912036:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788361765.912053:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788361765.912068:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788361765.912081:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788361765.912095:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788361765.912111:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788361765.912126:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788361765.912141:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788361765.912155:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788361765.912168:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788361765.912183:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788361765.912199:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788361765.912211:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788361765.912225:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788361765.912240:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788361765.912259:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788361765.912274:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788361765.912293:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788361765.912318:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788361765.912332:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788361765.912347:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788361765.912361:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788361765.912376:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:3.0:1788361765.912396:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.912402:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361765.912423:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.912434:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920768:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.912462:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.912470:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.912494:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d103ac8450 x1875230429920768 msgsize 272 00000100:00100000:3.0:1788361765.912498:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.912500:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361765.912556:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.912576:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102f500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361765.912608:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920768 00000100:00100000:2.0:1788361765.912613:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920768 00000020:00000040:2.0:1788361765.912624:0:94208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:2.0:1788361765.912628:0:94208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:2.0:1788361765.912642:0:94208:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788361765.912665:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:2.0:1788361765.912668:0:94208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:2.0:1788361765.912674:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d103ac8450 x1875230429920768/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.912685:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920768:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1788361765.912708:0:94208:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:2.0:1788361765.912746:0:94208:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:2.0:1788361765.912756:0:94208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920768 00000100:00000040:2.0:1788361765.912763:0:94208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:2.0:1788361765.912767:0:94208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.912789:0:94208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.912818:0:94208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:2.0:1788361765.912849:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d103ac8450 x1875230429920768/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.912858:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d103ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920768:12345-0@lo:502:mount.lustre.0 Request processed in 174us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361765.912865:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:2.0:1788361765.912868:0:94208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:3.0:1788361765.912870:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.912878:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:3.0:1788361765.912883:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.912892:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920768:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.912901:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.912914:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d110548e00 x1875230429920768/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.912936:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.912942:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:3.0:1788361765.913085:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788361765.913105:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1788361765.913114:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788361765.913124:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1788361765.913135:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1788361765.913151:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1788361765.913169:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1788361765.913186:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1788361765.913201:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1788361765.913217:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1788361765.913232:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1788361765.913248:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1788361765.913265:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1788361765.913283:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:3.0:1788361765.913291:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.913296:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361765.913310:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.913320:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920896:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.913342:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.913350:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.913366:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d1412a4c50 x1875230429920896 msgsize 272 00000100:00100000:3.0:1788361765.913370:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.913371:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361765.913387:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.913412:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429920896 00000100:00100000:1.0:1788361765.913416:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429920896 00000100:00100000:3.0:1788361765.913418:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d102f500c0 going to sleep for 11 seconds 00000020:00000040:1.0:1788361765.913418:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.913423:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:1.0:1788361765.913434:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361765.913451:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1788361765.913453:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.913456:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1412a4c50 x1875230429920896/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.913464:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920896:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788361765.913478:0:94209:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d134a62f00 : new refcount 2 00000040:00000040:1.0:1788361765.913503:0:94209:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d134a62f00 : new refcount 1 00010000:00000040:1.0:1788361765.913507:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429920896 00000100:00000040:1.0:1788361765.913512:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:1.0:1788361765.913516:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.913536:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.913557:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 51 to 0@lo 00000100:00000040:1.0:1788361765.913561:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1412a4c50 x1875230429920896/t0(0) o502->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 272/8472 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.913567:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429920896:12345-0@lo:502:mount.lustre.0 Request processed in 103us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.913572:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1788361765.913574:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361765.913581:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:3.0:1788361765.913583:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.913590:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.913595:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429920896:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788361765.913599:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.913607:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d110548e00 x1875230429920896/t0(0) o502->MGC192.168.204.135@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.913631:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361765.913638:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000040:00080000:3.0:1788361765.913659:0:96771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:3.0:1788361765.913666:0:96771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:3.0:1788361765.913937:0:96771:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d117862d80 : new refcount 1 00000020:00000040:3.0:1788361765.913942:0:96771:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:3.0:1788361765.914406:0:96782:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.135@tcp 192.168.204.135@tcp cnt=1 00000020:01000004:3.0:1788361765.914427:0:96782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788361765.914442:0:96782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) 00000020:00000040:3.0:1788361765.914449:0:96782:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d10f775000 with handle 0x1b69fa8920fe50cb to hash 00000020:00000040:3.0:1788361765.914455:0:96782:0:(genops.c:900:class_export_put()) PUTting export ffff99d10f775000 : new refcount 1 00000020:00000040:3.0:1788361765.914471:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) now 2 - obd_device_list 00000020:00000080:3.0:1788361765.914476:0:96782:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788361765.914647:0:96782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d139ff5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788361765.914652:0:96782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d139ff5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788361765.914655:0:96782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d139ff5800 3 00000020:00000040:3.0:1788361765.914670:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) now 3 - import 00000020:00000040:3.0:1788361765.914681:0:96782:0:(genops.c:1244:class_import_put()) import ffff99d001c6d800 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1788361765.914691:0:96782:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:3.0:1788361765.914694:0:96782:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 52 to 0@lo 00000100:00000040:3.0:1788361765.914696:0:96782:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.135@tcp -> ffff99d104d3b280 00010000:00080000:3.0:1788361765.914701:0:96782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d001c6d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788361765.916383:0:96782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:3.0:1788361765.916480:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) now 4 - setup 00000020:00000080:3.0:1788361765.916485:0:96782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788361765.916520:0:96782:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1788361765.916526:0:96782:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d001c6f800 with handle 0x1b69fa8920fe50d2 to hash 00000020:00000040:3.0:1788361765.916533:0:96782:0:(genops.c:889:class_export_get()) GET export ffff99d001c6f800 refcount=3 00000020:00000040:3.0:1788361765.916537:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) now 5 - export 00000020:00000040:3.0:1788361765.916540:0:96782:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6f800 : new refcount 2 00000020:00000080:3.0:1788361765.916542:0:96782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1b69fa8920fe50d2 00000020:00000040:3.0:1788361765.916544:0:96782:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50d2 00000020:00000040:3.0:1788361765.916547:0:96782:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d001c6f800 refcount=3 00000100:00080000:3.0:1788361765.916555:0:96782:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1788361765.916559:0:96782:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 53 to 0@lo 00000020:00000040:3.0:1788361765.916562:0:96782:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50d2 00000020:00000040:3.0:1788361765.916564:0:96782:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d001c6f800 refcount=4 00000100:00000040:3.0:1788361765.916566:0:96782:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 54 to 0@lo 00000020:00000040:3.0:1788361765.916568:0:96782:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6f800 : new refcount 3 00000100:00080000:3.0:1788361765.916570:0:96782:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d001c6d800 using connection 192.168.204.135@tcp/0@lo 00000020:00000040:3.0:1788361765.916584:0:96782:0:(genops.c:1231:class_import_get()) import ffff99d001c6d800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:3.0:1788361765.916603:0:96782:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361765.916630:0:96782:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000032ba0903] to pc [ptlrpcd_rcv+-1] req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361765.916654:0:96782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:3.0:1788361765.916664:0:96782:0:(genops.c:1231:class_import_get()) import ffff99d001c6d800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1788361765.916682:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.916699:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429921024:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788361765.916732:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361775 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.916740:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.916760:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788361765.916772:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d002dff000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1788361765.916782:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185eb480 x1875230429921024 msgsize 520 00000100:00000040:1.0:1788361765.916788:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361765.916801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.916807:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000013bfe0f4] to pc [ptlrpcd_00_03+3] req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.916854:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361775 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.916861:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788361765.916864:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921024 00000100:00000040:0.0:1788361765.916868:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000020:00000040:1.0:1788361765.916870:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d002dfb000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:3.0:1788361765.916872:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921024 00000020:00000040:3.0:1788361765.916876:0:66126:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00000040:1.0:1788361765.916884:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788361765.916897:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000528e0051] to pc [ptlrpcd_00_00+0] req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.916906:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361765.916914:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00000040:0.0:1788361765.916918:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.916920:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1788361765.916923:0:66126:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185eb480 x1875230429921024/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788361785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.916932:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d106904000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1788361765.916946:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429921152:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.916948:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361765.916950:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875230429921024:12345-0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788361765.916968:0:3652:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.916970:0:66126:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 14 - find 00000100:00000040:1.0:1788361765.916974:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003d322a5e] to pc [ptlrpcd_00_01+1] req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788361765.916981:0:66126:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00000100:00000040:0.0:1788361765.916992:0:3652:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00080000:3.0:1788361765.916994:0:66126:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 2805 last 0 00000100:00080000:1.0:1788361765.916999:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788361765.917003:0:66126:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d001c6d000 with handle 0x1b69fa8920fe50d9 to hash 00000100:00080000:1.0:1788361765.917004:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788361765.917009:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1788361765.917013:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185eb100 x1875230429921152 msgsize 224 00000100:00080000:1.0:1788361765.917015:0:48377:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2803 00000100:00080000:1.0:1788361765.917022:0:48377:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1788361765.917023:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.917029:0:48377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 53 to 0@lo 00000020:00000040:3.0:1788361765.917032:0:66126:0:(genops.c:889:class_export_get()) GET export ffff99d001c6d000 refcount=3 00000100:00000040:1.0:1788361765.917035:0:48377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 54 to 0@lo 00000020:00000040:3.0:1788361765.917038:0:66126:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 15 - export 00000020:00000040:1.0:1788361765.917039:0:48377:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fdda9d 00000100:00000040:0.0:1788361765.917043:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.917044:0:66126:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6d000 : new refcount 2 00000020:00000040:1.0:1788361765.917045:0:48377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136ca7800 refcount=4 00000020:00000080:3.0:1788361765.917049:0:66126:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b69fa8920fe50d9 00000020:00000040:3.0:1788361765.917054:0:66126:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50d9 00000020:00000040:3.0:1788361765.917059:0:66126:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d001c6d000 refcount=3 00000100:00000040:1.0:1788361765.917061:0:48377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 53 to 0@lo 00000100:00000040:0.0:1788361765.917063:0:3652:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 3468 usecs (4 jiffies) 00000100:00000040:1.0:1788361765.917068:0:48377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 54 to 0@lo 00000001:00000040:3.0:1788361765.917071:0:66126:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.135@tcp 00000020:00000040:1.0:1788361765.917073:0:48377:0:(genops.c:900:class_export_put()) PUTting export ffff99d136ca7800 : new refcount 3 00000001:00000040:3.0:1788361765.917078:0:66126:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 17 00000100:00080000:1.0:1788361765.917078:0:48377:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99d108bef800 using connection 192.168.204.135@tcp/0@lo 00000020:00000040:3.0:1788361765.917085:0:66126:0:(genops.c:889:class_export_get()) GET export ffff99d001c6d000 refcount=4 00000001:00000040:3.0:1788361765.917089:0:66126:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 18 00000020:00000040:1.0:1788361765.917092:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d108bef800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000001:00000040:3.0:1788361765.917094:0:66126:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99d1377f8800) : new refcount 17 00000004:00100000:3.0:1788361765.917102:0:66126:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788361765.917106:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1788361765.917113:0:66126:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99d1046e2120 for nid 0@lo - ref 6 00000100:00000040:1.0:1788361765.917121:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f2f174b8] to pc [ptlrpcd_rcv+-1] req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.917125:0:66126:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 16 - import 00000020:00000040:3.0:1788361765.917138:0:66126:0:(genops.c:1244:class_import_put()) import ffff99d10f773000 refcount=1 obd=lustre-MDT0000 00000100:00000040:1.0:1788361765.917142:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788361765.917146:0:66126:0:(genops.c:889:class_export_get()) GET export ffff99d001c6d000 refcount=5 00000020:00000040:1.0:1788361765.917149:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d136773800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788361765.917150:0:66126:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99d001c6d000 : new rpc_count 1 00000100:00000040:3.0:1788361765.917161:0:66126:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 55 to 0@lo 00000100:00000040:1.0:1788361765.917163:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361765.917166:0:66126:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 55 to 0@lo 00000020:00000040:3.0:1788361765.917173:0:66126:0:(genops.c:889:class_export_get()) GET export ffff99d001c6d000 refcount=6 00000100:00000040:1.0:1788361765.917182:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ba90082b] to pc [ptlrpcd_00_02+2] req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.917182:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.917185:0:66126:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00080000:3.0:1788361765.917197:0:66126:0:(import.c:65:import_set_state_nolock()) ffff99d10f773000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1788361765.917206:0:66126:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6d000 : new refcount 5 00000020:00000040:3.0:1788361765.917212:0:66126:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99d001c619c0) now 16 - find 00000100:00100000:0.0:1788361765.917218:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429921536:0@lo:8:kworker.0 00000100:00000040:1.0:1788361765.917224:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00000040:3.0:1788361765.917228:0:66126:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429921024 00000020:00000040:1.0:1788361765.917232:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d10f770000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788361765.917239:0:66126:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:0.0:1788361765.917239:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361785 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917245:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361765.917249:0:66126:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.917254:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.917267:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001f215df0] to pc [ptlrpcd_00_03+3] req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.917274:0:66126:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361775 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917282:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1788361765.917284:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d13a26b050 x1875230429921536 msgsize 520 00000020:00000040:1.0:1788361765.917293:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d12c4e1000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00100000:0.0:1788361765.917294:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.917298:0:66126:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00000040:0.0:1788361765.917299:0:3649:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788361765.917308:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361765.917309:0:66126:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185eb480 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788361785 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.917319:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361785 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.917343:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875230429921024:12345-0@lo:38:llog_process_th.0 Request processed in 394us (556us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361765.917344:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2661 usecs (3 jiffies) 00000100:00100000:3.0:1788361765.917361:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00000040:1.0:1788361765.917365:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000039b42d] to pc [ptlrpcd_00_00+0] req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.917366:0:66126:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d001c6d000 : new rpc_count 0 00000020:00000040:3.0:1788361765.917377:0:66126:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6d000 : new refcount 4 00000100:00100000:0.0:1788361765.917377:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361765.917378:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361765.917385:0:48377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000040:0.0:1788361765.917385:0:3649:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00100000:3.0:1788361765.917389:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921152 00000100:00080000:1.0:1788361765.917390:0:48377:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788361765.917394:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921152 00000100:00000040:0.0:1788361765.917395:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.917398:0:66126:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42a1 00000100:00080000:1.0:1788361765.917399:0:48377:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2803 00000020:00000040:3.0:1788361765.917404:0:66126:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d104f3e000 refcount=5 00000100:00080000:1.0:1788361765.917405:0:48377:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:1.0:1788361765.917413:0:48377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 55 to 0@lo 00000020:00000040:3.0:1788361765.917417:0:66126:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 16 - evictor 00000100:00080000:0.0:1788361765.917417:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00000040:1.0:1788361765.917418:0:48377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 56 to 0@lo 00000020:00000040:0.0:1788361765.917423:0:3649:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50d2 00000020:00000040:1.0:1788361765.917425:0:48377:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4166 00000020:00000040:0.0:1788361765.917427:0:3649:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d001c6f800 refcount=4 00000020:00000040:1.0:1788361765.917431:0:48377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0055d6800 refcount=4 00000100:00080000:0.0:1788361765.917435:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00000040:1.0:1788361765.917436:0:48377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 55 to 0@lo 00000100:00000040:3.0:1788361765.917438:0:66126:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000020:00000040:0.0:1788361765.917441:0:3649:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6f800 : new refcount 3 00000100:00000040:1.0:1788361765.917444:0:48377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00080000:0.0:1788361765.917447:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000020:00000040:1.0:1788361765.917449:0:48377:0:(genops.c:900:class_export_put()) PUTting export ffff99d0055d6800 : new refcount 3 00000100:00080000:0.0:1788361765.917451:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d001c6d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788361765.917454:0:48377:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d005034000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788361765.917461:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00000040:0.0:1788361765.917463:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361775 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.917465:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d005034000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788361765.917466:0:66126:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d104f3e000 : new rpc_count 1 00000100:00000040:3.0:1788361765.917475:0:66126:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185eb100 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.917479:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d110548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875230429921024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361765.917483:0:48377:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788361765.917493:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d110548e00 x1875230429921024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361775 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917508:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c1d1ca5d] to pc [ptlrpcd_rcv+-1] req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.917527:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d001c6d800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1788361765.917531:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788361765.917533:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429921152:12345-0@lo:400:kworker.0 00000020:00000040:1.0:1788361765.917538:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d117299000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1788361765.917544:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788361765.917549:0:66126:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429921152 00000100:00000040:1.0:1788361765.917551:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361765.917559:0:66126:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00100000:0.0:1788361765.917562:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429922048:0@lo:8:kworker.0 00000100:00000040:3.0:1788361765.917570:0:66126:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.917579:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000054970bf6] to pc [ptlrpcd_00_01+1] req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.917587:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361785 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.917592:0:66126:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.917626:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.917627:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788361765.917635:0:48377:0:(genops.c:1231:class_import_get()) import ffff99d10f55a000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1788361765.917648:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e8e00 x1875230429922048 msgsize 520 00000100:00000040:1.0:1788361765.917649:0:48377:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361765.917650:0:66126:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00100000:0.0:1788361765.917660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361765.917661:0:66126:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185eb100 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917675:0:48377:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000080247ac] to pc [ptlrpcd_00_02+2] req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.917680:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429921152:12345-0@lo:400:kworker.0 Request processed in 149us (662us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361765.917682:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361785 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.917697:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00000040:3.0:1788361765.917704:0:66126:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d104f3e000 : new rpc_count 0 00000100:00000040:1.0:1788361765.917704:0:48377:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (2810) 00000100:00000040:0.0:1788361765.917711:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4683 usecs (5 jiffies) 00000020:00000040:3.0:1788361765.917716:0:66126:0:(genops.c:900:class_export_put()) PUTting export ffff99d104f3e000 : new refcount 4 00000100:00000040:1.0:1788361765.917724:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.917736:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429921280:0@lo:400:kworker.0 00000100:00100000:0.0:1788361765.917738:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921536 00000100:00100000:0.0:1788361765.917744:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921536 00000100:00100000:3.0:1788361765.917745:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922048 00000020:00000040:0.0:1788361765.917747:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddab2 00000100:00100000:3.0:1788361765.917751:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922048 00000020:00000040:3.0:1788361765.917754:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe417b 00000100:00000040:1.0:1788361765.917755:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917766:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788361765.917777:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009 00000100:00000040:0.0:1788361765.917783:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d13a26b050 x1875230429921536/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917785:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d104299c00 x1875230429921280 msgsize 224 00000100:00100000:3.0:1788361765.917788:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010 00000100:00000040:3.0:1788361765.917798:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e8e00 x1875230429922048/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.917800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361765.917810:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d13a26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3649:x1875230429921536:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788361765.917818:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3649:x1875230429922048:12345-0@lo:8:kworker.0 00000100:00000040:1.0:1788361765.917843:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917858:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 3797 usecs (4 jiffies) 00000100:00000040:1.0:1788361765.917864:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.917873:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429921920:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.917888:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917895:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.917909:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d104299500 x1875230429921920 msgsize 224 00000100:00100000:1.0:1788361765.917920:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.917937:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917948:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1118 usecs (2 jiffies) 00000100:00100000:1.0:1788361765.917957:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1788361765.917963:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.917972:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429921408:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.917985:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.917993:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.918004:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d104298a80 x1875230429921408 msgsize 224 00000100:00100000:1.0:1788361765.918007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.918020:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918028:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2660247 usecs (2661 jiffies) 00000100:00000040:1.0:1788361765.918033:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.918040:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429922176:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.918049:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918054:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.918062:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d136b5ad80 x1875230429922176 msgsize 224 00000100:00100000:1.0:1788361765.918066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:0.0:1788361765.918076:0:8439:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 7 - find 00000100:00000040:1.0:1788361765.918077:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1788361765.918083:0:8439:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1788361765.918086:0:26161:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 8 - find 00000020:00000040:0.0:1788361765.918088:0:8439:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99d105318000) now 8 - find 00000100:00000040:1.0:1788361765.918090:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 4261 usecs (5 jiffies) 00010000:00000040:3.0:1788361765.918095:0:26161:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1788361765.918099:0:26161:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99d105318000) now 7 - find 00000100:00000040:0.0:1788361765.918101:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:0.0:1788361765.918105:0:8439:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:0.0:1788361765.918108:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1788361765.918109:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921920 00000100:00000040:3.0:1788361765.918112:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 58 to 0@lo 00000100:00000040:3.0:1788361765.918117:0:26161:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 58 to 0@lo 00000100:00100000:1.0:1788361765.918120:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921920 00000020:00000040:1.0:1788361765.918122:0:8449:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe415f 00000100:00000040:0.0:1788361765.918126:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361785 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.918128:0:8449:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002ffa000 refcount=5 00000100:00000040:3.0:1788361765.918134:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.918143:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918151:0:8449:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:0.0:1788361765.918152:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00100000:2.0:1788361765.918157:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429921792:0@lo:400:kworker.0 00000100:00000040:0.0:1788361765.918158:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d13a26b050 x1875230429921536/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.918163:0:26161:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361785 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.918173:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921408 00000100:00100000:0.0:1788361765.918177:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d13a26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3649:x1875230429921536:12345-0@lo:8:kworker.0 Request processed in 366us (888us total) trans 0 rc -11/-11 00000100:00000040:2.0:1788361765.918178:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.918180:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921408 00000020:00000040:1.0:1788361765.918184:0:8449:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4119 00000020:00000040:1.0:1788361765.918188:0:8449:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d116c07800 refcount=7 00000100:00100000:0.0:1788361765.918194:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009 00000100:00000040:3.0:1788361765.918195:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00000040:3.0:1788361765.918202:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e8e00 x1875230429922048/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918202:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1788361765.918211:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3649:x1875230429922048:12345-0@lo:8:kworker.0 Request processed in 397us (562us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361765.918219:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010 00000100:00000040:2.0:1788361765.918219:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d117283b80 x1875230429921792 msgsize 224 00000100:00100000:1.0:1788361765.918223:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4240 00000100:00100000:2.0:1788361765.918229:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.918230:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d002ffa000 : new rpc_count 1 00000100:00000040:1.0:1788361765.918238:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104299500 x1875230429921920/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.918239:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922176 00000100:00100000:3.0:1788361765.918244:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922176 00000020:00000040:3.0:1788361765.918248:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4189 00000100:00000040:2.0:1788361765.918248:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361765.918252:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d00541d000 refcount=5 00000100:00100000:1.0:1788361765.918258:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429921920:12345-0@lo:400:kworker.0 00000020:00000040:3.0:1788361765.918260:0:26161:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00000040:2.0:1788361765.918260:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 57083 usecs (58 jiffies) 00010000:00000040:1.0:1788361765.918271:0:8449:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429921920 00000100:00000040:3.0:1788361765.918273:0:26161:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1788361765.918275:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:1.0:1788361765.918278:0:8449:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:2.0:1788361765.918283:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918284:0:8449:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1788361765.918294:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1788361765.918295:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d104298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429921664:0@lo:400:kworker.0 00000100:00000040:3.0:1788361765.918298:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d00541d000 : new rpc_count 1 00000100:00000040:3.0:1788361765.918306:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136b5ad80 x1875230429922176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918306:0:8449:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.918330:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429922176:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1788361765.918330:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918338:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:3.0:1788361765.918343:0:26161:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1875230429922176 00000100:00000040:1.0:1788361765.918345:0:8449:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00000040:3.0:1788361765.918351:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:2.0:1788361765.918355:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d117281500 x1875230429921664 msgsize 224 00000100:00000040:1.0:1788361765.918355:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104299500 x1875230429921920/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.918356:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921280 00000100:00000040:3.0:1788361765.918360:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788361765.918363:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921280 00000100:00100000:2.0:1788361765.918364:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:0.0:1788361765.918368:0:66901:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddb45 00000100:00000040:3.0:1788361765.918374:0:26161:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.918374:0:66901:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d10f777800 refcount=5 00000100:00100000:1.0:1788361765.918379:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429921920:12345-0@lo:400:kworker.0 Request processed in 123us (464us total) trans 0 rc 0/0 00000100:00000040:2.0:1788361765.918383:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.918386:0:66901:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 10 - evictor 00000100:00100000:1.0:1788361765.918399:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4240 00000100:00000040:0.0:1788361765.918401:0:66901:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:2.0:1788361765.918402:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 2642 usecs (3 jiffies) 00000100:00000040:3.0:1788361765.918403:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00000040:1.0:1788361765.918404:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d002ffa000 : new rpc_count 0 00000100:00000040:3.0:1788361765.918410:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b5ad80 x1875230429922176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918410:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.918417:0:8449:0:(genops.c:900:class_export_put()) PUTting export ffff99d002ffa000 : new refcount 4 00000100:00100000:2.0:1788361765.918423:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d10429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429922304:0@lo:400:kworker.0 00000100:00100000:0.0:1788361765.918432:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921792 00000100:00100000:1.0:1788361765.918436:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4241 00000100:00100000:3.0:1788361765.918437:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429922176:12345-0@lo:400:kworker.0 Request processed in 105us (367us total) trans 0 rc 0/0 00000100:00000040:2.0:1788361765.918437:0:3653:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.918438:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921792 00000100:00000040:1.0:1788361765.918441:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d116c07800 : new rpc_count 1 00000020:00000040:0.0:1788361765.918443:0:66901:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42a8 00000020:00000040:0.0:1788361765.918449:0:66901:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d104f3b800 refcount=5 00000100:00000040:1.0:1788361765.918452:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104298a80 x1875230429921408/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.918453:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00000040:2.0:1788361765.918453:0:3653:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.918457:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d00541d000 : new rpc_count 0 00000020:00000040:3.0:1788361765.918467:0:26161:0:(genops.c:900:class_export_put()) PUTting export ffff99d00541d000 : new refcount 4 00000100:00000040:2.0:1788361765.918469:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff99d117280a80 x1875230429922304 msgsize 224 00000100:00100000:1.0:1788361765.918478:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429921408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361765.918479:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361765.918480:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429921664 00000100:00100000:0.0:1788361765.918484:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1788361765.918486:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429921664 00000100:00000040:0.0:1788361765.918489:0:66901:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d10f777800 : new rpc_count 1 00000020:00000040:3.0:1788361765.918490:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddace 00000100:00000040:2.0:1788361765.918491:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788361765.918492:0:8449:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875230429921408 00000020:00000040:3.0:1788361765.918495:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d005030000 refcount=5 00000100:00000040:0.0:1788361765.918499:0:66901:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104299c00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918500:0:8449:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:3.0:1788361765.918509:0:26161:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:1.0:1788361765.918509:0:8449:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.918516:0:3653:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 4022 usecs (5 jiffies) 00000100:00100000:0.0:1788361765.918525:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429921280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361765.918532:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00000040:1.0:1788361765.918534:0:8449:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.918536:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d005030000 : new rpc_count 1 00010000:00000040:0.0:1788361765.918539:0:66901:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429921280 00000100:00100000:2.0:1788361765.918540:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922304 00000100:00000040:3.0:1788361765.918544:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117281500 x1875230429921664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.918546:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922304 00000020:00000040:2.0:1788361765.918549:0:67579:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42af 00000100:00000040:0.0:1788361765.918551:0:66901:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 58 to 0@lo 00000020:00000040:2.0:1788361765.918553:0:67579:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136ca0800 refcount=5 00000100:00000040:0.0:1788361765.918562:0:66901:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.918572:0:8449:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00100000:3.0:1788361765.918573:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429921664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361765.918579:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00000040:1.0:1788361765.918580:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298a80 x1875230429921408/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788361765.918585:0:26161:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968754, transno 0, xid 1875230429921664 00000100:00000040:2.0:1788361765.918585:0:67579:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d104f3b800 : new rpc_count 1 00000100:00000040:0.0:1788361765.918588:0:66901:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918596:0:67579:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117283b80 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361765.918597:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 58 to 0@lo 00000100:00100000:1.0:1788361765.918597:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429921408:12345-0@lo:400:kworker.0 Request processed in 124us (587us total) trans 0 rc 0/0 00000100:00000040:3.0:1788361765.918607:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1788361765.918614:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4241 00000100:00000040:1.0:1788361765.918632:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d116c07800 : new rpc_count 0 00000100:00100000:2.0:1788361765.918642:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429921792:12345-0@lo:400:kworker.0 00000020:00000040:1.0:1788361765.918642:0:8449:0:(genops.c:900:class_export_put()) PUTting export ffff99d116c07800 : new refcount 6 00000100:00000040:0.0:1788361765.918642:0:66901:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:3.0:1788361765.918644:0:26161:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.918652:0:66901:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104299c00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788361765.918659:0:67579:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429921792 00000100:00100000:0.0:1788361765.918667:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875230429921280:12345-0@lo:400:kworker.0 Request processed in 146us (878us total) trans 0 rc 0/0 00000100:00000040:2.0:1788361765.918668:0:67579:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 58 to 0@lo 00000100:00000040:3.0:1788361765.918670:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:2.0:1788361765.918677:0:67579:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361765.918678:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117281500 x1875230429921664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.918683:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00000040:1.0:1788361765.918684:0:3652:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788361765.918691:0:66901:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d10f777800 : new rpc_count 0 00000100:00000040:1.0:1788361765.918694:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918695:0:67579:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361765.918696:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1875230429921664:12345-0@lo:400:kworker.0 Request processed in 125us (337us total) trans 0 rc 0/0 00000020:00000040:0.0:1788361765.918701:0:66901:0:(genops.c:900:class_export_put()) PUTting export ffff99d10f777800 : new refcount 4 00000100:00100000:3.0:1788361765.918714:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1788361765.918719:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00000040:3.0:1788361765.918720:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d005030000 : new rpc_count 0 00000100:00000040:1.0:1788361765.918721:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.918726:0:66901:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136ca0800 : new rpc_count 1 00000100:00000040:2.0:1788361765.918729:0:67579:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000020:00000040:3.0:1788361765.918737:0:26161:0:(genops.c:900:class_export_put()) PUTting export ffff99d005030000 : new refcount 4 00000100:00000040:0.0:1788361765.918737:0:66901:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117280a80 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:71/0 lens 224/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918740:0:67579:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117283b80 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.918740:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429921152:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.918751:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d10429ad80 x1875230429921152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.918771:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429922304:12345-0@lo:400:kworker.0 00000020:00000040:1.0:1788361765.918774:0:3652:0:(genops.c:1244:class_import_put()) import ffff99d002dff000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1788361765.918776:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875230429921792:12345-0@lo:400:kworker.0 Request processed in 137us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361765.918788:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00000040:2.0:1788361765.918793:0:67579:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d104f3b800 : new rpc_count 0 00000100:00000040:1.0:1788361765.918796:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000020:00000040:2.0:1788361765.918800:0:67579:0:(genops.c:900:class_export_put()) PUTting export ffff99d104f3b800 : new refcount 4 00010000:00000040:0.0:1788361765.918802:0:66901:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429922304 00000100:00000040:1.0:1788361765.918804:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.918810:0:66901:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00080000:2.0:1788361765.918817:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000040:0.0:1788361765.918841:0:66901:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1788361765.918846:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99d001c64d40) now 10 - evictor 00000100:00080000:2.0:1788361765.918852:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000040:1.0:1788361765.918852:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.918857:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00080000:2.0:1788361765.918864:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:0.0:1788361765.918865:0:66901:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.918868:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99d001c619c0) now 16 - evictor 00000100:00100000:1.0:1788361765.918870:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429921408:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.918895:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:0.0:1788361765.918902:0:66901:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 56 to 0@lo 00000100:00000040:1.0:1788361765.918903:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918904:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968754 00000100:00000040:0.0:1788361765.918913:0:66901:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117280a80 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.918914:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.918920:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.918936:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875230429922304:12345-0@lo:400:kworker.0 Request processed in 167us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.918947:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429922176:0@lo:400:kworker.0 00000100:00100000:0.0:1788361765.918955:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00000040:2.0:1788361765.918959:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.918960:0:66901:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136ca0800 : new rpc_count 0 00000100:00000040:1.0:1788361765.918964:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788361765.918971:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.918973:0:66901:0:(genops.c:900:class_export_put()) PUTting export ffff99d136ca0800 : new refcount 4 00000100:00100000:2.0:1788361765.918976:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875230429921664:0@lo:400:kworker.0 00000100:00000040:1.0:1788361765.918989:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.918996:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875230429921280:0@lo:400:kworker.0 00000100:00000040:2.0:1788361765.919000:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1788361765.919006:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968752 00000100:00000040:2.0:1788361765.919009:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.919009:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788361765.919017:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.919017:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.919041:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.919051:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361765.919052:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361765.919062:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361765.919063:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875230429922304:0@lo:400:kworker.0 00000100:00000040:0.0:1788361765.919071:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.919078:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429921920:0@lo:400:kworker.0 00000100:00000040:2.0:1788361765.919086:0:3653:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788361765.919092:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d10429a300 x1875230429921408/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.919092:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429922048:0@lo:8:kworker.0 00000100:00000040:2.0:1788361765.919094:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.919109:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968741 00000100:00000040:0.0:1788361765.919118:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.919127:0:3653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.919128:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d106904000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788361765.919134:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00000040:1.0:1788361765.919140:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d104298700 x1875230429922176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.919147:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d10429a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875230429921792:0@lo:400:kworker.0 00000100:00080000:0.0:1788361765.919153:0:3649:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000020:00000040:1.0:1788361765.919160:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d117299000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788361765.919165:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d104298000 x1875230429921664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.919165:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.919171:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d104298e00 x1875230429921280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.919199:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d136773800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:0.0:1788361765.919200:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d104299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429921536:0@lo:8:kworker.0 00000020:00000040:1.0:1788361765.919201:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d002dfb000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788361765.919215:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d10429aa00 x1875230429922304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.919215:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d10429bb80 x1875230429922048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.919216:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d10429b480 x1875230429921920/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.919250:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d12c4e1000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:2.0:1788361765.919252:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d10f55a000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:0.0:1788361765.919254:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d005034000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1788361765.919265:0:3653:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d10429a680 x1875230429921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.919267:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d104299880 x1875230429921536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788361785 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.919289:0:3653:0:(genops.c:1244:class_import_put()) import ffff99d10f770000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000020:00000040:0.0:1788361765.919292:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d108bef800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000020:00000040:1.0:1788361765.919350:0:96782:0:(genops.c:889:class_export_get()) GET export ffff99d001c6f800 refcount=4 00000020:00000040:1.0:1788361765.919359:0:96782:0:(genops.c:889:class_export_get()) GET export ffff99d001c6f800 refcount=5 00000020:00000040:0.0:1788361765.919373:0:96783:0:(genops.c:889:class_export_get()) GET export ffff99d001c6f800 refcount=6 00000020:00000040:0.0:1788361765.919378:0:96783:0:(genops.c:889:class_export_get()) GET export ffff99d001c6f800 refcount=7 00000020:00000040:0.0:1788361765.919383:0:96783:0:(genops.c:900:class_export_put()) PUTting export ffff99d001c6f800 : new refcount 6 00000100:00000040:1.0:1788361765.919422:0:96782:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.135@tcp 192.168.204.135@tcp cnt=1 00000020:01000004:1.0:1788361765.919446:0:96782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788361765.919460:0:96782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) 00000020:00000040:1.0:1788361765.919465:0:96782:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d137ea5800 with handle 0x1b69fa8920fe50e0 to hash 00000020:00000040:1.0:1788361765.919470:0:96782:0:(genops.c:900:class_export_put()) PUTting export ffff99d137ea5800 : new refcount 1 00000020:00000040:1.0:1788361765.919479:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) now 2 - obd_device_list 00000020:00000080:1.0:1788361765.919485:0:96782:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788361765.919645:0:96782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99d139ff5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788361765.919650:0:96782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99d139ff5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788361765.919653:0:96782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99d139ff5800 3 00000020:00000040:1.0:1788361765.919677:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) now 3 - import 00000020:00000040:1.0:1788361765.919683:0:96782:0:(genops.c:1244:class_import_put()) import ffff99d136ec2800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1788361765.919692:0:96782:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:1.0:1788361765.919695:0:96782:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 57 to 0@lo 00000100:00000040:1.0:1788361765.919698:0:96782:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.135@tcp -> ffff99d104d3b280 00010000:00080000:1.0:1788361765.919703:0:96782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d136ec2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788361765.921409:0:96782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:1.0:1788361765.921487:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) now 4 - setup 00000020:00000080:1.0:1788361765.921492:0:96782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788361765.921529:0:96782:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1788361765.921535:0:96782:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d002de9000 with handle 0x1b69fa8920fe50e7 to hash 00000020:00000040:1.0:1788361765.921541:0:96782:0:(genops.c:889:class_export_get()) GET export ffff99d002de9000 refcount=3 00000020:00000040:1.0:1788361765.921544:0:96782:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) now 5 - export 00000020:00000040:1.0:1788361765.921546:0:96782:0:(genops.c:900:class_export_put()) PUTting export ffff99d002de9000 : new refcount 2 00000020:00000080:1.0:1788361765.921548:0:96782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1b69fa8920fe50e7 00000020:00000040:1.0:1788361765.921550:0:96782:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50e7 00000020:00000040:1.0:1788361765.921552:0:96782:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002de9000 refcount=3 00000100:00080000:1.0:1788361765.921557:0:96782:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1788361765.921560:0:96782:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 58 to 0@lo 00000020:00000040:1.0:1788361765.921562:0:96782:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50e7 00000020:00000040:1.0:1788361765.921563:0:96782:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002de9000 refcount=4 00000100:00000040:1.0:1788361765.921564:0:96782:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 59 to 0@lo 00000020:00000040:1.0:1788361765.921566:0:96782:0:(genops.c:900:class_export_put()) PUTting export ffff99d002de9000 : new refcount 3 00000100:00080000:1.0:1788361765.921568:0:96782:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99d136ec2800 using connection 192.168.204.135@tcp/0@lo 00000020:00000040:1.0:1788361765.921578:0:96782:0:(genops.c:1231:class_import_get()) import ffff99d136ec2800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:1.0:1788361765.921593:0:96782:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788361765.921605:0:96782:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c6ffc070] to pc [ptlrpcd_rcv+-1] req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361765.921640:0:96782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:1.0:1788361765.921644:0:96782:0:(genops.c:1231:class_import_get()) import ffff99d136ec2800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788361765.921668:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.921684:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875230429922432:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1788361765.921724:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361775 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.921745:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.921791:0:48377:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (2810) 00000100:00000040:2.0:1788361765.921795:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d117282680 x1875230429922432 msgsize 520 00000100:00100000:2.0:1788361765.921802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361765.921859:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361775 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.921871:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:2.0:1788361765.921911:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922432 00000100:00100000:2.0:1788361765.921918:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922432 00000020:00000040:2.0:1788361765.921920:0:66128:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1788361765.921955:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00000040:2.0:1788361765.921961:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117282680 x1875230429922432/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788361785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.921967:0:96782:0:(genops.c:889:class_export_get()) GET export ffff99d002de9000 refcount=4 00000020:00000040:1.0:1788361765.921973:0:96782:0:(genops.c:889:class_export_get()) GET export ffff99d002de9000 refcount=5 00000100:00100000:2.0:1788361765.921978:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875230429922432:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1788361765.921990:0:66128:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 10 - find 00010000:00000040:2.0:1788361765.922001:0:66128:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1788361765.922007:0:66128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 2805 last 0 00000020:00000040:2.0:1788361765.922016:0:66128:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d11e633000 with handle 0x1b69fa8920fe50ee to hash 00000020:00000040:2.0:1788361765.922045:0:66128:0:(genops.c:889:class_export_get()) GET export ffff99d11e633000 refcount=3 00000020:00000040:2.0:1788361765.922048:0:66128:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 11 - export 00000020:00000040:2.0:1788361765.922051:0:66128:0:(genops.c:900:class_export_put()) PUTting export ffff99d11e633000 : new refcount 2 00000040:00080000:1.0:1788361765.922052:0:96782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000080:2.0:1788361765.922053:0:66128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1b69fa8920fe50ee 00000020:00000040:2.0:1788361765.922055:0:66128:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50ee 00000020:00000040:2.0:1788361765.922056:0:66128:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d11e633000 refcount=3 00000001:00000040:2.0:1788361765.922064:0:66128:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.135@tcp 00000001:00000040:2.0:1788361765.922068:0:66128:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 18 00000020:00000040:2.0:1788361765.922071:0:66128:0:(genops.c:889:class_export_get()) GET export ffff99d11e633000 refcount=4 00000001:00000040:2.0:1788361765.922073:0:66128:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 19 00000001:00000040:2.0:1788361765.922077:0:66128:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99d1377f8800) : new refcount 18 00000004:00100000:2.0:1788361765.922087:0:66128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1788361765.922097:0:66128:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99d0045976c0 for nid 0@lo - ref 4 00000020:00000040:2.0:1788361765.922105:0:66128:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 12 - import 00000020:00000040:2.0:1788361765.922110:0:66128:0:(genops.c:1244:class_import_put()) import ffff99d11e637800 refcount=1 obd=lustre-MDT0001 00000020:00000040:2.0:1788361765.922117:0:66128:0:(genops.c:889:class_export_get()) GET export ffff99d11e633000 refcount=5 00000100:00000040:2.0:1788361765.922119:0:66128:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99d11e633000 : new rpc_count 1 00000100:00000040:2.0:1788361765.922124:0:66128:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 60 to 0@lo 00000100:00000040:2.0:1788361765.922128:0:66128:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 60 to 0@lo 00000020:00000040:2.0:1788361765.922131:0:66128:0:(genops.c:889:class_export_get()) GET export ffff99d11e633000 refcount=6 00000100:00000040:2.0:1788361765.922137:0:66128:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00080000:2.0:1788361765.922145:0:66128:0:(import.c:65:import_set_state_nolock()) ffff99d11e637800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1788361765.922153:0:66128:0:(genops.c:900:class_export_put()) PUTting export ffff99d11e633000 : new refcount 5 00000020:00000040:2.0:1788361765.922157:0:66128:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99d001c64d40) now 12 - find 00010000:00000040:2.0:1788361765.922172:0:66128:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429922432 00000020:01000000:1.0:1788361765.922180:0:96771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 00000100:00000040:2.0:1788361765.922182:0:66128:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:2.0:1788361765.922190:0:66128:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.922213:0:66128:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361775 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788361765.922226:0:96771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00000040:2.0:1788361765.922240:0:66128:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000020:00000040:1.0:1788361765.922243:0:96771:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d005168a00 refcount=3 00000100:00000040:2.0:1788361765.922249:0:66128:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282680 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788361785 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788361765.922252:0:96771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe50c4 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361765.922273:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875230429922432:12345-0@lo:38:llog_process_th.0 Request processed in 296us (473us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361765.922274:0:96771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d005168a00/0x1b69fa8920fe50bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe50c4 expref: -99 pid: 96771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361765.922288:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00000040:2.0:1788361765.922292:0:66128:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d11e633000 : new rpc_count 0 00000020:00000040:2.0:1788361765.922305:0:66128:0:(genops.c:900:class_export_put()) PUTting export ffff99d11e633000 : new refcount 4 00000020:01000004:1.0:1788361765.922352:0:96771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:2.0:1788361765.922356:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000020:01000004:1.0:1788361765.922356:0:96771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361765.922360:0:96771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00000040:2.0:1788361765.922362:0:3649:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000020:01000004:1.0:1788361765.922364:0:96771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361765.922367:0:96771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361765.922370:0:96771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00000040:2.0:1788361765.922373:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1788361765.922374:0:96771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361765.922376:0:96771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361765.922378:0:96771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361765.922382:0:96771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788361765.922386:0:96771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361765.922390:0:96771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361765.922393:0:96771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361765.922396:0:96771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361765.922397:0:96771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361765.922399:0:96771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00080000:2.0:1788361765.922401:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:01000004:1.0:1788361765.922401:0:96771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361765.922403:0:96771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:00000040:2.0:1788361765.922407:0:3649:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50e7 00000020:01000004:1.0:1788361765.922408:0:96771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:2.0:1788361765.922413:0:3649:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002de9000 refcount=6 00000020:00000040:1.0:1788361765.922417:0:96771:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00080000:2.0:1788361765.922422:0:3649:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1788361765.922428:0:3649:0:(genops.c:900:class_export_put()) PUTting export ffff99d002de9000 : new refcount 5 00000100:00080000:2.0:1788361765.922431:0:3649:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 10000000:01000000:1.0:1788361765.922433:0:96771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00080000:2.0:1788361765.922435:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d136ec2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1788361765.922446:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361775 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.922448:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361765.922470:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875230429922432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361765.922477:0:96771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429922560:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788361765.922482:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136b58380 x1875230429922432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361775 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.922494:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d136ec2800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1788361765.922502:0:96771:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.922519:0:96771:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.922545:0:96771:0:(events.c:337:request_in_callback()) incoming req@ffff99d1412a7050 x1875230429922560 msgsize 4848 00000100:00100000:1.0:1788361765.922551:0:96771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.922553:0:96771:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788361765.922581:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.922598:0:96771:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d120e5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361765.922624:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922560 00000100:00100000:2.0:1788361765.922630:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922560 00000020:00000040:2.0:1788361765.922633:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:2.0:1788361765.922637:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:2.0:1788361765.922656:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788361765.922685:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1788361765.922689:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:2.0:1788361765.922694:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1412a7050 x1875230429922560/t0(0) o253->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 4848/0 e 0 to 0 dl 1788361776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361765.922701:0:96785:0:(genops.c:900:class_export_put()) PUTting export ffff99d002de9000 : new refcount 4 00000100:00100000:2.0:1788361765.922710:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1412a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429922560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361765.922738:0:94211:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361765.922751:0:94211:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361765.926359:0:94211:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361765.926376:0:94211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788361765.926393:0:94210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361765.926398:0:94210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:0.0:1788361765.926410:0:94210:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d12172de00 count: 4 00000020:00000040:0.0:1788361765.926420:0:94210:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d104c09600 with handle 0x1b69fa8920fe50f5 to hash 00010000:00010000:0.0:1788361765.926425:0:94210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.926440:0:94210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 24 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.926449:0:94210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 24 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.926459:0:94210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.926480:0:94210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.926487:0:94210:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d12172de00) refcount = 4 00010000:00000040:0.0:1788361765.926490:0:94210:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788361765.926494:0:94210:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.926501:0:94210:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 24 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.926507:0:94210:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 24 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.926512:0:94210:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:0.0:1788361765.926515:0:94210:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788361765.926534:0:94210:0:(genops.c:1231:class_import_get()) import ffff99d0074c3800 refcount=2 obd=MGS 00010000:00000040:1.0:1788361765.926538:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429922560 00000100:00000040:1.0:1788361765.926554:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00010000:00010000:0.0:1788361765.926556:0:94210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 9 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788361765.926565:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:0.0:1788361765.926574:0:94210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 9 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788361765.926590:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361765.926603:0:94210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429922688:192.168.204.35@tcp:104: 00000100:00000040:1.0:1788361765.926636:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.926643:0:94210:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788361765.926655:0:94210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361765.926704:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00000040:1.0:1788361765.926715:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1412a7050 x1875230429922560/t0(0) o253->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 4848/4768 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.926727:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1412a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:96771:x1875230429922560:12345-0@lo:253:mount.lustre.0 Request processed in 4020us (4178us total) trans 0 rc 0/0 00000100:00000040:2.0:1788361765.926735:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.926737:0:94210:0:(genops.c:1231:class_import_get()) import ffff99d007452800 refcount=2 obd=MGS 00000100:00100000:1.0:1788361765.926745:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00010000:0.0:1788361765.926748:0:94210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 24 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788361765.926756:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00010000:00010000:0.0:1788361765.926765:0:94210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 24 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788361765.926777:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:0.0:1788361765.926783:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788361765.926786:0:96771:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.926804:0:94210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429922816:0@lo:104: 00000100:00100000:2.0:1788361765.926811:0:96771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8a6f36d-efb9-41cf-af98-5917323f2b0d:96771:1875230429922560:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1788361765.926868:0:94210:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788361765.926879:0:94210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361765.926897:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788361765.926925:0:96771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00000040:0.0:1788361765.926925:0:94210:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185ead80 x1875230429922816 msgsize 328 00000020:01000004:2.0:1788361765.926935:0:96771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361765.926941:0:96771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361765.926946:0:96771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:0.0:1788361765.926948:0:94210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788361765.926951:0:96771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361765.926956:0:96771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361765.926959:0:96771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361765.926963:0:96771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361765.926967:0:96771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361765.926969:0:96771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:2.0:1788361765.926985:0:96771:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136b5a680 x1875230429922560/t0(0) o253->MGC192.168.204.135@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.927005:0:96771:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000100:00000040:0.0:1788361765.927008:0:94210:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:02000000:2.0:1788361765.927043:0:96771:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788361765.927073:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922816 00000100:00100000:1.0:1788361765.927082:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922816 00000020:00000040:1.0:1788361765.927088:0:6507:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920f9dab3 00000020:00000040:1.0:1788361765.927096:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d109074800 refcount=3 00000020:00000040:0.0:1788361765.927100:0:94210:0:(genops.c:1231:class_import_get()) import ffff99d007452800 refcount=3 obd=MGS 00010000:00010000:0.0:1788361765.927119:0:94210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 23 pid: 94208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.927135:0:94210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 23 pid: 94208 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788361765.927137:0:6507:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00000040:0.0:1788361765.927152:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361765.927161:0:94210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1185e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429922944:0@lo:104: 00000100:00000040:0.0:1788361765.927177:0:94210:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361765.927183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00000040:1.0:1788361765.927198:0:6507:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d109074800 : new rpc_count 1 00000100:00000040:0.0:1788361765.927198:0:94210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.927207:0:6507:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185ead80 x1875230429922816/t0(0) o104->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361765.927222:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:94210:x1875230429922816:12345-0@lo:104: 00000020:00000040:1.0:1788361765.927230:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d004309a00 refcount=2 00000100:00000040:0.0:1788361765.927234:0:94210:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185ea680 x1875230429922944 msgsize 328 00010000:00010000:1.0:1788361765.927237:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361765.927244:0:94210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361765.927264:0:94210:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788361765.927267:0:6507:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00002000:00000040:2.0:1788361765.927269:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00000100:00000040:1.0:1788361765.927278:0:6507:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788361765.927288:0:94210:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13a136840 going to sleep for 11 seconds 00002000:00000040:2.0:1788361765.927297:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00000100:00000040:1.0:1788361765.927309:0:6507:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361765.927316:0:92924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429922944 00000100:00100000:0.0:1788361765.927323:0:92924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429922944 00000020:00000040:0.0:1788361765.927326:0:92924:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920f9dab3 00000020:00000040:0.0:1788361765.927330:0:92924:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d109074800 refcount=4 00000100:00000040:1.0:1788361765.927348:0:6507:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00010000:00010000:1.0:1788361765.927374:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361765.927376:0:92924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00000040:0.0:1788361765.927384:0:92924:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d109074800 : new rpc_count 2 00000100:00000040:1.0:1788361765.927390:0:6507:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185ead80 x1875230429922816/t0(0) o104->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788361765.927393:0:92924:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185ea680 x1875230429922944/t0(0) o104->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000040:2.0:1788361765.927400:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00000100:00100000:1.0:1788361765.927409:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:94210:x1875230429922816:12345-0@lo:104: Request processed in 190us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361765.927417:0:92924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+4:94210:x1875230429922944:12345-0@lo:104: 00000100:00100000:1.0:1788361765.927422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000020:00000040:0.0:1788361765.927423:0:92924:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d004308a00 refcount=2 00000100:00000040:1.0:1788361765.927426:0:6507:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d109074800 : new rpc_count 1 00010000:00010000:0.0:1788361765.927429:0:92924:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788361765.927437:0:6507:0:(genops.c:900:class_export_put()) PUTting export ffff99d109074800 : new refcount 3 00000100:00000040:0.0:1788361765.927443:0:92924:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:0.0:1788361765.927448:0:92924:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00002000:00000040:2.0:1788361765.927467:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00010000:00010000:1.0:1788361765.927469:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00000040:0.0:1788361765.927473:0:92924:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1788361765.927477:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.927490:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004309a00 already unused, calling callback (ffffffffc1218c20) 00000100:00000040:0.0:1788361765.927492:0:92924:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 10000000:00010000:1.0:1788361765.927496:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.927508:0:92924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:0.0:1788361765.927515:0:92924:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185ea680 x1875230429922944/t0(0) o104->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1788361765.927516:0:6512:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d004309a00 refcount=3 00010000:00010000:2.0:1788361765.927522:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361765.927524:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361765.927530:0:92924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+3:94210:x1875230429922944:12345-0@lo:104: Request processed in 114us (291us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361765.927532:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361765.927533:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361765.927549:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361765.927557:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d004308a00 already unused, calling callback (ffffffffc1218c20) 10000000:00000040:1.0:1788361765.927557:0:6512:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 00000100:00100000:0.0:1788361765.927557:0:92924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 10000000:00000040:1.0:1788361765.927564:0:6512:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00010000:2.0:1788361765.927565:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788361765.927565:0:92924:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d109074800 : new rpc_count 0 10000000:00000040:1.0:1788361765.927584:0:6512:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99d005073200) refs 2 00000020:00000040:0.0:1788361765.927584:0:92924:0:(genops.c:900:class_export_put()) PUTting export ffff99d109074800 : new refcount 2 00000020:00000040:2.0:1788361765.927590:0:6511:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d004308a00 refcount=3 00000020:00000040:1.0:1788361765.927599:0:6512:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99d004309a00 with handle 0x1b69fa8920fe41eb from hash 00010000:00010000:2.0:1788361765.927606:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788361765.927613:0:6512:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361765.927625:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:2.0:1788361765.927631:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.927645:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361765.927654:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1788361765.927680:0:6511:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 00010000:00010000:1.0:1788361765.927681:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00000040:2.0:1788361765.927686:0:6511:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1788361765.927694:0:6511:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99d102b3c000) refs 2 00000020:00000040:2.0:1788361765.927710:0:6511:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99d004308a00 with handle 0x1b69fa8920fe41cf from hash 00000100:00000040:1.0:1788361765.927710:0:6512:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a83558dd] to pc [ptlrpcd_00_03+3] req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.927721:0:6511:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00010000:00010000:2.0:1788361765.927735:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361765.927743:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1788361765.927752:0:6511:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f55f7ef9] to pc [ptlrpcd_00_00+0] req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788361765.927758:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.927771:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004309a00/0x1b69fa8920fe41eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361765.927779:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788361765.927785:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.927787:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361765.927791:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361765.927795:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1788361765.927796:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361765.927798:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff99d004308a00/0x1b69fa8920fe41cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b69fa8920fe41d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361765.927819:0:6511:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff99d004359a00 count: 0 00000100:00100000:0.0:1788361765.927856:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429923072:0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1788361765.927861:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361765.927876:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1788361765.927878:0:3652:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788361765.927881:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361765.927892:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1788361765.927896:0:3652:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1788361765.927900:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429923200:0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1788361765.927925:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.927928:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff99d1178bbc50 x1875230429923072 msgsize 328 00000100:00000040:1.0:1788361765.927935:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788361765.927938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361765.927942:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00002000:00000040:2.0:1788361765.927946:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00000100:00000040:1.0:1788361765.927960:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff99d136b58e00 x1875230429923200 msgsize 328 00000100:00000040:0.0:1788361765.927966:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.927970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361765.927997:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00002000:00000040:2.0:1788361765.928003:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:2.0:1788361765.928037:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00000100:00100000:1.0:1788361765.928047:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923072 00000100:00100000:1.0:1788361765.928054:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923072 00000020:00000040:1.0:1788361765.928057:0:9528:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361765.928060:0:9528:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00100000:3.0:1788361765.928063:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923200 00000100:00100000:3.0:1788361765.928074:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923200 00000020:00000040:3.0:1788361765.928078:0:19651:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00002000:00000040:2.0:1788361765.928079:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00000100:00000040:1.0:1788361765.928080:0:9528:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1788361765.928085:0:19651:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=25 00000020:00000040:1.0:1788361765.928093:0:9528:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d139917a00 refcount=5 00010000:00010000:1.0:1788361765.928102:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 25 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788361765.928121:0:19651:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d1012eac00 refcount=5 00010000:00010000:3.0:1788361765.928133:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 25 pid: 94208 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:2.0:1788361765.928143:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00000100:00100000:1.0:1788361765.928154:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00000040:1.0:1788361765.928159:0:9528:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361765.928167:0:9528:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1178bbc50 x1875230429923072/t0(0) o103->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.928170:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00000040:0.0:1788361765.928178:0:8456:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 2 00000100:00000040:0.0:1788361765.928188:0:8456:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136b58e00 x1875230429923200/t0(0) o103->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.928194:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1178bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429923072:12345-0@lo:103:ldlm_bl.0 00002000:00000040:2.0:1788361765.928210:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000100:00100000:0.0:1788361765.928214:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3650:x1875230429923200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361765.928217:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1788361765.928224:0:9528:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d139917a00 refcount=5 00010000:00000040:1.0:1788361765.928228:0:9528:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d12172de00 count: 5 00010000:00010000:0.0:1788361765.928228:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1788361765.928235:0:8456:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d1012eac00 refcount=5 00010000:00010000:1.0:1788361765.928238:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 25 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361765.928239:0:8456:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d12172de00 count: 7 00010000:00010000:0.0:1788361765.928248:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 25 pid: 94208 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361765.928264:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 25 pid: 94208 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.928283:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 25 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788361765.928298:0:8456:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99d1012eac00 with handle 0x1b69fa8920fe41d6 from hash 00000020:00000040:1.0:1788361765.928312:0:9528:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99d139917a00 with handle 0x1b69fa8920fe41f2 from hash 00010000:00000040:0.0:1788361765.928318:0:8456:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff99d104c09600 00010000:00000040:1.0:1788361765.928324:0:9528:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff99d104c09600 00010000:00010000:0.0:1788361765.928324:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361765.928329:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1788361765.928334:0:8456:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:1.0:1788361765.928338:0:9528:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 63 to 0@lo 00000100:00000040:0.0:1788361765.928343:0:8456:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361765.928346:0:9528:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361765.928371:0:8456:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.928374:0:9528:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.928412:0:9528:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:1.0:1788361765.928419:0:9528:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1178bbc50 x1875230429923072/t0(0) o103->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361765.928425:0:8456:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00100000:1.0:1788361765.928434:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1178bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3652:x1875230429923072:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (503us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361765.928435:0:8456:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b58e00 x1875230429923200/t0(0) o103->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:71/0 lens 328/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.928452:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1788361765.928453:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+25:3650:x1875230429923200:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (490us total) trans 0 rc 0/0 00000100:00000040:1.0:1788361765.928458:0:9528:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 1 00000100:00000040:2.0:1788361765.928459:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361765.928466:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000020:00000040:1.0:1788361765.928474:0:9528:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 24 00000100:00000040:0.0:1788361765.928474:0:8456:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:2.0:1788361765.928481:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361765.928492:0:8456:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00100000:2.0:1788361765.928493:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429923200:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1788361765.928505:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117281c00 x1875230429923200/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361765.928519:0:3650:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361765.928553:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361765.928564:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361765.928568:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361765.928577:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3652:1875230429923072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361765.928588:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d139917a00/0x1b69fa8920fe41f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe41eb expref: 23 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361765.928590:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136b59180 x1875230429923072/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788361765.928605:0:94210:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff99d007453000 : new locks_count 17 00000020:00000040:2.0:1788361765.928609:0:3652:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 00000020:00000040:1.0:1788361765.928610:0:94210:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00000040:1.0:1788361765.928633:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361765.928652:0:94210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429922816:0@lo:104: 00000100:00000040:1.0:1788361765.928669:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1788361765.928680:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d1012eac00/0x1b69fa8920fe41d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b69fa8920fe41cf expref: 22 pid: 94208 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.928687:0:94210:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff99d007453000 : new locks_count 16 00000020:00000040:1.0:1788361765.928690:0:94210:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 21 00000100:00000040:1.0:1788361765.928701:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361765.928709:0:94210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429922944:0@lo:104: 00002000:00000040:3.0:1788361765.928873:0:96771:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:3.0:1788361765.929094:0:96771:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968773 00000100:00000040:1.0:1788361765.929207:0:3645:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788361765.929331:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788361765.929345:0:94210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361765.929367:0:94210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1185ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94210:1875230429922688:192.168.204.35@tcp:104: 00000100:00000040:2.0:1788361765.929377:0:94210:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185e9180 x1875230429922816/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1788361765.929386:0:94210:0:(genops.c:1244:class_import_put()) import ffff99d007452800 refcount=2 obd=MGS 00000100:00000040:2.0:1788361765.929394:0:94210:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185e9f80 x1875230429922944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1788361765.929401:0:94210:0:(genops.c:1244:class_import_put()) import ffff99d007452800 refcount=1 obd=MGS 00000100:00000040:2.0:1788361765.929406:0:94210:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1185ea300 x1875230429922688/t0(0) o104->MGS@192.168.204.35@tcp:15/16 lens 328/224 e 0 to 0 dl 1788361781 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1788361765.929413:0:94210:0:(genops.c:1244:class_import_put()) import ffff99d0074c3800 refcount=1 obd=MGS 00010000:00010000:2.0:1788361765.929423:0:94210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788361765.929743:0:96787:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96787 00010000:02000000:3.0:1788361765.929754:0:96787:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788361765.929757:0:96787:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1788361765.929761:0:96787:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:0.0:1788361765.929816:0:96771:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:0.0:1788361765.929850:0:96771:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99d0043d89c0 : new refcount 2 00000040:00000040:0.0:1788361765.929855:0:96771:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99d0043d89c0 : new refcount 1 00000020:00000040:0.0:1788361765.929882:0:96771:0:(genops.c:900:class_export_put()) PUTting export ffff99d1069b8000 : new refcount 1 00000020:00000040:0.0:1788361765.929892:0:96771:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.135@tcp (ffff99d1349b4d40) now 6 - mgc_fs 10000000:01000000:0.0:1788361765.929895:0:96771:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788361765.929914:0:96771:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788361765.929935:0:96771:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00000040:1.0:1788361765.930074:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d136b5bb80 x1875230407106176 msgsize 328 00000100:00100000:1.0:1788361765.930085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361765.930146:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106176 00000100:00100000:1.0:1788361765.930162:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106176 00000020:00000040:1.0:1788361765.930166:0:6508:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4293 00000020:00000040:1.0:1788361765.930171:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0074c0800 refcount=10 00000100:00000040:1.0:1788361765.930195:0:6508:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1788361765.930206:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d004308200 refcount=4 00010000:00010000:1.0:1788361765.930216:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 10 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361765.930271:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2645 00000100:00000040:1.0:1788361765.930277:0:6508:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d0074c0800 : new rpc_count 1 00000100:00000040:1.0:1788361765.930287:0:6508:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136b5bb80 x1875230407106176/t0(0) o103->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:71/0 lens 328/0 e 0 to 0 dl 1788361776 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.930347:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+10:2409:x1875230407106176:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361765.930385:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1788361765.930393:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d004308200 refcount=4 00010000:00000040:1.0:1788361765.930398:0:6508:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d12172de00 count: 3 00010000:00010000:1.0:1788361765.930408:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 10 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.930454:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 10 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788361765.930491:0:6508:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99d004308200 with handle 0x1b69fa8920fe44ae from hash 00010000:00010000:1.0:1788361765.930501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d004308200/0x1b69fa8920fe44ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0xeb09878fae7110c3 expref: 10 pid: 94209 timeout: 2905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.930521:0:6508:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff99d0074c0800 : new locks_count 3 00000020:00000040:1.0:1788361765.930527:0:6508:0:(genops.c:900:class_export_put()) PUTting export ffff99d0074c0800 : new refcount 9 00010000:00000040:1.0:1788361765.930544:0:6508:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff99d104c09600 00010000:00010000:1.0:1788361765.930554:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.930585:0:6508:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d12172de00) refcount = 2 00010000:00010000:1.0:1788361765.930595:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361765.930655:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004255816s 00000020:00000040:1.0:1788361765.930663:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d104c09600 refcount=5 00010000:00010000:1.0:1788361765.930671:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.930715:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.930757:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.930797:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.930869:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d104c09600 already unused, calling callback (ffffffffc0c1d300) 00010000:00010000:1.0:1788361765.930877:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788361765.930894:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d104c09600 refcount=6 00010000:00010000:1.0:1788361765.930903:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788361765.930926:0:6508:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99d104c09600 with handle 0x1b69fa8920fe50f5 from hash 00010000:00010000:1.0:1788361765.930935:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.930954:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1788361765.930971:0:6508:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361765.930984:0:6508:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000020:00000004:0.0:1788361765.931025:0:96771:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00000040:1.0:1788361765.931047:0:6508:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361765.931059:0:6508:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b5bb80 x1875230407106176/t0(0) o103->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:71/0 lens 328/224 e 0 to 0 dl 1788361776 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361765.931079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3956ab41-635b-456b-967f-6c1073c5d2df+9:2409:x1875230407106176:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 741us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361765.931115:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2645 00000100:00000040:1.0:1788361765.931120:0:6508:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d0074c0800 : new rpc_count 0 00000020:00000040:1.0:1788361765.931135:0:6508:0:(genops.c:900:class_export_put()) PUTting export ffff99d0074c0800 : new refcount 8 00010000:00010000:1.0:1788361765.931178:0:94210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.931197:0:94210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361765.931207:0:94210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361765.931212:0:94210:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff99d12172de00 count: 0 00000020:00000004:0.0:1788361765.931335:0:96771:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788361765.974012:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788361766.344117:0:96837:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788361766.344360:0:96837:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000040:2.0:1788361766.743006:0:75535:0:(genops.c:1231:class_import_get()) import ffff99d136773800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788361766.743044:0:75535:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f55f7ef9] to pc [ptlrpcd_00_01+1] req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361766.743091:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361766.743106:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429923328:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1788361766.743136:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361782 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361766.743144:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361766.743180:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054a300 x1875230429923328 msgsize 224 00000100:00100000:3.0:1788361766.743184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361766.743207:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361782 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361766.743233:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 2640 usecs (3 jiffies) 00000100:00100000:1.0:1788361766.743273:0:26156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923328 00000100:00100000:1.0:1788361766.743281:0:26156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923328 00000020:00000040:1.0:1788361766.743284:0:26156:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddace 00000020:00000040:1.0:1788361766.743288:0:26156:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d005030000 refcount=5 00000100:00000040:1.0:1788361766.743310:0:26156:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788361766.743334:0:26156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00000040:1.0:1788361766.743338:0:26156:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d005030000 : new rpc_count 1 00000100:00000040:1.0:1788361766.743344:0:26156:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054a300 x1875230429923328/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:72/0 lens 224/0 e 0 to 0 dl 1788361777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361766.743357:0:26156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429923328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788361766.743387:0:26156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000040:1.0:1788361766.743397:0:26156:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968754, transno 0, xid 1875230429923328 00000100:00000040:1.0:1788361766.743407:0:26156:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:1.0:1788361766.743411:0:26156:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361766.743430:0:26156:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361782 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361766.743895:0:26156:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00000040:1.0:1788361766.743902:0:26156:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054a300 x1875230429923328/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:72/0 lens 224/368 e 0 to 0 dl 1788361777 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361766.743911:0:26156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429923328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 556us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361766.743918:0:26156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00000040:1.0:1788361766.743921:0:26156:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d005030000 : new rpc_count 0 00000020:00000040:1.0:1788361766.743930:0:26156:0:(genops.c:900:class_export_put()) PUTting export ffff99d005030000 : new refcount 4 00000100:00000040:3.0:1788361766.743950:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968754 00000100:00000040:3.0:1788361766.744021:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788361766.744032:0:3651:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1788361766.744035:0:3651:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261733 state=0: rc = 0 00000100:00000040:3.0:1788361766.744044:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361782 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361766.744052:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d117281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429923328:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1788361766.744058:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d117281c00 x1875230429923328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361782 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361766.744132:0:3651:0:(genops.c:1244:class_import_put()) import ffff99d136773800 refcount=2 obd=lustre-OST0001-osc-MDT0001 40000000:00000040:3.0:1788361766.750366:0:96885:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00010000:00010000:3.0:1788361767.001811:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788361767.111928:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d12cfc5850 x1875230407106304 msgsize 328 00000100:00100000:3.0:1788361767.111947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00000040:3.0:1788361767.111950:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1788361767.112004:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106304 00000100:00100000:0.0:1788361767.112016:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106304 00000020:00000040:0.0:1788361767.112019:0:94207:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4293 00000020:00000040:0.0:1788361767.112024:0:94207:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0074c0800 refcount=9 00000100:00000040:0.0:1788361767.112054:0:94207:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788361767.112092:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 192 00000100:00000040:0.0:1788361767.112098:0:94207:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d0074c0800 : new rpc_count 1 00000100:00000040:0.0:1788361767.112106:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d12cfc5850 x1875230407106304/t0(0) o101->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.112122:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+9:70890:x1875230407106304:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361767.112139:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:0.0:1788361767.112157:0:94207:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d104c09600 with handle 0x1b69fa8920fe50fc to hash 00010000:00010000:0.0:1788361767.112163:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeb09878fae71143c expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788361767.112172:0:94207:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99d0074c0800 : new locks_count 4 00000020:00000040:0.0:1788361767.112174:0:94207:0:(genops.c:889:class_export_get()) GET export ffff99d0074c0800 refcount=10 00010000:00000040:0.0:1788361767.112199:0:94207:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d005604300) refcount = 1 00010000:00010000:0.0:1788361767.112205:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71143c expref: 10 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361767.112216:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71143c expref: 10 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361767.112226:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d104c09600, rc 0) 00010000:00000040:0.0:1788361767.112230:0:94207:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230407106304 00000100:00000040:0.0:1788361767.112240:0:94207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.112247:0:94207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.112296:0:94207:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.112302:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d12cfc5850 x1875230407106304/t0(0) o101->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:73/0 lens 328/344 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.112311:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407106304:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 193us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361767.112324:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 192 00000100:00000040:0.0:1788361767.112327:0:94207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d0074c0800 : new rpc_count 0 00000020:00000040:0.0:1788361767.112337:0:94207:0:(genops.c:900:class_export_put()) PUTting export ffff99d0074c0800 : new refcount 9 00000100:00000040:1.0:1788361767.114417:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d14097ec50 x1875230407106432 msgsize 304 00000100:00100000:1.0:1788361767.114430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00000040:1.0:1788361767.114432:0:3644:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1788361767.114818:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106432 00000100:00100000:2.0:1788361767.114846:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106432 00000020:00000040:2.0:1788361767.114849:0:94208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4293 00000020:00000040:2.0:1788361767.114854:0:94208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0074c0800 refcount=10 00000100:00000040:2.0:1788361767.114874:0:94208:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788361767.114950:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00000040:2.0:1788361767.114954:0:94208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d0074c0800 : new rpc_count 1 00000100:00000040:2.0:1788361767.114962:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d14097ec50 x1875230407106432/t0(0) o256->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:73/0 lens 304/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.114977:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407106432:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361767.115008:0:94208:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:2.0:1788361767.115021:0:94208:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1788361767.115027:0:94208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361767.115030:0:94208:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:2.0:1788361767.115040:0:94208:0:(genops.c:889:class_export_get()) GET export ffff99d0074c0800 refcount=11 00000020:00000040:0.0:1788361767.116216:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d0074c0800 : new refcount 10 00010000:00000040:0.0:1788361767.116235:0:94208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230407106432 00000100:00000040:0.0:1788361767.116248:0:94208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.116254:0:94208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.116289:0:94208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 8 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.116296:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d14097ec50 x1875230407106432/t0(0) o256->3956ab41-635b-456b-967f-6c1073c5d2df@192.168.204.35@tcp:73/0 lens 304/240 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.116303:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3956ab41-635b-456b-967f-6c1073c5d2df+10:70890:x1875230407106432:12345-192.168.204.35@tcp:256:ll_cfg_requeue.0 Request processed in 1330us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361767.116309:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00000040:0.0:1788361767.116312:0:94208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d0074c0800 : new rpc_count 0 00000020:00000040:0.0:1788361767.116321:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d0074c0800 : new refcount 9 00000100:00000040:2.0:1788361767.120441:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d117280e00 x1875230407106560 msgsize 520 00000100:00100000:2.0:1788361767.120457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.120534:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106560 00000100:00100000:1.0:1788361767.120544:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106560 00000020:00000040:1.0:1788361767.120548:0:26163:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42e0 00000100:00100000:2.0:1788361767.120695:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5011 00000100:00000040:2.0:1788361767.120703:0:26165:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117280e00 x1875230407106560/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.120715:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2408:x1875230407106560:12345-192.168.204.35@tcp:8:ll_cfg_requeue.0 00000020:00000040:2.0:1788361767.120734:0:26165:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 7 - find 00010000:00000040:2.0:1788361767.120746:0:26165:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1788361767.120753:0:26165:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'f1e400d1-472b-42d1-b5e7-e80dc701272a' at ffff99d136e1b800, cookie 0x1b69fa8920fe50a8 00010000:00080000:2.0:1788361767.120758:0:26165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp recovering/t4294968753 exp ffff99d136e1b800 cur 2807 last 1788361765 00010000:02000400:2.0:1788361767.120767:0:26165:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:2.0:1788361767.120772:0:26165:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:2.0:1788361767.120784:0:26165:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 19 00000020:00000040:2.0:1788361767.120787:0:26165:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=4 00000001:00000040:2.0:1788361767.120789:0:26165:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 20 00000001:00000040:2.0:1788361767.120792:0:26165:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99d1377f8800) : new refcount 19 00002000:00100000:2.0:1788361767.120794:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1e400d1-472b-42d1-b5e7-e80dc701272a/ffff99d136e1b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788361767.120809:0:26165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:2.0:1788361767.120816:0:26165:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99d00685e9c0 for nid 192.168.204.35@tcp - ref 2 00000020:00000040:2.0:1788361767.120942:0:26165:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 8 - import 00000020:00000040:2.0:1788361767.120956:0:26165:0:(genops.c:1244:class_import_put()) import ffff99d005419000 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1788361767.120964:0:26165:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=5 00000100:00000040:2.0:1788361767.120966:0:26165:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.120976:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.120979:0:26165:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d002f2b600 refcount 9 to 192.168.204.35@tcp 00000020:00000040:2.0:1788361767.120982:0:26165:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=6 00000100:00000040:2.0:1788361767.120987:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00000100:00080000:2.0:1788361767.120997:0:26165:0:(import.c:65:import_set_state_nolock()) ffff99d005419000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1788361767.121003:0:26165:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 5 00000020:00000040:2.0:1788361767.121006:0:26165:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99d105318000) now 8 - find 00010000:00000040:2.0:1788361767.121020:0:26165:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 0, xid 1875230407106560 00000100:00000040:2.0:1788361767.121028:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.121033:0:26165:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:2.0:1788361767.121088:0:26165:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.121094:0:26165:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117280e00 x1875230407106560/t0(0) o8->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:0/0 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.121104:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2408:x1875230407106560:12345-192.168.204.35@tcp:8:ll_cfg_requeue.0 Request processed in 389us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361767.121111:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5011 00000100:00000040:2.0:1788361767.121115:0:26165:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:2.0:1788361767.121124:0:26165:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 4 00000100:00000040:2.0:1788361767.125234:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d117282d80 x1875230407078656 msgsize 440 00000100:00100000:2.0:1788361767.125245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.125773:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407078656 00000100:00100000:1.0:1788361767.125784:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407078656 00000020:00000040:1.0:1788361767.125787:0:24840:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.125793:0:24840:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=5 00000100:00000040:1.0:1788361767.125851:0:24840:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.125898:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 641 00000100:00000040:1.0:1788361767.125904:0:24840:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.125913:0:24840:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117282d80 x1875230407078656/t0(4294968774) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.125927:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2408:x1875230407078656:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:1.0:1788361767.125940:0:24840:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d117282d80 x1875230407078656/t0(4294968774) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.125950:0:24840:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968774, current: 4294968774, replaying 00010000:00000040:1.0:1788361767.125959:0:24840:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.125977:0:24840:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117282d80 x1875230407078656/t0(4294968774) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.125986:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+5:2408:x1875230407078656:12345-192.168.204.35@tcp:10:dd.0 Request processed in 62us (751us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.125993:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 641 00000100:00000040:1.0:1788361767.125997:0:24840:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.126026:0:96787:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:0.0:1788361767.155968:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff99d104010000) now 12 - health_check_show 00000020:00000040:0.0:1788361767.155980:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff99d104010000) now 12 - health_check_show 00000020:00000040:0.0:1788361767.155984:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff99d13a3a99c0) now 10 - health_check_show 00000020:00000040:0.0:1788361767.155987:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff99d13a3a99c0) now 10 - health_check_show 00000020:00000040:0.0:1788361767.155989:0:96933:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.135@tcp (ffff99d1349b4d40) now 6 - health_check_show 00000020:00000040:0.0:1788361767.155992:0:96933:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.135@tcp (ffff99d1349b4d40) now 6 - health_check_show 00000020:00000040:0.0:1788361767.155994:0:96933:0:(obd_config.c:994:class_incref()) incref MGS (ffff99d0042e19c0) now 8 - health_check_show 00000020:00000040:0.0:1788361767.155999:0:96933:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff99d0042e19c0) now 8 - health_check_show 00000020:00000040:0.0:1788361767.156001:0:96933:0:(obd_config.c:994:class_incref()) incref MDS (ffff99d00381cd40) now 4 - health_check_show 00000020:00000040:0.0:1788361767.156009:0:96933:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff99d00381cd40) now 4 - health_check_show 00000020:00000040:0.0:1788361767.156011:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff99d001c63380) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156014:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff99d001c63380) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156020:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 12 - health_check_show 00000020:00000040:0.0:1788361767.156023:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99d001c64d40) now 12 - health_check_show 00000020:00000040:0.0:1788361767.156025:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff99d12e0799c0) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156027:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff99d12e0799c0) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156030:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff99d1349b3380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156032:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff99d1349b3380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156034:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff99d0038199c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156036:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff99d0038199c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156038:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff99d13a3ab380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156040:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff99d13a3ab380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156042:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff99d12e078000) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156044:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff99d12e078000) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156046:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff99d001c60000) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156048:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff99d001c60000) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156049:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 16 - health_check_show 00000020:00000040:0.0:1788361767.156051:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99d001c619c0) now 16 - health_check_show 00000020:00000040:0.0:1788361767.156053:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff99d006a04d40) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156055:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff99d006a04d40) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156057:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff99d006a03380) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156059:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff99d006a03380) now 5 - health_check_show 00000020:00000040:0.0:1788361767.156062:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99d10531cd40) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156065:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff99d10531cd40) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156067:0:96933:0:(obd_config.c:994:class_incref()) incref OSS (ffff99d136cb3380) now 4 - health_check_show 00000020:00000040:0.0:1788361767.156072:0:96933:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff99d136cb3380) now 4 - health_check_show 00000020:00000040:0.0:1788361767.156074:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 8 - health_check_show 00000020:00000040:0.0:1788361767.156131:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99d105318000) now 8 - health_check_show 00000020:00000040:0.0:1788361767.156134:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156136:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff99d006a019c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156144:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156146:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff99d1040119c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156148:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff99d006a00000) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156150:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff99d006a00000) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156152:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff99d1053199c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156155:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff99d1053199c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156157:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff99d002364d40) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156159:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff99d002364d40) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156161:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - health_check_show 00000020:00000040:0.0:1788361767.156183:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - health_check_show 00000020:00000040:0.0:1788361767.156185:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff99d002363380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156188:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff99d002363380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156190:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff99d0023619c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156192:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff99d0023619c0) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156194:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff99d10531b380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156196:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff99d10531b380) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156198:0:96933:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff99d0042e0000) now 6 - health_check_show 00000020:00000040:0.0:1788361767.156200:0:96933:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff99d0042e0000) now 6 - health_check_show 00000100:00000040:2.0:1788361767.304787:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d117280380 x1875230407106688 msgsize 224 00000100:00100000:2.0:1788361767.304818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00000040:2.0:1788361767.304918:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d117281c00 x1875230407106944 msgsize 224 00000100:00100000:2.0:1788361767.304933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.304949:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106688 00000100:00100000:3.0:1788361767.304965:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106688 00000020:00000040:3.0:1788361767.304969:0:66126:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4120 00000020:00000040:3.0:1788361767.304977:0:66126:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d116c04000 refcount=51 00000100:00000040:2.0:1788361767.304987:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d55500 x1875230407106816 msgsize 224 00000100:00100000:2.0:1788361767.304994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000020:00000040:3.0:1788361767.304996:0:66126:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99d001c619c0) now 16 - evictor 00000100:00000040:3.0:1788361767.305036:0:66126:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00080000:1.0:1788361767.305065:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788361767.305071:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99d001c619c0) now 16 - evictor 00000100:00100000:3.0:1788361767.305080:0:66126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106816 00000100:00100000:3.0:1788361767.305085:0:66126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106816 00000020:00000040:3.0:1788361767.305087:0:66126:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe373a 00000020:00000040:3.0:1788361767.305098:0:66126:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d1054f4000 refcount=11 00000020:00000040:3.0:1788361767.305106:0:66126:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99d001c64d40) now 12 - evictor 00000100:00100000:0.0:1788361767.305142:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407106944 00000100:00100000:0.0:1788361767.305148:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407106944 00000020:00000040:0.0:1788361767.305150:0:8535:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe42e7 00000020:00000040:0.0:1788361767.305154:0:8535:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d003827800 refcount=7 00000020:00000040:0.0:1788361767.305166:0:8535:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00000040:0.0:1788361767.305180:0:8535:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1788361767.305208:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1953 00000100:00000040:0.0:1788361767.305213:0:8535:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d003827800 : new rpc_count 1 00000100:00000040:0.0:1788361767.305223:0:8535:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117281c00 x1875230407106944/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.305267:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407106944:12345-192.168.204.35@tcp:400:kworker.0 00010000:00000040:0.0:1788361767.305307:0:8535:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230407106944 00000100:00000040:0.0:1788361767.305326:0:8535:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.305334:0:8535:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.305410:0:8535:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.305416:0:8535:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117281c00 x1875230407106944/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 224/224 e 0 to 0 dl 1788361778 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.305427:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407106944:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 165us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361767.305435:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1953 00000100:00000040:0.0:1788361767.305438:0:8535:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d003827800 : new rpc_count 0 00000020:00000040:0.0:1788361767.305450:0:8535:0:(genops.c:900:class_export_put()) PUTting export ffff99d003827800 : new refcount 6 00000100:00080000:0.0:1788361767.305583:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788361767.305586:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00080000:0.0:1788361767.305603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788361767.305605:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99d001c64d40) now 12 - evictor 00000100:00100000:3.0:1788361767.308936:0:66126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 984 00000100:00000040:3.0:1788361767.308949:0:66126:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d116c04000 : new rpc_count 1 00000100:00000040:3.0:1788361767.308964:0:66126:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d117280380 x1875230407106688/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.308983:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 985 00000100:00000040:0.0:1788361767.308990:0:66901:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d1054f4000 : new rpc_count 1 00000100:00000040:0.0:1788361767.308999:0:66901:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d55500 x1875230407106816/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.309000:0:66126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407106688:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361767.309022:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407106816:12345-192.168.204.35@tcp:400:kworker.0 00010000:00000040:0.0:1788361767.309050:0:66901:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411473, transno 0, xid 1875230407106816 00010000:00000040:3.0:1788361767.309051:0:66126:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875230407106688 00000100:00000040:3.0:1788361767.309068:0:66126:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 12 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.309069:0:66901:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 12 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.309083:0:66126:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.309083:0:66901:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.309158:0:66126:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.309158:0:66901:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.309167:0:66126:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d117280380 x1875230407106688/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 224/224 e 0 to 0 dl 1788361778 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.309181:0:66126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d117280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407106688:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 200us (4394us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361767.309186:0:66901:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d55500 x1875230407106816/t0(0) o400->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 224/224 e 0 to 0 dl 1788361778 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.309195:0:66126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 984 00000100:00100000:0.0:1788361767.309204:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407106816:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 188us (4214us total) trans 0 rc 0/0 00000100:00000040:3.0:1788361767.309218:0:66126:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d116c04000 : new rpc_count 0 00000100:00100000:0.0:1788361767.309220:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 985 00000100:00000040:0.0:1788361767.309225:0:66901:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d1054f4000 : new rpc_count 0 00000020:00000040:0.0:1788361767.309243:0:66901:0:(genops.c:900:class_export_put()) PUTting export ffff99d1054f4000 : new refcount 10 00000020:00000040:3.0:1788361767.309244:0:66126:0:(genops.c:900:class_export_put()) PUTting export ffff99d116c04000 : new refcount 50 10000000:00000040:3.0:1788361767.382790:0:6520:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99d102b3c000) refs 2 10000000:01000000:3.0:1788361767.382805:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361767.382809:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d1042fb800 from 128 10000000:01000000:3.0:1788361767.382814:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1788361767.382860:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361767.382907:0:6520:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d100031600 with handle 0x1b69fa8920fe5103 to hash 00010000:00010000:3.0:1788361767.382918:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361767.382930:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361767.382957:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788361767.382987:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.383004:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923456:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788361767.383038:0:6520:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.383048:0:6520:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361767.383122:0:6520:0:(events.c:337:request_in_callback()) incoming req@ffff99d12cfc6050 x1875230429923456 msgsize 328 00000100:00100000:3.0:1788361767.383128:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361767.383130:0:6520:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361767.383158:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.383173:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923456 00000100:00100000:1.0:1788361767.383183:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923456 00000020:00000040:1.0:1788361767.383187:0:94209:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361767.383192:0:94209:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=22 00000100:00100000:3.0:1788361767.383195:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9600 going to sleep for 11 seconds 00000100:00000040:1.0:1788361767.383220:0:94209:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361767.383264:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1788361767.383269:0:94209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361767.383276:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d12cfc6050 x1875230429923456/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.383305:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+22:6520:x1875230429923456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361767.383324:0:94209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788361767.383334:0:94209:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d005604300 count: 2 00000020:00000040:1.0:1788361767.383340:0:94209:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d1012ea600 with handle 0x1b69fa8920fe510a to hash 00010000:00010000:1.0:1788361767.383345:0:94209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d1012ea600/0x1b69fa8920fe510a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe5103 expref: -99 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788361767.383353:0:94209:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99d007453000 : new locks_count 17 00000020:00000040:1.0:1788361767.383355:0:94209:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=23 00010000:00000040:1.0:1788361767.383375:0:94209:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d005604300) refcount = 2 00010000:00000040:1.0:1788361767.383383:0:94209:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788361767.383390:0:94209:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71143c expref: 9 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361767.383407:0:94209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d1012ea600/0x1b69fa8920fe510a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe5103 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361767.383420:0:94209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d1012ea600/0x1b69fa8920fe510a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe5103 expref: 23 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361767.383430:0:94209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d1012ea600, rc 0) 00010000:00000040:1.0:1788361767.383435:0:94209:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429923456 00000100:00000040:1.0:1788361767.383447:0:94209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:1.0:1788361767.383453:0:94209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361767.383474:0:94209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.383500:0:94209:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00000040:1.0:1788361767.383506:0:94209:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d12cfc6050 x1875230429923456/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 328/344 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.383515:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429923456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361767.383522:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1788361767.383526:0:94209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361767.383537:0:94209:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00000040:3.0:1788361767.383611:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.383623:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.383631:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923456:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788361767.383638:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361767.383650:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100031600 refcount=4 00010000:00000040:3.0:1788361767.383655:0:6520:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99d100031600, remote cookie: 0x1b69fa8920fe510a, flags: 0x0 00010000:00000040:3.0:1788361767.383662:0:6520:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d13a135000) refcount = 1 00010000:00010000:3.0:1788361767.383675:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe510a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361767.383686:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe510a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788361767.383695:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054a680 x1875230429923456/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361767.383708:0:6520:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:00000040:3.0:1788361767.383716:0:6520:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99d102b3c000) refs 3 00000020:00000040:3.0:1788361767.383719:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100031600 refcount=3 00000020:00000040:3.0:1788361767.383735:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361767.383749:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:3.0:1788361767.383760:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.383770:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923584:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788361767.383790:0:6520:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.383798:0:6520:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361767.383815:0:6520:0:(events.c:337:request_in_callback()) incoming req@ffff99d12cfc6450 x1875230429923584 msgsize 304 00000100:00100000:3.0:1788361767.383850:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361767.383853:0:6520:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361767.383866:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.383888:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361767.384632:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923584 00000100:00100000:1.0:1788361767.384640:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923584 00000020:00000040:1.0:1788361767.384643:0:94211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:1.0:1788361767.384647:0:94211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00000040:1.0:1788361767.384663:0:94211:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788361767.384692:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1788361767.384705:0:94211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:1.0:1788361767.384710:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d12cfc6450 x1875230429923584/t0(0) o256->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 304/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.384724:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429923584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788361767.384745:0:94211:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1788361767.384760:0:94211:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1788361767.384767:0:94211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788361767.384770:0:94211:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1788361767.384776:0:94211:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=24 00000020:00000040:1.0:1788361767.384869:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00010000:00000040:1.0:1788361767.384892:0:94211:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429923584 00000100:00000040:1.0:1788361767.384901:0:94211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:1.0:1788361767.384905:0:94211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361767.384923:0:94211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.384949:0:94211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00000040:1.0:1788361767.384954:0:94211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d12cfc6450 x1875230429923584/t0(0) o256->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 304/240 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.384963:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429923584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 241us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361767.384970:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1788361767.384973:0:94211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000020:00000040:1.0:1788361767.384983:0:94211:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 22 00000100:00000040:3.0:1788361767.385364:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.385377:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.385394:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.385401:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923584:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788361767.385410:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1788361767.385422:0:6520:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:3.0:1788361767.385436:0:6520:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788361767.385454:0:6520:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.135@tcp has 192.168.204.135@tcp. 10000000:00000040:3.0:1788361767.385472:0:6520:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1788361767.385477:0:6520:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99d005034000 already not connected (conn 4, was 0): DISCONN 00000100:00000040:3.0:1788361767.385489:0:6520:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:3.0:1788361767.385504:0:6520:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:3.0:1788361767.385507:0:6520:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.135@tcp -> ffff99d104d3b280 00010000:00080000:3.0:1788361767.385510:0:6520:0:(ldlm_lib.c:85:import_set_conn()) imp ffff99d005034000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.135@tcp, moved to head 00010000:00000040:3.0:1788361767.385515:0:6520:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00080000:3.0:1788361767.385520:0:6520:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1788361767.385525:0:6520:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 60 to 0@lo 00000100:00000040:3.0:1788361767.385527:0:6520:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 61 to 0@lo 00000020:00000040:3.0:1788361767.385529:0:6520:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4166 00000020:00000040:3.0:1788361767.385532:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0055d6800 refcount=4 00000100:00000040:3.0:1788361767.385535:0:6520:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 60 to 0@lo 00000100:00000040:3.0:1788361767.385537:0:6520:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 61 to 0@lo 00000020:00000040:3.0:1788361767.385539:0:6520:0:(genops.c:900:class_export_put()) PUTting export ffff99d0055d6800 : new refcount 3 00000100:00080000:3.0:1788361767.385542:0:6520:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d005034000 using connection 192.168.204.135@tcp/0@lo 00000020:00000040:3.0:1788361767.385557:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d005034000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788361767.385576:0:6520:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788361767.385609:0:6520:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009f471c72] to pc [ptlrpcd_rcv+-1] req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1788361767.385631:0:6520:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788361767.385638:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054a680 x1875230429923584/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361767.385649:0:6520:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:3.0:1788361767.385653:0:6520:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:01000000:3.0:1788361767.385677:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00000040:2.0:1788361767.385680:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361767.385684:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100031600 refcount=3 00010000:00010000:3.0:1788361767.385693:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe510a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361767.385700:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429923712:0@lo:8:ll_cfg_requeue.0 00010000:00010000:3.0:1788361767.385708:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe510a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1788361767.385721:0:6520:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99d005073200) refs 2 10000000:00000040:3.0:1788361767.385725:0:6520:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99d102b3c000) refs 3 10000000:01000000:3.0:1788361767.385728:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361767.385731:0:6520:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99d002df9000 from 128 10000000:01000000:3.0:1788361767.385734:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1788361767.385739:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000100:00000040:2.0:1788361767.385742:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361787 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.385751:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:3.0:1788361767.385754:0:6520:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d13a135000 count: 2 00000020:00000040:3.0:1788361767.385764:0:6520:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d100031a00 with handle 0x1b69fa8920fe5111 to hash 00010000:00010000:3.0:1788361767.385772:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361767.385776:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d57b80 x1875230429923712 msgsize 520 00010000:00010000:3.0:1788361767.385781:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361767.385785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361767.385809:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788361767.385814:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361787 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.385857:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.385859:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4493 usecs (5 jiffies) 00000100:00100000:3.0:1788361767.385873:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923840:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788361767.385888:0:6520:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.385895:0:6520:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788361767.385915:0:6520:0:(events.c:337:request_in_callback()) incoming req@ffff99d14097c850 x1875230429923840 msgsize 328 00000100:00100000:3.0:1788361767.385919:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788361767.385921:0:6520:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788361767.385940:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.385967:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d0038e9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361767.385990:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923712 00000100:00100000:0.0:1788361767.385998:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923712 00000020:00000040:0.0:1788361767.386000:0:26171:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe417b 00000100:00100000:2.0:1788361767.386036:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923840 00000100:00100000:0.0:1788361767.386036:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012 00000100:00100000:2.0:1788361767.386043:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923840 00000100:00000040:0.0:1788361767.386043:0:26171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d57b80 x1875230429923712/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361767.386047:0:94207:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:2.0:1788361767.386052:0:94207:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=23 00000100:00100000:0.0:1788361767.386057:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3649:x1875230429923712:12345-0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788361767.386071:0:94207:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000040:0.0:1788361767.386073:0:26171:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 8 - find 00010000:00000040:0.0:1788361767.386084:0:26171:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1788361767.386092:0:26171:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff99d13fd79000, cookie 0x1b69fa8920fe50a1 00010000:00080000:0.0:1788361767.386097:0:26171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294968769 exp ffff99d13fd79000 cur 2807 last 1788361765 00000100:00100000:2.0:1788361767.386100:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:2.0:1788361767.386107:0:94207:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:2.0:1788361767.386112:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d14097c850 x1875230429923840/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000001:00000040:0.0:1788361767.386122:0:26171:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.135@tcp 00000100:00100000:2.0:1788361767.386132:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+23:6520:x1875230429923840:12345-0@lo:101:ll_cfg_requeue.0 00000001:00000040:0.0:1788361767.386142:0:26171:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 20 00010000:00010000:2.0:1788361767.386145:0:94207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:0.0:1788361767.386150:0:26171:0:(genops.c:889:class_export_get()) GET export ffff99d13fd79000 refcount=4 00000001:00000040:0.0:1788361767.386154:0:26171:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 21 00010000:00000040:2.0:1788361767.386157:0:94207:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99d005604300 count: 3 00000001:00000040:0.0:1788361767.386160:0:26171:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99d1377f8800) : new refcount 20 00000020:00000040:2.0:1788361767.386165:0:94207:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99d005169600 with handle 0x1b69fa8920fe5118 to hash 00002000:00100000:0.0:1788361767.386167:0:26171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d13fd79000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00010000:2.0:1788361767.386173:0:94207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d005169600/0x1b69fa8920fe5118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b69fa8920fe5111 expref: -99 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788361767.386175:0:26171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788361767.386181:0:26171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00000040:2.0:1788361767.386184:0:94207:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99d007453000 : new locks_count 18 00000020:00000040:2.0:1788361767.386195:0:94207:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=24 00000020:00000040:0.0:1788361767.386204:0:26171:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99d004597a20 for nid 0@lo - ref 2 00010000:00000040:2.0:1788361767.386217:0:94207:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d005604300) refcount = 3 00010000:00000040:2.0:1788361767.386222:0:94207:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788361767.386237:0:94207:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d1012ea600/0x1b69fa8920fe510a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe5103 expref: 24 pid: 94209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788361767.386247:0:94207:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99d104c09600/0x1b69fa8920fe50fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0xeb09878fae71143c expref: 9 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361767.386254:0:94207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d005169600/0x1b69fa8920fe5118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b69fa8920fe5111 expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361767.386266:0:94207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d005169600/0x1b69fa8920fe5118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b69fa8920fe5111 expref: 24 pid: 94207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361767.386276:0:94207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d005169600, rc 0) 00010000:00000040:2.0:1788361767.386280:0:94207:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429923840 00000100:00000040:2.0:1788361767.386295:0:94207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:2.0:1788361767.386300:0:94207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361767.386322:0:94207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.386350:0:94207:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 61 to 0@lo 00000100:00000040:2.0:1788361767.386356:0:94207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d14097c850 x1875230429923840/t0(0) o101->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 328/344 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361767.386363:0:26171:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 9 - import 00000100:00100000:2.0:1788361767.386366:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429923840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361767.386376:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000020:00000040:0.0:1788361767.386376:0:26171:0:(genops.c:1244:class_import_put()) import ffff99d11e630800 refcount=1 obd=lustre-OST0000 00000100:00000040:2.0:1788361767.386382:0:94207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:1.0:1788361767.386384:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361767.386387:0:26171:0:(genops.c:889:class_export_get()) GET export ffff99d13fd79000 refcount=5 00000100:00000040:0.0:1788361767.386393:0:26171:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99d13fd79000 : new rpc_count 1 00000020:00000040:2.0:1788361767.386395:0:94207:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:0.0:1788361767.386401:0:26171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:0.0:1788361767.386405:0:26171:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 62 to 0@lo 00000020:00000040:0.0:1788361767.386408:0:26171:0:(genops.c:889:class_export_get()) GET export ffff99d13fd79000 refcount=6 00000100:00000040:0.0:1788361767.386415:0:26171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 63 to 0@lo 00000100:00080000:0.0:1788361767.386424:0:26171:0:(import.c:65:import_set_state_nolock()) ffff99d11e630800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1788361767.386431:0:26171:0:(genops.c:900:class_export_put()) PUTting export ffff99d13fd79000 : new refcount 5 00000020:00000040:0.0:1788361767.386434:0:26171:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99d105318000) now 9 - find 00010000:00000040:0.0:1788361767.386444:0:26171:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968769, transno 0, xid 1875230429923712 00000100:00000040:0.0:1788361767.386449:0:26171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 64 to 0@lo 00000100:00000040:0.0:1788361767.386453:0:26171:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361767.386473:0:26171:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361787 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.386515:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.386517:0:26171:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 63 to 0@lo 00000100:00000040:0.0:1788361767.386527:0:26171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d57b80 x1875230429923712/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.386542:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429923712:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 485us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361767.386551:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012 00000100:00000040:0.0:1788361767.386553:0:26171:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d13fd79000 : new rpc_count 0 00000020:00000040:0.0:1788361767.386560:0:26171:0:(genops.c:900:class_export_put()) PUTting export ffff99d13fd79000 : new refcount 4 00000100:00100000:1.0:1788361767.386567:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923840:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1788361767.386576:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361767.386600:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100031a00 refcount=4 00010000:00000040:1.0:1788361767.386606:0:6520:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99d100031a00, remote cookie: 0x1b69fa8920fe5118, flags: 0x0 00010000:00000040:1.0:1788361767.386611:0:6520:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99d13a135000) refcount = 2 00010000:00000040:1.0:1788361767.386614:0:6520:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788361767.386616:0:6520:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.135@tcp lock: ffff99d100031600/0x1b69fa8920fe5103 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe510a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361767.386624:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe5118 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361767.386633:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b69fa8920fe5118 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788361767.386643:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054a680 x1875230429923840/t0(0) o101->MGC192.168.204.135@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788361783 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361767.386653:0:6520:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:00000040:1.0:1788361767.386659:0:6520:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99d005073200) refs 3 00000020:00000040:1.0:1788361767.386662:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100031a00 refcount=3 00000020:00000040:1.0:1788361767.386694:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:1.0:1788361767.386708:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d1054f2000 refcount=5 obd=MGC192.168.204.135@tcp 00000100:00000040:1.0:1788361767.386719:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.386729:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923968:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1788361767.386757:0:6520:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.386763:0:6520:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361767.386782:0:6520:0:(events.c:337:request_in_callback()) incoming req@ffff99d14097d850 x1875230429923968 msgsize 304 00000100:00100000:1.0:1788361767.386785:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361767.386787:0:6520:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788361767.386810:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.386857:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff99d13944a6c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788361767.389219:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.389256:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968769 gen 2 00000100:00000040:2.0:1788361767.389264:0:3649:0:(client.c:3168:ptlrpc_free_committed()) @@@ commit (last_committed 4294968769) req@ffff99d13983e680 x1875230429912576/t4294968769(4294968769) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788361768 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.389274:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d13983e680 x1875230429912576/t4294968769(4294968769) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788361768 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361767.389289:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d005034000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1788361767.389297:0:3649:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:2.0:1788361767.389303:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361767.389319:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:2.0:1788361767.389323:0:3649:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4166 00000020:00000040:2.0:1788361767.389328:0:3649:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d0055d6800 refcount=4 00000020:00000040:2.0:1788361767.389339:0:3649:0:(genops.c:900:class_export_put()) PUTting export ffff99d0055d6800 : new refcount 3 00000100:00080000:2.0:1788361767.389346:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788361767.389353:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788361767.389354:0:94208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429923968 00000100:00100000:2.0:1788361767.389356:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968769 gen 2 00000100:00000040:2.0:1788361767.389360:0:3649:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1788361767.389364:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d005034000 from lustre-OST0000_UUID committed 4294968769 last 0 00000100:00100000:0.0:1788361767.389366:0:94208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429923968 00000100:00080000:2.0:1788361767.389369:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:0.0:1788361767.389371:0:94208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe40b0 00000020:00000040:2.0:1788361767.389375:0:3649:0:(genops.c:1231:class_import_get()) import ffff99d005034000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:0.0:1788361767.389377:0:94208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d007453000 refcount=24 00000100:00000040:0.0:1788361767.389417:0:94208:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788361767.389467:0:94208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:0.0:1788361767.389482:0:94208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d007453000 : new rpc_count 1 00000100:00000040:0.0:1788361767.389490:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d14097d850 x1875230429923968/t0(0) o256->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 304/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.389504:0:94208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429923968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361767.389535:0:94208:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:0.0:1788361767.389558:0:94208:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1788361767.389567:0:94208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361767.389570:0:94208:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:0.0:1788361767.389577:0:94208:0:(genops.c:889:class_export_get()) GET export ffff99d007453000 refcount=25 00000020:00000040:0.0:1788361767.389702:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 24 00010000:00000040:0.0:1788361767.389723:0:94208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429923968 00000100:00000040:0.0:1788361767.389734:0:94208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 64 to 0@lo 00000100:00000040:0.0:1788361767.389741:0:94208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361767.389762:0:94208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.389787:0:94208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 63 to 0@lo 00000100:00000040:0.0:1788361767.389793:0:94208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d14097d850 x1875230429923968/t0(0) o256->c8a6f36d-efb9-41cf-af98-5917323f2b0d@0@lo:73/0 lens 304/240 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.389803:0:94208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:6520:x1875230429923968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 302us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361767.389812:0:94208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:0.0:1788361767.389816:0:94208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d007453000 : new rpc_count 0 00000100:00000040:1.0:1788361767.389855:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361767.389858:0:94208:0:(genops.c:900:class_export_put()) PUTting export ffff99d007453000 : new refcount 23 00000100:00000040:1.0:1788361767.389870:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.389881:0:6520:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.389889:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8a6f36d-efb9-41cf-af98-5917323f2b0d:6520:1875230429923968:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1788361767.389899:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.389900:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.389932:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d11054b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429923712:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788361767.389941:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d11054b100 x1875230429923712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1788361767.389942:0:6520:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:1.0:1788361767.389963:0:6520:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000020:00000040:2.0:1788361767.389972:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d005034000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788361767.389979:0:6520:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.135@tcp has 192.168.204.135@tcp. 10000000:00000040:1.0:1788361767.389997:0:6520:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1788361767.390002:0:6520:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99d108bef800 already not connected (conn 4, was 0): DISCONN 00000100:00000040:1.0:1788361767.390011:0:6520:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 64 to 0@lo 00000100:00000040:1.0:1788361767.390014:0:6520:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 64 to 0@lo 00000100:00000040:1.0:1788361767.390016:0:6520:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.135@tcp -> ffff99d104d3b280 00010000:00080000:1.0:1788361767.390019:0:6520:0:(ldlm_lib.c:85:import_set_conn()) imp ffff99d108bef800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.135@tcp, moved to head 00010000:00000040:1.0:1788361767.390029:0:6520:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 63 to 0@lo 00010000:00080000:3.0:1788361767.390032:0:96952:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00000100:00080000:1.0:1788361767.390034:0:6520:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1788361767.390039:0:96952:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00000100:00000040:1.0:1788361767.390040:0:6520:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 62 to 0@lo 00000100:00000040:1.0:1788361767.390045:0:6520:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 63 to 0@lo 00000020:00000040:1.0:1788361767.390047:0:6520:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fdda9d 00000020:00000040:1.0:1788361767.390049:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136ca7800 refcount=4 00000100:00000040:1.0:1788361767.390051:0:6520:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 62 to 0@lo 00010000:00010000:3.0:1788361767.390053:0:96952:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788361767.390054:0:6520:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 63 to 0@lo 00000020:00000040:1.0:1788361767.390058:0:6520:0:(genops.c:900:class_export_put()) PUTting export ffff99d136ca7800 : new refcount 3 00000100:00080000:1.0:1788361767.390061:0:6520:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99d108bef800 using connection 192.168.204.135@tcp/0@lo 00000020:00000040:1.0:1788361767.390073:0:6520:0:(genops.c:1231:class_import_get()) import ffff99d108bef800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1788361767.390090:0:6520:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788361767.390101:0:6520:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004604bb3a] to pc [ptlrpcd_rcv+-1] req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361767.390105:0:96952:0:(import.c:65:import_set_state_nolock()) ffff99d005034000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1788361767.390117:0:96952:0:(genops.c:1231:class_import_get()) import ffff99d005034000 refcount=5 obd=lustre-OST0000-osc-MDT0000 10000000:00000040:1.0:1788361767.390122:0:6520:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788361767.390133:0:6520:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136b59180 x1875230429923968/t0(0) o256->MGC192.168.204.135@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788361783 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.390134:0:96952:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a2d33e2e] to pc [ptlrpcd_rcv+-1] req@ffff99d110549f80 x1875230429924224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361767.390159:0:96952:0:(genops.c:1244:class_import_put()) import ffff99d005034000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:1.0:1788361767.390160:0:6520:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=4 obd=MGC192.168.204.135@tcp 00000020:00000040:1.0:1788361767.390164:0:6520:0:(genops.c:1244:class_import_put()) import ffff99d1054f2000 refcount=3 obd=MGC192.168.204.135@tcp 10000000:01000000:1.0:1788361767.390188:0:6520:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1788361767.390194:0:6520:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99d100031a00 refcount=3 00010000:00010000:1.0:1788361767.390201:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe5118 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361767.390213:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff99d100031a00/0x1b69fa8920fe5111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b69fa8920fe5118 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1788361767.390236:0:6520:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99d005073200) refs 3 00000100:00000040:2.0:1788361767.390269:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.390283:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429924096:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788361767.390306:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361787 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.390314:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361767.390334:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d54a80 x1875230429924096 msgsize 520 00000100:00100000:2.0:1788361767.390339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361767.390358:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361787 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.390370:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2660 usecs (3 jiffies) 00000100:00000040:2.0:1788361767.390378:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d110549f80 x1875230429924224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.390386:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d110549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875230429924224:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1788361767.390413:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff99d110549f80 x1875230429924224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361783 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.390420:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361767.390432:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d56680 x1875230429924224 msgsize 224 00000100:00100000:2.0:1788361767.390436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361767.390454:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d110549f80 x1875230429924224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361783 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.390463:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4491 usecs (5 jiffies) 00000100:00100000:1.0:1788361767.390480:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924096 00000100:00100000:1.0:1788361767.390487:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924096 00000020:00000040:1.0:1788361767.390489:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fddab2 00000100:00100000:1.0:1788361767.390520:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924224 00000100:00100000:1.0:1788361767.390524:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924224 00000020:00000040:1.0:1788361767.390525:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a1 00000020:00000040:1.0:1788361767.390528:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d13fd79000 refcount=5 00000100:00000040:1.0:1788361767.390544:0:26172:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1788361767.390671:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00000040:3.0:1788361767.390676:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d13fd79000 : new rpc_count 1 00000100:00000040:3.0:1788361767.390688:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d56680 x1875230429924224/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.390700:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429924224:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:3.0:1788361767.390712:0:8440:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d56680 x1875230429924224/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788361767.390723:0:8440:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d13fd79000 : new rpc_count 2 00010000:00080000:3.0:1788361767.390727:0:8440:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d002d56680 x1875230429924224/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.390746:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d56680 x1875230429924224/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.390754:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875230429924224:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 57us (320us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.390761:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00000040:3.0:1788361767.390764:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d13fd79000 : new rpc_count 1 00010000:00080000:0.0:1788361767.390774:0:96787:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1788361767.390778:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5013 00000100:00000040:3.0:1788361767.390783:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d54a80 x1875230429924096/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788361787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.390790:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1875230429924096:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:3.0:1788361767.390805:0:8440:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 9 - find 00010000:00000040:3.0:1788361767.390814:0:8440:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1788361767.390946:0:8440:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d13fd7a000, cookie 0x1b69fa8920fe509a 00010000:00080000:3.0:1788361767.390953:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d13fd7a000 cur 2807 last 1788361765 00000001:00000040:3.0:1788361767.390967:0:8440:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.135@tcp 00000001:00000040:3.0:1788361767.390974:0:8440:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 21 00000020:00000040:3.0:1788361767.390978:0:8440:0:(genops.c:889:class_export_get()) GET export ffff99d13fd7a000 refcount=4 00000001:00000040:3.0:1788361767.390987:0:8440:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99d1377f8800) : new refcount 22 00000001:00000040:3.0:1788361767.390991:0:8440:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99d1377f8800) : new refcount 21 00002000:00100000:3.0:1788361767.390996:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99d13fd7a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788361767.391000:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788361767.391004:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1788361767.391015:0:8440:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99d004597a20 for nid 0@lo - ref 3 00000020:00000040:3.0:1788361767.391026:0:8440:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99d105318000) now 10 - import 00000020:00000040:3.0:1788361767.391031:0:8440:0:(genops.c:1244:class_import_put()) import ffff99d006c8b800 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1788361767.391037:0:8440:0:(genops.c:889:class_export_get()) GET export ffff99d13fd7a000 refcount=5 00000100:00000040:3.0:1788361767.391039:0:8440:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99d13fd7a000 : new rpc_count 1 00000100:00000040:3.0:1788361767.391043:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 64 to 0@lo 00000100:00000040:3.0:1788361767.391045:0:8440:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99d104d3b280 refcount 64 to 0@lo 00000020:00000040:3.0:1788361767.391048:0:8440:0:(genops.c:889:class_export_get()) GET export ffff99d13fd7a000 refcount=6 00000100:00000040:3.0:1788361767.391054:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 65 to 0@lo 00000100:00080000:3.0:1788361767.391062:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99d006c8b800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1788361767.391074:0:8440:0:(genops.c:900:class_export_put()) PUTting export ffff99d13fd7a000 : new refcount 5 00000020:00000040:3.0:1788361767.391078:0:8440:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99d105318000) now 10 - find 00010000:00000040:3.0:1788361767.391089:0:8440:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968741, transno 0, xid 1875230429924096 00000100:00000040:3.0:1788361767.391095:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 66 to 0@lo 00010000:00080000:0.0:1788361767.391097:0:96787:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:3.0:1788361767.391102:0:8440:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:0.0:1788361767.391105:0:96787:0:(ldlm_lib.c:2874:target_recovery_thread()) 1: request replay stage - 2 clients from t4294968774 00010000:00080000:0.0:1788361767.391110:0:96787:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 4294968774 00000100:00000040:3.0:1788361767.391126:0:8440:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788361787 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788361767.391128:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294968774, next_transno: 4294968774 00010000:00080000:0.0:1788361767.391136:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968774) 00000100:00000040:3.0:1788361767.391164:0:8440:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 65 to 0@lo 00000100:00000040:3.0:1788361767.391170:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d54a80 x1875230429924096/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.391179:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875230429924096:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 388us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361767.391186:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5013 00000100:00000040:3.0:1788361767.391195:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d13fd7a000 : new rpc_count 0 00000020:00000040:3.0:1788361767.391203:0:8440:0:(genops.c:900:class_export_put()) PUTting export ffff99d13fd7a000 : new refcount 4 00010000:00080000:0.0:1788361767.391226:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407078656 t4294968774 from 192.168.204.35@tcp req@ffff99d117282d80 x1875230407078656/t0(4294968774) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.391248:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d117282d80 x1875230407078656/t0(4294968774) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.391291:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x782:0x0] 00010000:00080000:1.0:1788361767.391615:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.391623:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968741 00000100:00000040:1.0:1788361767.391626:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361767.391634:0:3649:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:1.0:1788361767.391636:0:3649:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fdda9d 00000020:00000040:1.0:1788361767.391638:0:3649:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136ca7800 refcount=4 00000020:00000040:1.0:1788361767.391643:0:3649:0:(genops.c:900:class_export_put()) PUTting export ffff99d136ca7800 : new refcount 3 00000100:00080000:1.0:1788361767.391646:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788361767.391648:0:3649:0:(import.c:1706:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788361767.391650:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968741 gen 2 00000100:00000040:1.0:1788361767.391652:0:3649:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1788361767.391654:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff99d108bef800 from lustre-OST0000_UUID committed 4294968741 last 0 00000100:00080000:1.0:1788361767.391656:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1788361767.391658:0:3649:0:(genops.c:1231:class_import_get()) import ffff99d108bef800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788361767.391903:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.391923:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429924096:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1788361767.391930:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136b5a680 x1875230429924096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361787 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361767.391941:0:3649:0:(genops.c:1244:class_import_put()) import ffff99d108bef800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:3.0:1788361767.391983:0:96953:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788361767.391987:0:96953:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1788361767.391992:0:96953:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1788361767.392037:0:96953:0:(import.c:65:import_set_state_nolock()) ffff99d108bef800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1788361767.392044:0:96953:0:(genops.c:1231:class_import_get()) import ffff99d108bef800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788361767.392057:0:96953:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d78785e6] to pc [ptlrpcd_rcv+-1] req@ffff99d11054b800 x1875230429924352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.392094:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d11054b800 x1875230429924352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.392101:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d11054b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875230429924352:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1788361767.392116:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff99d11054b800 x1875230429924352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361783 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.392121:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361767.392142:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff99d136b5a680 x1875230429924352 msgsize 224 00000100:00100000:1.0:1788361767.392148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788361767.392174:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d11054b800 x1875230429924352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788361783 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.392187:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2656 usecs (3 jiffies) 00000020:00000040:3.0:1788361767.392208:0:96953:0:(genops.c:1244:class_import_put()) import ffff99d108bef800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1788361767.392226:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924352 00000100:00100000:2.0:1788361767.392232:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924352 00000020:00000040:2.0:1788361767.392234:0:26170:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe509a 00000020:00000040:2.0:1788361767.392243:0:26170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d13fd7a000 refcount=5 00000100:00100000:2.0:1788361767.392289:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00000040:2.0:1788361767.392293:0:26170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d13fd7a000 : new rpc_count 1 00000100:00000040:2.0:1788361767.392299:0:26170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136b5a680 x1875230429924352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.392312:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3649:x1875230429924352:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1788361767.392323:0:26170:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136b5a680 x1875230429924352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788361767.392333:0:26170:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d13fd7a000 : new rpc_count 2 00010000:00080000:2.0:1788361767.392338:0:26170:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99d136b5a680 x1875230429924352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361767.392347:0:26170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b5a680 x1875230429924352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361767.392355:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3649:x1875230429924352:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 45us (211us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.392364:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00000040:2.0:1788361767.392366:0:26170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d13fd7a000 : new rpc_count 1 00000001:00000040:0.0:1788361767.393268:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 1 00000020:00000040:0.0:1788361767.393274:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=6 00010000:00000040:0.0:1788361767.393350:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968774, xid 1875230407078656 00000100:00000040:0.0:1788361767.393360:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.393371:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.393437:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.393454:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.393461:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.393482:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 5 00010000:00080000:0.0:1788361767.393488:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968775 00010000:00080000:0.0:1788361767.393493:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968775 00000100:00000040:0.0:1788361767.396030:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e8a80 x1875230407079936 msgsize 440 00000100:00100000:0.0:1788361767.396048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.396121:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407079936 00000100:00100000:3.0:1788361767.396185:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407079936 00000020:00000040:3.0:1788361767.396190:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.396197:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=6 00000100:00000040:3.0:1788361767.396228:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.396287:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 642 00000100:00000040:3.0:1788361767.396293:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.396302:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e8a80 x1875230407079936/t0(4294968775) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.396317:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+6:2408:x1875230407079936:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.396332:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e8a80 x1875230407079936/t0(4294968775) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.396342:0:24842:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968775, current: 4294968775, replaying 00010000:00000040:3.0:1788361767.396346:0:24842:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.396364:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e8a80 x1875230407079936/t0(4294968775) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.396509:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968775, next_transno: 4294968775 00010000:00080000:0.0:1788361767.396514:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968775) 00010000:00080000:0.0:1788361767.396523:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407079936 t4294968775 from 192.168.204.35@tcp req@ffff99d1185e8a80 x1875230407079936/t0(4294968775) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.396543:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e8a80 x1875230407079936/t0(4294968775) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.396606:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x784:0x0] 00000001:00000040:0.0:1788361767.396882:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 2 00000020:00000040:0.0:1788361767.396887:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=7 00010000:00000040:0.0:1788361767.396928:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968775, xid 1875230407079936 00000100:00000040:0.0:1788361767.396941:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.396948:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.397008:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.397020:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.397026:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.397030:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968776 00010000:00080000:0.0:1788361767.397034:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968776 00000100:00100000:3.0:1788361767.397153:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407079936:12345-192.168.204.35@tcp:10:dd.0 Request processed in 838us (1122us total) trans 4294968775 rc 0/0 00000100:00100000:3.0:1788361767.397162:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 642 00000100:00000040:3.0:1788361767.397167:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.397179:0:24842:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 6 00000100:00000040:2.0:1788361767.399351:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d55c00 x1875230407081216 msgsize 440 00000100:00100000:2.0:1788361767.399378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.399528:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081216 00000100:00100000:3.0:1788361767.399541:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081216 00000020:00000040:3.0:1788361767.399544:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.399551:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=7 00000100:00000040:3.0:1788361767.399582:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.399652:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 643 00000100:00000040:3.0:1788361767.399658:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.399668:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d55c00 x1875230407081216/t0(4294968776) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.399683:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407081216:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.399697:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d55c00 x1875230407081216/t0(4294968776) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.399709:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968776, current: 4294968776, replaying 00010000:00000040:3.0:1788361767.399713:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.399789:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d55c00 x1875230407081216/t0(4294968776) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.399800:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2408:x1875230407081216:12345-192.168.204.35@tcp:10:dd.0 Request processed in 119us (451us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.399807:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 643 00000100:00000040:3.0:1788361767.399811:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.400058:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968776, next_transno: 4294968776 00010000:00080000:0.0:1788361767.400064:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968776) 00010000:00080000:0.0:1788361767.400074:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407081216 t4294968776 from 192.168.204.35@tcp req@ffff99d002d55c00 x1875230407081216/t0(4294968776) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.400092:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d55c00 x1875230407081216/t0(4294968776) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.400136:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x783:0x0] 00000001:00000040:0.0:1788361767.400508:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 3 00000020:00000040:0.0:1788361767.400512:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=8 00010000:00000040:0.0:1788361767.400557:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968776, xid 1875230407081216 00000100:00000040:0.0:1788361767.400569:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.400576:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.400652:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.400665:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.400673:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.400684:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 7 00010000:00080000:0.0:1788361767.400689:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968777 00010000:00080000:0.0:1788361767.400693:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968777 00000100:00000040:2.0:1788361767.402952:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d54380 x1875230407081856 msgsize 440 00000100:00100000:2.0:1788361767.402970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.403074:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407081856 00000100:00100000:1.0:1788361767.403086:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407081856 00000020:00000040:1.0:1788361767.403089:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.403095:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=8 00000100:00000040:1.0:1788361767.403123:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.403192:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 644 00000100:00000040:1.0:1788361767.403198:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.403208:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d54380 x1875230407081856/t0(4294968777) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.403225:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2408:x1875230407081856:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:1.0:1788361767.403259:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d54380 x1875230407081856/t0(4294968777) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.403269:0:8445:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968777, current: 4294968777, replaying 00010000:00000040:1.0:1788361767.403273:0:8445:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.403295:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d54380 x1875230407081856/t0(4294968777) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.403308:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+8:2408:x1875230407081856:12345-192.168.204.35@tcp:10:dd.0 Request processed in 83us (355us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.403317:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 644 00010000:00080000:0.0:1788361767.403320:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968777, next_transno: 4294968777 00000100:00000040:1.0:1788361767.403323:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.403327:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968777) 00010000:00080000:0.0:1788361767.403339:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407081856 t4294968777 from 192.168.204.35@tcp req@ffff99d002d54380 x1875230407081856/t0(4294968777) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.403404:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d54380 x1875230407081856/t0(4294968777) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.403483:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x788:0x0] 00000001:00000040:0.0:1788361767.403708:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 4 00000020:00000040:0.0:1788361767.403712:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=9 00010000:00000040:0.0:1788361767.403749:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968777, xid 1875230407081856 00000100:00000040:0.0:1788361767.403766:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.403773:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.403848:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.403861:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.403867:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.403878:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 8 00010000:00080000:0.0:1788361767.403882:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968778 00010000:00080000:0.0:1788361767.403887:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968778 00000100:00000040:1.0:1788361767.406025:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d136b59180 x1875230407084032 msgsize 440 00000100:00100000:1.0:1788361767.406041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.406143:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084032 00000100:00100000:2.0:1788361767.406214:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084032 00000020:00000040:2.0:1788361767.406219:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.406224:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=9 00000100:00000040:2.0:1788361767.406251:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.406332:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 645 00000100:00000040:2.0:1788361767.406352:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.406361:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136b59180 x1875230407084032/t0(4294968778) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.406376:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2408:x1875230407084032:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:2.0:1788361767.406388:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136b59180 x1875230407084032/t0(4294968778) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.406409:0:24837:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968778, current: 4294968778, replaying 00010000:00000040:2.0:1788361767.406413:0:24837:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.406431:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b59180 x1875230407084032/t0(4294968778) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.406440:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+9:2408:x1875230407084032:12345-192.168.204.35@tcp:10:dd.0 Request processed in 68us (416us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.406447:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 645 00000100:00000040:2.0:1788361767.406451:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.406496:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968778, next_transno: 4294968778 00010000:00080000:0.0:1788361767.406503:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968778) 00010000:00080000:0.0:1788361767.406512:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407084032 t4294968778 from 192.168.204.35@tcp req@ffff99d136b59180 x1875230407084032/t0(4294968778) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.406531:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136b59180 x1875230407084032/t0(4294968778) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.406565:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x785:0x0] 00000001:00000040:0.0:1788361767.406786:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 5 00000020:00000040:0.0:1788361767.406796:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=10 00010000:00000040:0.0:1788361767.409553:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968778, xid 1875230407084032 00000100:00000040:0.0:1788361767.409581:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.409607:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.409685:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.409702:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.409714:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.409728:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 9 00010000:00080000:0.0:1788361767.409736:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968779 00010000:00080000:0.0:1788361767.409742:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968779 00000100:00000040:2.0:1788361767.414114:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d002d56d80 x1875230407084160 msgsize 440 00000100:00100000:2.0:1788361767.414130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.414251:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407084160 00000100:00100000:0.0:1788361767.414264:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407084160 00000020:00000040:0.0:1788361767.414268:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.414274:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=10 00000100:00000040:0.0:1788361767.414305:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.414370:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 646 00000100:00000040:0.0:1788361767.414375:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.414385:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d002d56d80 x1875230407084160/t0(4294968779) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.414400:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2408:x1875230407084160:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:0.0:1788361767.414415:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d56d80 x1875230407084160/t0(4294968779) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.414425:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968779, current: 4294968779, replaying 00010000:00000040:0.0:1788361767.414428:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.414449:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d002d56d80 x1875230407084160/t0(4294968779) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.414458:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d002d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+10:2408:x1875230407084160:12345-192.168.204.35@tcp:10:dd.0 Request processed in 61us (345us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.414485:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 646 00000100:00000040:0.0:1788361767.414489:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.414557:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968779, next_transno: 4294968779 00010000:00080000:3.0:1788361767.414561:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968779) 00010000:00080000:3.0:1788361767.414573:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407084160 t4294968779 from 192.168.204.35@tcp req@ffff99d002d56d80 x1875230407084160/t0(4294968779) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.414595:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d002d56d80 x1875230407084160/t0(4294968779) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.414630:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x786:0x0] 00000001:00000040:3.0:1788361767.415105:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 6 00000020:00000040:3.0:1788361767.415109:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=11 00010000:00000040:3.0:1788361767.415154:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968779, xid 1875230407084160 00000100:00000040:3.0:1788361767.415166:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.415173:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.415279:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.415290:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.415296:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.415307:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 10 00010000:00080000:3.0:1788361767.415312:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968780 00010000:00080000:3.0:1788361767.415316:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968780 00000100:00000040:2.0:1788361767.416943:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef0000 x1875230407086592 msgsize 440 00000100:00100000:2.0:1788361767.416956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.417089:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407086592 00000100:00100000:1.0:1788361767.417099:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407086592 00000020:00000040:1.0:1788361767.417102:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.417107:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=11 00000100:00000040:1.0:1788361767.417132:0:8444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.417222:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 647 00000100:00000040:1.0:1788361767.417227:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.417234:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef0000 x1875230407086592/t0(4294968780) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.417248:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2408:x1875230407086592:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:1.0:1788361767.417259:0:8444:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef0000 x1875230407086592/t0(4294968780) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.417268:0:8444:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968780, current: 4294968780, replaying 00010000:00000040:1.0:1788361767.417285:0:8444:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.417308:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef0000 x1875230407086592/t0(4294968780) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.417318:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2408:x1875230407086592:12345-192.168.204.35@tcp:10:dd.0 Request processed in 73us (375us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.417326:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 647 00000100:00000040:1.0:1788361767.417329:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.417381:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968780, next_transno: 4294968780 00010000:00080000:0.0:1788361767.417385:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968780) 00010000:00080000:0.0:1788361767.417393:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407086592 t4294968780 from 192.168.204.35@tcp req@ffff99d136ef0000 x1875230407086592/t0(4294968780) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.417410:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef0000 x1875230407086592/t0(4294968780) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.417440:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78f:0x0] 00000001:00000040:0.0:1788361767.417644:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 7 00000020:00000040:0.0:1788361767.417648:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=12 00010000:00000040:0.0:1788361767.417689:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968780, xid 1875230407086592 00000100:00000040:0.0:1788361767.417698:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.417703:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.417784:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.417793:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.417798:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.417807:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 11 00010000:00080000:0.0:1788361767.417812:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968781 00010000:00080000:0.0:1788361767.417816:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968781 00000100:00000040:1.0:1788361767.419740:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d136b58380 x1875230407087104 msgsize 440 00000100:00100000:1.0:1788361767.419756:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.420016:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407087104 00000100:00100000:3.0:1788361767.420028:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407087104 00000020:00000040:3.0:1788361767.420031:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.420037:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=12 00000100:00000040:3.0:1788361767.420069:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.420176:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 648 00000100:00000040:3.0:1788361767.420181:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.420192:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136b58380 x1875230407087104/t0(4294968781) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.420206:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2408:x1875230407087104:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.420234:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136b58380 x1875230407087104/t0(4294968781) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.420244:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968781, current: 4294968781, replaying 00010000:00000040:3.0:1788361767.420247:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.420264:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136b58380 x1875230407087104/t0(4294968781) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.420274:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+12:2408:x1875230407087104:12345-192.168.204.35@tcp:10:dd.0 Request processed in 71us (535us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.420281:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 648 00000100:00000040:3.0:1788361767.420285:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.420332:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968781, next_transno: 4294968781 00010000:00080000:0.0:1788361767.420338:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968781) 00010000:00080000:0.0:1788361767.420346:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407087104 t4294968781 from 192.168.204.35@tcp req@ffff99d136b58380 x1875230407087104/t0(4294968781) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.420363:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136b58380 x1875230407087104/t0(4294968781) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.420419:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x787:0x0] 00000001:00000040:0.0:1788361767.420683:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 8 00000020:00000040:0.0:1788361767.420687:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=13 00010000:00000040:0.0:1788361767.420725:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968781, xid 1875230407087104 00000100:00000040:0.0:1788361767.420736:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.420742:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.420803:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.420813:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.420818:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.420844:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 12 00010000:00080000:0.0:1788361767.420849:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968782 00010000:00080000:0.0:1788361767.420853:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968782 00000100:00000040:2.0:1788361767.422620:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef1500 x1875230407088512 msgsize 440 00000100:00100000:2.0:1788361767.422636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.422729:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088512 00000100:00100000:0.0:1788361767.422741:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088512 00000020:00000040:0.0:1788361767.422744:0:24841:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.422749:0:24841:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=13 00000100:00000040:0.0:1788361767.422776:0:24841:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.422856:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 649 00000100:00000040:0.0:1788361767.422866:0:24841:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.422875:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef1500 x1875230407088512/t0(4294968782) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.422891:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:2408:x1875230407088512:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:0.0:1788361767.422905:0:24841:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef1500 x1875230407088512/t0(4294968782) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.422927:0:24841:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968782, current: 4294968782, replaying 00010000:00000040:0.0:1788361767.422930:0:24841:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.422968:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef1500 x1875230407088512/t0(4294968782) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.422978:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+13:2408:x1875230407088512:12345-192.168.204.35@tcp:10:dd.0 Request processed in 90us (357us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.422986:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 649 00000100:00000040:0.0:1788361767.422990:0:24841:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.423140:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968782, next_transno: 4294968782 00010000:00080000:3.0:1788361767.423146:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968782) 00010000:00080000:3.0:1788361767.423155:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407088512 t4294968782 from 192.168.204.35@tcp req@ffff99d136ef1500 x1875230407088512/t0(4294968782) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.423174:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef1500 x1875230407088512/t0(4294968782) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.423207:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x789:0x0] 00000001:00000040:3.0:1788361767.423473:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 9 00000020:00000040:3.0:1788361767.423477:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=14 00010000:00000040:3.0:1788361767.423520:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968782, xid 1875230407088512 00000100:00000040:3.0:1788361767.423530:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.423538:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.423602:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.423612:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.423619:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.423628:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 13 00010000:00080000:3.0:1788361767.423640:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968783 00010000:00080000:3.0:1788361767.423644:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968783 00000100:00000040:1.0:1788361767.426078:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429b800 x1875230407088768 msgsize 440 00000100:00100000:1.0:1788361767.426098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.426355:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407088768 00000100:00100000:3.0:1788361767.426369:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407088768 00000020:00000040:3.0:1788361767.426372:0:24839:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.426379:0:24839:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=14 00000100:00000040:3.0:1788361767.426408:0:24839:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.426521:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 650 00000100:00000040:3.0:1788361767.426534:0:24839:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.426544:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429b800 x1875230407088768/t0(4294968783) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.426565:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2408:x1875230407088768:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.426580:0:24839:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429b800 x1875230407088768/t0(4294968783) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.426598:0:24839:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968783, current: 4294968783, replaying 00010000:00000040:3.0:1788361767.426600:0:24839:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.426621:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429b800 x1875230407088768/t0(4294968783) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.426631:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+14:2408:x1875230407088768:12345-192.168.204.35@tcp:10:dd.0 Request processed in 75us (555us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.426638:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 650 00000100:00000040:3.0:1788361767.426642:0:24839:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.426700:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968783, next_transno: 4294968783 00010000:00080000:0.0:1788361767.426705:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968783) 00010000:00080000:0.0:1788361767.426714:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407088768 t4294968783 from 192.168.204.35@tcp req@ffff99d10429b800 x1875230407088768/t0(4294968783) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.426730:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429b800 x1875230407088768/t0(4294968783) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.426763:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78a:0x0] 00000001:00000040:1.0:1788361767.427383:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 10 00000020:00000040:1.0:1788361767.427389:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=15 00010000:00000040:1.0:1788361767.427442:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968783, xid 1875230407088768 00000100:00000040:1.0:1788361767.427460:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.427468:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.427537:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.427548:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.427555:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.427565:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 14 00010000:00080000:1.0:1788361767.427569:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968784 00010000:00080000:1.0:1788361767.427574:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968784 00000100:00000040:1.0:1788361767.430712:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d104299880 x1875230407090816 msgsize 440 00000100:00100000:1.0:1788361767.430732:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.431121:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407090816 00000100:00100000:0.0:1788361767.431141:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407090816 00000020:00000040:0.0:1788361767.431145:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.431151:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=15 00000100:00000040:0.0:1788361767.431186:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.431348:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 651 00000100:00000040:0.0:1788361767.431353:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.431363:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104299880 x1875230407090816/t0(4294968784) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.431379:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2408:x1875230407090816:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:0.0:1788361767.431394:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104299880 x1875230407090816/t0(4294968784) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.431416:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968784, current: 4294968784, replaying 00010000:00000040:0.0:1788361767.431438:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.431463:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104299880 x1875230407090816/t0(4294968784) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.431472:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+15:2408:x1875230407090816:12345-192.168.204.35@tcp:10:dd.0 Request processed in 97us (762us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.431480:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 651 00000100:00000040:0.0:1788361767.431484:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.431542:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968784, next_transno: 4294968784 00010000:00080000:3.0:1788361767.431548:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968784) 00010000:00080000:3.0:1788361767.431566:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407090816 t4294968784 from 192.168.204.35@tcp req@ffff99d104299880 x1875230407090816/t0(4294968784) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.431607:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104299880 x1875230407090816/t0(4294968784) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.431647:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x794:0x0] 00000001:00000040:3.0:1788361767.431947:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 11 00000020:00000040:3.0:1788361767.431953:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=16 00010000:00000040:3.0:1788361767.432003:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968784, xid 1875230407090816 00000100:00000040:3.0:1788361767.432015:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.432021:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.432082:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.432093:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.432100:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.432110:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 15 00010000:00080000:3.0:1788361767.432115:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968785 00010000:00080000:3.0:1788361767.432119:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968785 00000100:00000040:2.0:1788361767.433895:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef1f80 x1875230407091968 msgsize 440 00000100:00100000:2.0:1788361767.433913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.433965:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407091968 00000100:00100000:3.0:1788361767.433975:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407091968 00000020:00000040:3.0:1788361767.433978:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.433983:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=16 00000100:00000040:3.0:1788361767.434007:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.434055:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 652 00000100:00000040:3.0:1788361767.434060:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.434068:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef1f80 x1875230407091968/t0(4294968785) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.434084:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:2408:x1875230407091968:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.434096:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef1f80 x1875230407091968/t0(4294968785) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.434125:0:24842:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968785, current: 4294968785, replaying 00010000:00000040:3.0:1788361767.434128:0:24842:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.434151:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef1f80 x1875230407091968/t0(4294968785) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.434160:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+16:2408:x1875230407091968:12345-192.168.204.35@tcp:10:dd.0 Request processed in 80us (266us total) trans 0 rc 0/-999 00010000:00080000:1.0:1788361767.434211:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968785, next_transno: 4294968785 00010000:00080000:1.0:1788361767.434272:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968785) 00010000:00080000:1.0:1788361767.434283:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407091968 t4294968785 from 192.168.204.35@tcp req@ffff99d136ef1f80 x1875230407091968/t0(4294968785) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.434306:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef1f80 x1875230407091968/t0(4294968785) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788361767.434335:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78c:0x0] 00000100:00100000:3.0:1788361767.434362:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 652 00000100:00000040:3.0:1788361767.434367:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00000001:00000040:1.0:1788361767.434505:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 12 00000020:00000040:1.0:1788361767.434510:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=17 00010000:00000040:1.0:1788361767.434545:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968785, xid 1875230407091968 00000100:00000040:1.0:1788361767.434934:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.434941:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.434984:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.434993:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.434998:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.435008:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 16 00010000:00080000:1.0:1788361767.435012:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968786 00010000:00080000:1.0:1788361767.435016:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968786 00000100:00000040:1.0:1788361767.439987:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429a680 x1875230407093120 msgsize 440 00000100:00100000:1.0:1788361767.440003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.440100:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407093120 00000100:00100000:2.0:1788361767.440110:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407093120 00000020:00000040:2.0:1788361767.440113:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.440119:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=17 00000100:00000040:2.0:1788361767.440149:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.440206:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 653 00000100:00000040:2.0:1788361767.440211:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.440219:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429a680 x1875230407093120/t0(4294968786) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.440232:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:2408:x1875230407093120:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:2.0:1788361767.440244:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429a680 x1875230407093120/t0(4294968786) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.440254:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968786, current: 4294968786, replaying 00010000:00000040:2.0:1788361767.440257:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.440315:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429a680 x1875230407093120/t0(4294968786) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.440325:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+17:2408:x1875230407093120:12345-192.168.204.35@tcp:10:dd.0 Request processed in 95us (339us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.440333:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 653 00000100:00000040:2.0:1788361767.440336:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.441489:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968786, next_transno: 4294968786 00010000:00080000:1.0:1788361767.441496:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968786) 00010000:00080000:1.0:1788361767.441507:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407093120 t4294968786 from 192.168.204.35@tcp req@ffff99d10429a680 x1875230407093120/t0(4294968786) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.441528:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429a680 x1875230407093120/t0(4294968786) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788361767.441557:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78b:0x0] 00000001:00000040:1.0:1788361767.442092:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 13 00000020:00000040:1.0:1788361767.442097:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=18 00010000:00000040:1.0:1788361767.442128:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968786, xid 1875230407093120 00000100:00000040:1.0:1788361767.442142:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.442149:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.442244:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.442254:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.442260:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.442270:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 17 00010000:00080000:1.0:1788361767.442274:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968787 00010000:00080000:1.0:1788361767.442278:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968787 00000100:00000040:2.0:1788361767.444903:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef0a80 x1875230407094656 msgsize 440 00000100:00100000:2.0:1788361767.444923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.445088:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094656 00000100:00100000:1.0:1788361767.445099:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094656 00000020:00000040:1.0:1788361767.445102:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.445107:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=18 00000100:00000040:1.0:1788361767.445132:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.445184:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 654 00000100:00000040:1.0:1788361767.445197:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.445206:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef0a80 x1875230407094656/t0(4294968787) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.445221:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:2408:x1875230407094656:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:1.0:1788361767.445237:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef0a80 x1875230407094656/t0(4294968787) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.445247:0:8445:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968787, current: 4294968787, replaying 00010000:00000040:1.0:1788361767.445250:0:8445:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.445322:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef0a80 x1875230407094656/t0(4294968787) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.445332:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+18:2408:x1875230407094656:12345-192.168.204.35@tcp:10:dd.0 Request processed in 114us (429us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.445342:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 654 00000100:00000040:1.0:1788361767.445353:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.445541:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968787, next_transno: 4294968787 00010000:00080000:3.0:1788361767.445546:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968787) 00010000:00080000:3.0:1788361767.445555:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407094656 t4294968787 from 192.168.204.35@tcp req@ffff99d136ef0a80 x1875230407094656/t0(4294968787) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.445570:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef0a80 x1875230407094656/t0(4294968787) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.445614:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78e:0x0] 00000001:00000040:3.0:1788361767.445779:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 14 00000020:00000040:3.0:1788361767.445783:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=19 00010000:00000040:3.0:1788361767.445818:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968787, xid 1875230407094656 00000100:00000040:3.0:1788361767.446520:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.446531:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.446650:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.446666:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.446705:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.446735:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 18 00010000:00080000:3.0:1788361767.446741:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968788 00010000:00080000:3.0:1788361767.446759:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968788 00000100:00000040:0.0:1788361767.453453:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185ebb80 x1875230407094784 msgsize 440 00000100:00100000:0.0:1788361767.453471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.453526:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407094784 00000100:00100000:3.0:1788361767.453541:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407094784 00000020:00000040:3.0:1788361767.453546:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.453553:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=19 00000100:00000040:3.0:1788361767.453605:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.453679:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 655 00000100:00000040:3.0:1788361767.453686:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.453695:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185ebb80 x1875230407094784/t0(4294968788) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.453721:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:2408:x1875230407094784:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.453736:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185ebb80 x1875230407094784/t0(4294968788) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.453747:0:24837:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968788, current: 4294968788, replaying 00010000:00000040:3.0:1788361767.453763:0:24837:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.453785:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185ebb80 x1875230407094784/t0(4294968788) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.453795:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+19:2408:x1875230407094784:12345-192.168.204.35@tcp:10:dd.0 Request processed in 78us (345us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.453803:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 655 00000100:00000040:3.0:1788361767.453807:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.453945:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968788, next_transno: 4294968788 00010000:00080000:0.0:1788361767.453951:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968788) 00010000:00080000:0.0:1788361767.453962:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407094784 t4294968788 from 192.168.204.35@tcp req@ffff99d1185ebb80 x1875230407094784/t0(4294968788) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.453981:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185ebb80 x1875230407094784/t0(4294968788) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.454019:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78d:0x0] 00000001:00000040:0.0:1788361767.454244:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 15 00000020:00000040:0.0:1788361767.454249:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=20 00010000:00000040:0.0:1788361767.454294:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968788, xid 1875230407094784 00000100:00000040:0.0:1788361767.454307:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.454315:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.454378:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.454391:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.454398:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.454410:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 19 00010000:00080000:0.0:1788361767.454415:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968789 00010000:00080000:0.0:1788361767.454420:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968789 00000100:00000040:1.0:1788361767.457075:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429bb80 x1875230407095936 msgsize 440 00000100:00100000:1.0:1788361767.457096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.457304:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407095936 00000100:00100000:0.0:1788361767.457316:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407095936 00000020:00000040:0.0:1788361767.457320:0:24840:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.457327:0:24840:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=20 00000100:00000040:0.0:1788361767.457366:0:24840:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.457469:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 656 00000100:00000040:0.0:1788361767.457482:0:24840:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.457502:0:24840:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429bb80 x1875230407095936/t0(4294968789) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.457519:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2408:x1875230407095936:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:0.0:1788361767.457533:0:24840:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429bb80 x1875230407095936/t0(4294968789) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.457544:0:24840:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968789, current: 4294968789, replaying 00010000:00000040:0.0:1788361767.457549:0:24840:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.457562:0:24840:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429bb80 x1875230407095936/t0(4294968789) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.457572:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+20:2408:x1875230407095936:12345-192.168.204.35@tcp:10:dd.0 Request processed in 56us (498us total) trans 0 rc 0/-999 00010000:00080000:3.0:1788361767.457573:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968789, next_transno: 4294968789 00010000:00080000:3.0:1788361767.457582:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968789) 00000100:00100000:0.0:1788361767.457600:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 656 00000100:00000040:0.0:1788361767.457605:0:24840:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.457610:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407095936 t4294968789 from 192.168.204.35@tcp req@ffff99d10429bb80 x1875230407095936/t0(4294968789) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.457631:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429bb80 x1875230407095936/t0(4294968789) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.457686:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x790:0x0] 00000001:00000040:3.0:1788361767.457922:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 16 00000020:00000040:3.0:1788361767.457926:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=21 00010000:00000040:3.0:1788361767.457971:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968789, xid 1875230407095936 00000100:00000040:3.0:1788361767.457984:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.457991:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.458045:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.458055:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.458061:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.458071:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 20 00010000:00080000:3.0:1788361767.458075:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968790 00010000:00080000:3.0:1788361767.458079:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968790 00000100:00000040:1.0:1788361767.462306:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429aa00 x1875230407097344 msgsize 440 00000100:00100000:1.0:1788361767.462328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.462434:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407097344 00000100:00100000:0.0:1788361767.462449:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407097344 00000020:00000040:0.0:1788361767.462453:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.462460:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=21 00000100:00000040:0.0:1788361767.462494:0:8444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.462559:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 657 00000100:00000040:0.0:1788361767.462566:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.462605:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429aa00 x1875230407097344/t0(4294968790) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.462625:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:2408:x1875230407097344:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:0.0:1788361767.462642:0:8444:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429aa00 x1875230407097344/t0(4294968790) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.462655:0:8444:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968790, current: 4294968790, replaying 00010000:00000040:0.0:1788361767.462659:0:8444:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.462679:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429aa00 x1875230407097344/t0(4294968790) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.462690:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+21:2408:x1875230407097344:12345-192.168.204.35@tcp:10:dd.0 Request processed in 70us (386us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.462699:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 657 00010000:00080000:3.0:1788361767.462701:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968790, next_transno: 4294968790 00000100:00000040:0.0:1788361767.462704:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.462706:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968790) 00010000:00080000:3.0:1788361767.462721:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407097344 t4294968790 from 192.168.204.35@tcp req@ffff99d10429aa00 x1875230407097344/t0(4294968790) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.462741:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429aa00 x1875230407097344/t0(4294968790) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.462780:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x791:0x0] 00000001:00000040:3.0:1788361767.463079:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 17 00000020:00000040:3.0:1788361767.463084:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=22 00010000:00000040:3.0:1788361767.463149:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968790, xid 1875230407097344 00000100:00000040:3.0:1788361767.463161:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.463168:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.463230:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.463241:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.463249:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.463269:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 21 00010000:00080000:3.0:1788361767.463275:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968791 00010000:00080000:3.0:1788361767.463279:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968791 00000100:00000040:1.0:1788361767.465091:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429b480 x1875230407098624 msgsize 440 00000100:00100000:1.0:1788361767.465112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.465152:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098624 00000100:00100000:2.0:1788361767.465164:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098624 00000020:00000040:2.0:1788361767.465168:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.465174:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=22 00000100:00000040:2.0:1788361767.465200:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.465254:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 658 00000100:00000040:2.0:1788361767.465258:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.465267:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429b480 x1875230407098624/t0(4294968791) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.465296:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2408:x1875230407098624:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:2.0:1788361767.465310:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429b480 x1875230407098624/t0(4294968791) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.465319:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968791, current: 4294968791, replaying 00010000:00000040:2.0:1788361767.465323:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.465391:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429b480 x1875230407098624/t0(4294968791) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.465401:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+22:2408:x1875230407098624:12345-192.168.204.35@tcp:10:dd.0 Request processed in 110us (312us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.465410:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 658 00000100:00000040:2.0:1788361767.465413:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.465443:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968791, next_transno: 4294968791 00010000:00080000:0.0:1788361767.465448:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968791) 00010000:00080000:0.0:1788361767.465457:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407098624 t4294968791 from 192.168.204.35@tcp req@ffff99d10429b480 x1875230407098624/t0(4294968791) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.465474:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429b480 x1875230407098624/t0(4294968791) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788361767.465505:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x792:0x0] 00000001:00000040:0.0:1788361767.465707:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 18 00000020:00000040:0.0:1788361767.465712:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=23 00010000:00000040:0.0:1788361767.465750:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968791, xid 1875230407098624 00000100:00000040:0.0:1788361767.465760:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.465765:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.465817:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.465910:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.465916:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.465928:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 22 00010000:00080000:0.0:1788361767.465933:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968792 00010000:00080000:0.0:1788361767.465937:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968792 00000100:00000040:1.0:1788361767.470974:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d104298e00 x1875230407098880 msgsize 440 00000100:00100000:1.0:1788361767.470997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.471782:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407098880 00000100:00100000:2.0:1788361767.471796:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407098880 00000020:00000040:2.0:1788361767.471800:0:24841:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.471807:0:24841:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=23 00000100:00000040:2.0:1788361767.471856:0:24841:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.471970:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 659 00000100:00000040:2.0:1788361767.471975:0:24841:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.472003:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104298e00 x1875230407098880/t0(4294968792) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.472021:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:2408:x1875230407098880:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:2.0:1788361767.472053:0:24841:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104298e00 x1875230407098880/t0(4294968792) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.472065:0:24841:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968792, current: 4294968792, replaying 00010000:00000040:2.0:1788361767.472077:0:24841:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.472095:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298e00 x1875230407098880/t0(4294968792) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.472106:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+23:2408:x1875230407098880:12345-192.168.204.35@tcp:10:dd.0 Request processed in 89us (1133us total) trans 0 rc 0/-999 00010000:00080000:1.0:1788361767.472134:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968792, next_transno: 4294968792 00010000:00080000:1.0:1788361767.472141:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968792) 00000100:00100000:2.0:1788361767.472144:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 659 00010000:00080000:1.0:1788361767.472155:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407098880 t4294968792 from 192.168.204.35@tcp req@ffff99d104298e00 x1875230407098880/t0(4294968792) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.472188:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104298e00 x1875230407098880/t0(4294968792) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788361767.472227:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x793:0x0] 00000100:00000040:2.0:1788361767.472390:0:24841:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00000001:00000040:1.0:1788361767.472478:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 19 00000020:00000040:1.0:1788361767.472483:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=24 00010000:00000040:1.0:1788361767.472525:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968792, xid 1875230407098880 00000100:00000040:1.0:1788361767.472543:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.472550:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.472634:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.472645:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.472651:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.472664:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 23 00010000:00080000:1.0:1788361767.472668:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968793 00010000:00080000:1.0:1788361767.472673:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968793 00000100:00000040:1.0:1788361767.477124:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d104298000 x1875230407099904 msgsize 440 00000100:00100000:1.0:1788361767.477151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.477245:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407099904 00000100:00100000:3.0:1788361767.477258:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407099904 00000020:00000040:3.0:1788361767.477263:0:24839:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.477269:0:24839:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=24 00000100:00000040:3.0:1788361767.477303:0:24839:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.477359:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 660 00000100:00000040:3.0:1788361767.477362:0:24839:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.477370:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104298000 x1875230407099904/t0(4294968793) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.477382:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+24:2408:x1875230407099904:12345-192.168.204.35@tcp:10:dd.0 00000020:00000040:3.0:1788361767.477395:0:24839:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104298000 x1875230407099904/t0(4294968793) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.477407:0:24839:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968793, current: 4294968793, replaying 00010000:00000040:3.0:1788361767.477411:0:24839:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.477471:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298000 x1875230407099904/t0(4294968793) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.477481:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+24:2408:x1875230407099904:12345-192.168.204.35@tcp:10:dd.0 Request processed in 101us (359us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.477489:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 660 00000100:00000040:3.0:1788361767.477493:0:24839:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.477527:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968793, next_transno: 4294968793 00010000:00080000:1.0:1788361767.477533:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968793) 00010000:00080000:1.0:1788361767.477542:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407099904 t4294968793 from 192.168.204.35@tcp req@ffff99d104298000 x1875230407099904/t0(4294968793) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.477561:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104298000 x1875230407099904/t0(4294968793) o10->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 440/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788361767.477613:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x795:0x0] 00000001:00000040:1.0:1788361767.477887:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 20 00000020:00000040:1.0:1788361767.477893:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=25 00010000:00000040:1.0:1788361767.477942:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968793, xid 1875230407099904 00000100:00000040:1.0:1788361767.477955:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.477962:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.478026:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.478038:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.478043:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.478056:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 24 00010000:00080000:1.0:1788361767.478060:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968794 00010000:00080000:1.0:1788361767.478065:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968794 00000100:00000040:1.0:1788361767.481356:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d104298700 x1875230407100288 msgsize 1512 00000100:00100000:1.0:1788361767.481374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.481457:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100288 00000100:00100000:0.0:1788361767.481470:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100288 00000020:00000040:0.0:1788361767.481475:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.481481:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=25 00000100:00000040:0.0:1788361767.481510:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.481686:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 661 00000100:00000040:0.0:1788361767.481691:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.481701:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d104298700 x1875230407100288/t0(4294968794) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.481718:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d104298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2408:x1875230407100288:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.481731:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104298700 x1875230407100288/t0(4294968794) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.481741:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968794, current: 4294968794, replaying 00010000:00000040:0.0:1788361767.481745:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.481765:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d104298700 x1875230407100288/t0(4294968794) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.481775:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d104298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+25:2408:x1875230407100288:12345-192.168.204.35@tcp:4:dd.0 Request processed in 62us (421us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.481781:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 661 00000100:00000040:0.0:1788361767.481783:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.481843:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968794, next_transno: 4294968794 00010000:00080000:3.0:1788361767.481850:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968794) 00010000:00080000:3.0:1788361767.481862:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407100288 t4294968794 from 192.168.204.35@tcp req@ffff99d104298700 x1875230407100288/t0(4294968794) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.481890:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d104298700 x1875230407100288/t0(4294968794) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788361767.481947:0:96787:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:3.0:1788361767.482101:0:96787:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:3.0:1788361767.482198:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788361767.482241:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:3.0:1788361767.482605:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 21 00000020:00000040:3.0:1788361767.482611:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=26 00010000:00000040:3.0:1788361767.483398:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968794, xid 1875230407100288 00000100:00000040:3.0:1788361767.483415:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.483424:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.483609:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.483626:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.483636:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.483649:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 25 00010000:00080000:3.0:1788361767.483655:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968795 00010000:00080000:3.0:1788361767.483661:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968795 00000100:00000040:1.0:1788361767.486676:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429a300 x1875230407100544 msgsize 1512 00000100:00100000:1.0:1788361767.486691:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.486758:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100544 00000100:00100000:0.0:1788361767.486780:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100544 00000020:00000040:0.0:1788361767.486793:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.486802:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=26 00000100:00000040:0.0:1788361767.486854:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.486921:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 662 00000100:00000040:0.0:1788361767.486928:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.486938:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429a300 x1875230407100544/t0(4294968795) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.486956:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2408:x1875230407100544:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.486970:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429a300 x1875230407100544/t0(4294968795) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.486981:0:24842:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968795, current: 4294968795, replaying 00010000:00000040:0.0:1788361767.486986:0:24842:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.487006:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429a300 x1875230407100544/t0(4294968795) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.487016:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+26:2408:x1875230407100544:12345-192.168.204.35@tcp:4:dd.0 Request processed in 65us (341us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.487025:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 662 00000100:00000040:0.0:1788361767.487029:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.487381:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968795, next_transno: 4294968795 00010000:00080000:1.0:1788361767.487387:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968795) 00010000:00080000:1.0:1788361767.487403:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407100544 t4294968795 from 192.168.204.35@tcp req@ffff99d10429a300 x1875230407100544/t0(4294968795) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.487456:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429a300 x1875230407100544/t0(4294968795) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.487581:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.487637:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.487953:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 22 00000020:00000040:1.0:1788361767.487958:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=27 00010000:00000040:1.0:1788361767.488435:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968795, xid 1875230407100544 00000100:00000040:1.0:1788361767.488449:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.488457:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.488518:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.488529:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.488539:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.488549:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 26 00010000:00080000:1.0:1788361767.488552:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968796 00010000:00080000:1.0:1788361767.488557:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968796 00000100:00000040:1.0:1788361767.490447:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d10429ad80 x1875230407100800 msgsize 1512 00000100:00100000:1.0:1788361767.490461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.490538:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407100800 00000100:00100000:3.0:1788361767.490547:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407100800 00000020:00000040:3.0:1788361767.490550:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.490562:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=27 00000100:00000040:3.0:1788361767.490581:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.490658:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 663 00000100:00000040:3.0:1788361767.490662:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.490781:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d10429ad80 x1875230407100800/t0(4294968796) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.490793:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10429ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2408:x1875230407100800:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:3.0:1788361767.490816:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429ad80 x1875230407100800/t0(4294968796) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.490901:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968796, current: 4294968796, replaying 00010000:00000040:3.0:1788361767.490905:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.490924:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d10429ad80 x1875230407100800/t0(4294968796) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.490933:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10429ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f1e400d1-472b-42d1-b5e7-e80dc701272a+27:2408:x1875230407100800:12345-192.168.204.35@tcp:4:dd.0 Request processed in 143us (486us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.490940:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 663 00000100:00000040:3.0:1788361767.490944:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.490982:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968796, next_transno: 4294968796 00010000:00080000:1.0:1788361767.490986:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968796) 00010000:00080000:1.0:1788361767.490993:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407100800 t4294968796 from 192.168.204.35@tcp req@ffff99d10429ad80 x1875230407100800/t0(4294968796) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.491009:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d10429ad80 x1875230407100800/t0(4294968796) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.491089:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.491117:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.491347:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 23 00000020:00000040:1.0:1788361767.491350:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=28 00010000:00000040:1.0:1788361767.491555:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968796, xid 1875230407100800 00000100:00000040:1.0:1788361767.491565:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.491572:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.491647:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.491659:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:1.0:1788361767.491667:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.491681:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 27 00010000:00080000:1.0:1788361767.491685:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968797 00010000:00080000:1.0:1788361767.491690:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968797 00000100:00000040:1.0:1788361767.493875:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d137c93480 x1875230407101056 msgsize 1512 00000100:00100000:1.0:1788361767.493938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.493978:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101056 00000100:00100000:3.0:1788361767.493989:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101056 00000020:00000040:3.0:1788361767.493992:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.493997:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=28 00000100:00000040:3.0:1788361767.494024:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.494068:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 664 00000100:00000040:3.0:1788361767.494073:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.494082:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137c93480 x1875230407101056/t0(4294968797) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.494098:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:2408:x1875230407101056:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:3.0:1788361767.494110:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c93480 x1875230407101056/t0(4294968797) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.494119:0:8445:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968797, current: 4294968797, replaying 00010000:00000040:3.0:1788361767.494122:0:8445:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.494142:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137c93480 x1875230407101056/t0(4294968797) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.494160:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+28:2408:x1875230407101056:12345-192.168.204.35@tcp:4:dd.0 Request processed in 65us (284us total) trans 0 rc 0/-999 00010000:00080000:1.0:1788361767.494164:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968797, next_transno: 4294968797 00000100:00100000:3.0:1788361767.494170:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 664 00010000:00080000:1.0:1788361767.494172:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968797) 00000100:00000040:3.0:1788361767.494175:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.494184:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407101056 t4294968797 from 192.168.204.35@tcp req@ffff99d137c93480 x1875230407101056/t0(4294968797) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.494201:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c93480 x1875230407101056/t0(4294968797) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.494356:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.494385:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.494687:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 24 00000020:00000040:1.0:1788361767.494691:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=29 00010000:00000040:1.0:1788361767.495034:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968797, xid 1875230407101056 00000100:00000040:1.0:1788361767.495044:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.495122:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.495165:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.495389:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.495404:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.495416:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 28 00010000:00080000:1.0:1788361767.495421:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968798 00010000:00080000:1.0:1788361767.495425:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968798 00000100:00000040:3.0:1788361767.497395:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054ad80 x1875230407101312 msgsize 1512 00000100:00100000:3.0:1788361767.497406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.497496:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101312 00000100:00100000:0.0:1788361767.497505:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101312 00000020:00000040:0.0:1788361767.497508:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.497513:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=29 00000100:00000040:0.0:1788361767.497532:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.497626:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 665 00000100:00000040:0.0:1788361767.497631:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.497638:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054ad80 x1875230407101312/t0(4294968798) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.497680:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2408:x1875230407101312:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.497693:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054ad80 x1875230407101312/t0(4294968798) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.497702:0:24837:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968798, current: 4294968798, replaying 00010000:00000040:0.0:1788361767.497705:0:24837:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.497718:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054ad80 x1875230407101312/t0(4294968798) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.497727:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+29:2408:x1875230407101312:12345-192.168.204.35@tcp:4:dd.0 Request processed in 64us (332us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.497735:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 665 00000100:00000040:0.0:1788361767.497739:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.497740:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968798, next_transno: 4294968798 00010000:00080000:1.0:1788361767.497746:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968798) 00010000:00080000:1.0:1788361767.497756:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407101312 t4294968798 from 192.168.204.35@tcp req@ffff99d11054ad80 x1875230407101312/t0(4294968798) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.497771:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054ad80 x1875230407101312/t0(4294968798) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.497976:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.498010:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.498329:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 25 00000020:00000040:1.0:1788361767.498335:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=30 00010000:00000040:3.0:1788361767.499314:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968798, xid 1875230407101312 00000100:00000040:3.0:1788361767.499330:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.499337:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.499455:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.499468:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.499477:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.499489:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 29 00010000:00080000:3.0:1788361767.499494:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968799 00010000:00080000:3.0:1788361767.499498:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968799 00000100:00000040:3.0:1788361767.502435:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d110548000 x1875230407101568 msgsize 1512 00000100:00100000:3.0:1788361767.502451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.502858:0:24840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101568 00000100:00100000:0.0:1788361767.502871:0:24840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101568 00000020:00000040:0.0:1788361767.502874:0:24840:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.502880:0:24840:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=30 00000100:00000040:0.0:1788361767.502909:0:24840:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.502963:0:24840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 666 00000100:00000040:0.0:1788361767.502969:0:24840:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.502978:0:24840:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110548000 x1875230407101568/t0(4294968799) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.502994:0:24840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2408:x1875230407101568:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.503006:0:24840:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548000 x1875230407101568/t0(4294968799) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.503017:0:24840:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968799, current: 4294968799, replaying 00010000:00000040:0.0:1788361767.503029:0:24840:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.503038:0:24840:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548000 x1875230407101568/t0(4294968799) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.503048:0:24840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+30:2408:x1875230407101568:12345-192.168.204.35@tcp:4:dd.0 Request processed in 57us (614us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.503056:0:24840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 666 00000100:00000040:0.0:1788361767.503059:0:24840:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.503160:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968799, next_transno: 4294968799 00010000:00080000:3.0:1788361767.503165:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968799) 00010000:00080000:3.0:1788361767.503186:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407101568 t4294968799 from 192.168.204.35@tcp req@ffff99d110548000 x1875230407101568/t0(4294968799) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.503203:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548000 x1875230407101568/t0(4294968799) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.503311:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788361767.503346:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:3.0:1788361767.503623:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 26 00000020:00000040:3.0:1788361767.503628:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=31 00010000:00000040:3.0:1788361767.504438:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968799, xid 1875230407101568 00000100:00000040:3.0:1788361767.504451:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.504458:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.504543:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.504554:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.504562:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.504574:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 30 00010000:00080000:3.0:1788361767.504579:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968800 00010000:00080000:3.0:1788361767.504583:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968800 00000100:00000040:0.0:1788361767.506642:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e9500 x1875230407101824 msgsize 1512 00000100:00100000:0.0:1788361767.506658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.506734:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407101824 00000100:00100000:2.0:1788361767.506743:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407101824 00000020:00000040:2.0:1788361767.506746:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.506751:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=31 00000100:00000040:2.0:1788361767.506774:0:8444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.506880:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 667 00000100:00000040:2.0:1788361767.506884:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.506891:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e9500 x1875230407101824/t0(4294968800) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.506905:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+31:2408:x1875230407101824:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:2.0:1788361767.506916:0:8444:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e9500 x1875230407101824/t0(4294968800) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.506925:0:8444:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968800, current: 4294968800, replaying 00010000:00000040:2.0:1788361767.506928:0:8444:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.506939:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9500 x1875230407101824/t0(4294968800) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.506948:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+31:2408:x1875230407101824:12345-192.168.204.35@tcp:4:dd.0 Request processed in 46us (306us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.506955:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 667 00000100:00000040:2.0:1788361767.506968:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.507995:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968800, next_transno: 4294968800 00010000:00080000:3.0:1788361767.508002:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968800) 00010000:00080000:3.0:1788361767.508013:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407101824 t4294968800 from 192.168.204.35@tcp req@ffff99d1185e9500 x1875230407101824/t0(4294968800) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.508032:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e9500 x1875230407101824/t0(4294968800) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.508131:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788361767.508166:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:3.0:1788361767.508414:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 27 00000020:00000040:3.0:1788361767.508418:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=32 00010000:00000040:2.0:1788361767.508962:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968800, xid 1875230407101824 00000100:00000040:2.0:1788361767.508975:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.508983:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:2.0:1788361767.509038:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:2.0:1788361767.509050:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788361767.509058:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:2.0:1788361767.509071:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 31 00010000:00080000:2.0:1788361767.509076:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968801 00010000:00080000:2.0:1788361767.509080:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968801 00000100:00000040:1.0:1788361767.511600:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d137c90000 x1875230407102080 msgsize 1512 00000100:00100000:1.0:1788361767.511610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.511899:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102080 00000100:00100000:0.0:1788361767.511909:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102080 00000020:00000040:0.0:1788361767.511912:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.511917:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=32 00000100:00000040:0.0:1788361767.511939:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.511985:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 668 00000100:00000040:0.0:1788361767.511989:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.511997:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137c90000 x1875230407102080/t0(4294968801) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.512011:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:2408:x1875230407102080:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.512021:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c90000 x1875230407102080/t0(4294968801) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.512031:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968801, current: 4294968801, replaying 00010000:00000040:0.0:1788361767.512035:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.512045:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137c90000 x1875230407102080/t0(4294968801) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.512054:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+32:2408:x1875230407102080:12345-192.168.204.35@tcp:4:dd.0 Request processed in 46us (454us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.512069:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 668 00000100:00000040:0.0:1788361767.512072:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:2.0:1788361767.512130:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968801, next_transno: 4294968801 00010000:00080000:2.0:1788361767.512136:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968801) 00010000:00080000:2.0:1788361767.512145:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407102080 t4294968801 from 192.168.204.35@tcp req@ffff99d137c90000 x1875230407102080/t0(4294968801) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788361767.512162:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c90000 x1875230407102080/t0(4294968801) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788361767.512307:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788361767.512340:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:2.0:1788361767.512600:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 28 00000020:00000040:2.0:1788361767.512605:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=33 00010000:00000040:2.0:1788361767.512951:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968801, xid 1875230407102080 00000100:00000040:2.0:1788361767.512963:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.512970:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:2.0:1788361767.513023:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:2.0:1788361767.513034:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788361767.513043:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:2.0:1788361767.513056:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 32 00010000:00080000:2.0:1788361767.513060:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968802 00010000:00080000:2.0:1788361767.513071:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968802 00000100:00000040:3.0:1788361767.515354:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d110549880 x1875230407102336 msgsize 1512 00000100:00100000:3.0:1788361767.515369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.515527:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102336 00000100:00100000:2.0:1788361767.515538:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102336 00000020:00000040:2.0:1788361767.515542:0:24841:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.515547:0:24841:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=33 00000100:00000040:2.0:1788361767.515595:0:24841:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.515642:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 669 00000100:00000040:2.0:1788361767.515646:0:24841:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.515655:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110549880 x1875230407102336/t0(4294968802) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.515669:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:2408:x1875230407102336:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:2.0:1788361767.515682:0:24841:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110549880 x1875230407102336/t0(4294968802) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.515691:0:24841:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968802, current: 4294968802, replaying 00010000:00000040:2.0:1788361767.515694:0:24841:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.515719:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110549880 x1875230407102336/t0(4294968802) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.515729:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+33:2408:x1875230407102336:12345-192.168.204.35@tcp:4:dd.0 Request processed in 63us (376us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.515736:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 669 00000100:00000040:2.0:1788361767.515738:0:24841:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.516082:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968802, next_transno: 4294968802 00010000:00080000:1.0:1788361767.516087:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968802) 00010000:00080000:1.0:1788361767.516095:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407102336 t4294968802 from 192.168.204.35@tcp req@ffff99d110549880 x1875230407102336/t0(4294968802) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.516113:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110549880 x1875230407102336/t0(4294968802) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.516276:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.516308:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.516566:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 29 00000020:00000040:1.0:1788361767.516571:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=34 00010000:00000040:1.0:1788361767.517459:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968802, xid 1875230407102336 00000100:00000040:1.0:1788361767.517475:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.517482:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.517531:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.517542:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.517551:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.517574:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 33 00010000:00080000:1.0:1788361767.517579:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968803 00010000:00080000:1.0:1788361767.517594:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968803 00000100:00000040:3.0:1788361767.519425:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d110548a80 x1875230407102592 msgsize 1512 00000100:00100000:3.0:1788361767.519444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.519894:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102592 00000100:00100000:1.0:1788361767.519905:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102592 00000020:00000040:1.0:1788361767.519909:0:24839:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.519915:0:24839:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=34 00000100:00000040:1.0:1788361767.519941:0:24839:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.520003:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 670 00000100:00000040:1.0:1788361767.520008:0:24839:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.520017:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110548a80 x1875230407102592/t0(4294968803) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.520033:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2408:x1875230407102592:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:1.0:1788361767.520045:0:24839:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548a80 x1875230407102592/t0(4294968803) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.520066:0:24839:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968803, current: 4294968803, replaying 00010000:00000040:1.0:1788361767.520071:0:24839:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.520091:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548a80 x1875230407102592/t0(4294968803) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.520101:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+34:2408:x1875230407102592:12345-192.168.204.35@tcp:4:dd.0 Request processed in 71us (678us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.520120:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 670 00000100:00000040:1.0:1788361767.520123:0:24839:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.520385:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968803, next_transno: 4294968803 00010000:00080000:3.0:1788361767.520391:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968803) 00010000:00080000:3.0:1788361767.520406:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407102592 t4294968803 from 192.168.204.35@tcp req@ffff99d110548a80 x1875230407102592/t0(4294968803) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.520423:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548a80 x1875230407102592/t0(4294968803) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788361767.520522:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788361767.520620:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:3.0:1788361767.522995:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 30 00000020:00000040:3.0:1788361767.523005:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=35 00010000:00000040:3.0:1788361767.523476:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968803, xid 1875230407102592 00000100:00000040:3.0:1788361767.523491:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:3.0:1788361767.523497:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:3.0:1788361767.523542:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:3.0:1788361767.523552:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788361767.523559:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:3.0:1788361767.523569:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 34 00010000:00080000:3.0:1788361767.523573:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968804 00010000:00080000:3.0:1788361767.523577:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968804 00000100:00000040:2.0:1788361767.526661:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef3100 x1875230407102848 msgsize 1512 00000100:00100000:2.0:1788361767.526690:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.526914:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407102848 00000100:00100000:0.0:1788361767.526926:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407102848 00000020:00000040:0.0:1788361767.526930:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.526935:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=35 00000100:00000040:0.0:1788361767.526958:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.527011:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 671 00000100:00000040:0.0:1788361767.527015:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.527023:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef3100 x1875230407102848/t0(4294968804) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.527036:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:2408:x1875230407102848:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.527048:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef3100 x1875230407102848/t0(4294968804) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.527057:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968804, current: 4294968804, replaying 00010000:00000040:0.0:1788361767.527060:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.527077:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef3100 x1875230407102848/t0(4294968804) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.527086:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+35:2408:x1875230407102848:12345-192.168.204.35@tcp:4:dd.0 Request processed in 52us (425us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.527092:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 671 00000100:00000040:0.0:1788361767.527096:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:2.0:1788361767.527777:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968804, next_transno: 4294968804 00010000:00080000:2.0:1788361767.527785:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968804) 00010000:00080000:2.0:1788361767.527796:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407102848 t4294968804 from 192.168.204.35@tcp req@ffff99d136ef3100 x1875230407102848/t0(4294968804) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788361767.527866:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d136ef3100 x1875230407102848/t0(4294968804) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788361767.528109:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788361767.528143:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:2.0:1788361767.528432:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 31 00000020:00000040:2.0:1788361767.528436:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=36 00010000:00000040:2.0:1788361767.528972:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968804, xid 1875230407102848 00000100:00000040:2.0:1788361767.528985:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.528993:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:2.0:1788361767.529046:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:2.0:1788361767.529058:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788361767.529068:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:2.0:1788361767.529082:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 35 00010000:00080000:2.0:1788361767.529086:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968805 00010000:00080000:2.0:1788361767.529091:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968805 00000100:00000040:0.0:1788361767.530974:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e9880 x1875230407103104 msgsize 1512 00000100:00100000:0.0:1788361767.530985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.531030:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103104 00000100:00100000:1.0:1788361767.531040:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103104 00000020:00000040:1.0:1788361767.531044:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.531049:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=36 00000100:00000040:1.0:1788361767.531070:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.531118:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 672 00000100:00000040:1.0:1788361767.531124:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.531133:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e9880 x1875230407103104/t0(4294968805) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.531149:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:2408:x1875230407103104:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:1.0:1788361767.531161:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e9880 x1875230407103104/t0(4294968805) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.531184:0:24842:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968805, current: 4294968805, replaying 00010000:00000040:1.0:1788361767.531194:0:24842:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.531213:0:24842:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9880 x1875230407103104/t0(4294968805) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.531222:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+36:2408:x1875230407103104:12345-192.168.204.35@tcp:4:dd.0 Request processed in 76us (248us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.531228:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 672 00000100:00000040:1.0:1788361767.531231:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.531455:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968805, next_transno: 4294968805 00010000:00080000:0.0:1788361767.531467:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968805) 00010000:00080000:0.0:1788361767.531476:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407103104 t4294968805 from 192.168.204.35@tcp req@ffff99d1185e9880 x1875230407103104/t0(4294968805) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.531494:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e9880 x1875230407103104/t0(4294968805) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.531597:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788361767.531628:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:0.0:1788361767.532026:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 32 00000020:00000040:0.0:1788361767.532031:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=37 00010000:00000040:0.0:1788361767.532966:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968805, xid 1875230407103104 00000100:00000040:0.0:1788361767.532981:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.532989:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.533047:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.533063:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.533073:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.533085:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 36 00010000:00080000:0.0:1788361767.533091:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968806 00010000:00080000:0.0:1788361767.533096:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968806 00000100:00000040:3.0:1788361767.534490:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054b480 x1875230407103360 msgsize 1512 00000100:00100000:3.0:1788361767.534503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.534601:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103360 00000100:00100000:2.0:1788361767.534611:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103360 00000020:00000040:2.0:1788361767.534614:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.534618:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=37 00000100:00000040:2.0:1788361767.534641:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.534698:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 673 00000100:00000040:2.0:1788361767.534703:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.534711:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054b480 x1875230407103360/t0(4294968806) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.534725:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+37:2408:x1875230407103360:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:2.0:1788361767.534738:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054b480 x1875230407103360/t0(4294968806) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.534755:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968806, current: 4294968806, replaying 00010000:00000040:2.0:1788361767.534759:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.534776:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054b480 x1875230407103360/t0(4294968806) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.534786:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+37:2408:x1875230407103360:12345-192.168.204.35@tcp:4:dd.0 Request processed in 64us (296us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.534794:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 673 00000100:00000040:2.0:1788361767.534797:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:3.0:1788361767.534817:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968806, next_transno: 4294968806 00010000:00080000:3.0:1788361767.534850:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968806) 00010000:00080000:3.0:1788361767.534861:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407103360 t4294968806 from 192.168.204.35@tcp req@ffff99d11054b480 x1875230407103360/t0(4294968806) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788361767.534906:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054b480 x1875230407103360/t0(4294968806) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788361767.534996:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788361767.535025:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:2.0:1788361767.535281:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 33 00000020:00000040:2.0:1788361767.535285:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=38 00010000:00000040:2.0:1788361767.535490:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968806, xid 1875230407103360 00000100:00000040:2.0:1788361767.535501:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:2.0:1788361767.535506:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:2.0:1788361767.535550:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:2.0:1788361767.535558:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788361767.535564:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:2.0:1788361767.535593:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 37 00010000:00080000:2.0:1788361767.535598:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968807 00010000:00080000:2.0:1788361767.535602:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968807 00000100:00000040:3.0:1788361767.537197:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d110548380 x1875230407103616 msgsize 1512 00000100:00100000:3.0:1788361767.537209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.537370:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103616 00000100:00100000:0.0:1788361767.537380:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103616 00000020:00000040:0.0:1788361767.537384:0:24841:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.537389:0:24841:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=38 00000100:00000040:0.0:1788361767.537410:0:24841:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.537448:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 674 00000100:00000040:0.0:1788361767.537451:0:24841:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.537456:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110548380 x1875230407103616/t0(4294968807) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.537466:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2408:x1875230407103616:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.537480:0:24841:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548380 x1875230407103616/t0(4294968807) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.537485:0:24841:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968807, current: 4294968807, replaying 00010000:00000040:0.0:1788361767.537488:0:24841:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.537507:0:24841:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548380 x1875230407103616/t0(4294968807) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.537516:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+38:2408:x1875230407103616:12345-192.168.204.35@tcp:4:dd.0 Request processed in 51us (318us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.537524:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 674 00000100:00000040:0.0:1788361767.537526:0:24841:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.537529:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968807, next_transno: 4294968807 00010000:00080000:1.0:1788361767.537535:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968807) 00010000:00080000:1.0:1788361767.537547:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407103616 t4294968807 from 192.168.204.35@tcp req@ffff99d110548380 x1875230407103616/t0(4294968807) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.537570:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548380 x1875230407103616/t0(4294968807) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.537664:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.537708:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.538004:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 34 00000020:00000040:1.0:1788361767.538009:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=39 00010000:00000040:1.0:1788361767.538636:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968807, xid 1875230407103616 00000100:00000040:1.0:1788361767.538649:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.538655:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.538702:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.538713:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.538721:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.538730:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 38 00010000:00080000:1.0:1788361767.538734:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968808 00010000:00080000:1.0:1788361767.538738:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968808 00000100:00000040:0.0:1788361767.540892:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e9c00 x1875230407103872 msgsize 1512 00000100:00100000:0.0:1788361767.540903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.540947:0:24839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407103872 00000100:00100000:3.0:1788361767.540960:0:24839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407103872 00000020:00000040:3.0:1788361767.540970:0:24839:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.540976:0:24839:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=39 00000100:00000040:3.0:1788361767.540999:0:24839:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788361767.541052:0:24839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 675 00000100:00000040:3.0:1788361767.541056:0:24839:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.541064:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e9c00 x1875230407103872/t0(4294968808) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.541077:0:24839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2408:x1875230407103872:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:3.0:1788361767.541100:0:24839:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e9c00 x1875230407103872/t0(4294968808) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788361767.541109:0:24839:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968808, current: 4294968808, replaying 00010000:00000040:3.0:1788361767.541113:0:24839:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.541124:0:24839:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9c00 x1875230407103872/t0(4294968808) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361767.541133:0:24839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+39:2408:x1875230407103872:12345-192.168.204.35@tcp:4:dd.0 Request processed in 58us (241us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788361767.541139:0:24839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 675 00000100:00000040:3.0:1788361767.541143:0:24839:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.541148:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968808, next_transno: 4294968808 00010000:00080000:1.0:1788361767.541154:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968808) 00010000:00080000:1.0:1788361767.541164:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407103872 t4294968808 from 192.168.204.35@tcp req@ffff99d1185e9c00 x1875230407103872/t0(4294968808) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.541182:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185e9c00 x1875230407103872/t0(4294968808) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.541269:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.541305:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.541570:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 35 00000020:00000040:1.0:1788361767.541575:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=40 00010000:00000040:1.0:1788361767.541979:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968808, xid 1875230407103872 00000100:00000040:1.0:1788361767.541999:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.542006:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.542049:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.542064:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.542072:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.542086:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 39 00010000:00080000:1.0:1788361767.542091:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968809 00010000:00080000:1.0:1788361767.542095:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968809 00000100:00000040:0.0:1788361767.544017:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185ea300 x1875230407104128 msgsize 1512 00000100:00100000:0.0:1788361767.544032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.544448:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104128 00000100:00100000:1.0:1788361767.544458:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104128 00000020:00000040:1.0:1788361767.544462:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.544467:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=40 00000100:00000040:1.0:1788361767.544492:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.544539:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 676 00000100:00000040:1.0:1788361767.544544:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.544552:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185ea300 x1875230407104128/t0(4294968809) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.544566:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:2408:x1875230407104128:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:1.0:1788361767.544577:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185ea300 x1875230407104128/t0(4294968809) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.544602:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968809, current: 4294968809, replaying 00010000:00000040:1.0:1788361767.544606:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.544619:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185ea300 x1875230407104128/t0(4294968809) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.544628:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f1e400d1-472b-42d1-b5e7-e80dc701272a+40:2408:x1875230407104128:12345-192.168.204.35@tcp:4:dd.0 Request processed in 65us (610us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.544635:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 676 00000100:00000040:1.0:1788361767.544644:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.544663:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968809, next_transno: 4294968809 00010000:00080000:1.0:1788361767.544677:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968809) 00010000:00080000:1.0:1788361767.544685:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407104128 t4294968809 from 192.168.204.35@tcp req@ffff99d1185ea300 x1875230407104128/t0(4294968809) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.544701:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1185ea300 x1875230407104128/t0(4294968809) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.544793:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.544841:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.545171:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 36 00000020:00000040:1.0:1788361767.545176:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=41 00010000:00000040:0.0:1788361767.545514:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968809, xid 1875230407104128 00000100:00000040:0.0:1788361767.545527:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.545532:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.545618:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.545630:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.545635:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.545647:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 40 00010000:00080000:0.0:1788361767.545651:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968810 00010000:00080000:0.0:1788361767.545656:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968810 00000100:00000040:3.0:1788361767.547334:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d110549c00 x1875230407104384 msgsize 1512 00000100:00100000:3.0:1788361767.547351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788361767.547407:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104384 00000100:00100000:2.0:1788361767.547420:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104384 00000020:00000040:2.0:1788361767.547424:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:2.0:1788361767.547437:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=41 00000100:00000040:2.0:1788361767.547464:0:8444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.547525:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 677 00000100:00000040:2.0:1788361767.547530:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.547542:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110549c00 x1875230407104384/t0(4294968810) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.547560:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:2408:x1875230407104384:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:2.0:1788361767.547576:0:8444:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110549c00 x1875230407104384/t0(4294968810) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.547604:0:8444:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968810, current: 4294968810, replaying 00010000:00000040:2.0:1788361767.547608:0:8444:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.547626:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110549c00 x1875230407104384/t0(4294968810) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.547636:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f1e400d1-472b-42d1-b5e7-e80dc701272a+41:2408:x1875230407104384:12345-192.168.204.35@tcp:4:dd.0 Request processed in 79us (302us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.547644:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 677 00000100:00000040:2.0:1788361767.547648:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.547651:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968810, next_transno: 4294968810 00010000:00080000:1.0:1788361767.547657:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968810) 00010000:00080000:1.0:1788361767.547675:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407104384 t4294968810 from 192.168.204.35@tcp req@ffff99d110549c00 x1875230407104384/t0(4294968810) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.547696:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110549c00 x1875230407104384/t0(4294968810) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.547815:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.547928:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.548225:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 37 00000020:00000040:1.0:1788361767.548229:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=42 00010000:00000040:1.0:1788361767.548900:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968810, xid 1875230407104384 00000100:00000040:1.0:1788361767.548915:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.548923:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.548983:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.548995:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.549004:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.549022:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 41 00010000:00080000:1.0:1788361767.549028:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968811 00010000:00080000:1.0:1788361767.549033:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968811 00000100:00000040:1.0:1788361767.552688:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d137c91f80 x1875230407104640 msgsize 1512 00000100:00100000:1.0:1788361767.552702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361767.552734:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104640 00000100:00100000:3.0:1788361767.552744:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104640 00000020:00000040:3.0:1788361767.552747:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.552752:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=42 00000100:00000040:3.0:1788361767.552773:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788361767.552877:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 678 00000100:00000040:2.0:1788361767.552883:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:2.0:1788361767.552891:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137c91f80 x1875230407104640/t0(4294968811) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.552906:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:2408:x1875230407104640:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:2.0:1788361767.552917:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c91f80 x1875230407104640/t0(4294968811) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788361767.552927:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968811, current: 4294968811, replaying 00010000:00000040:2.0:1788361767.552951:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:2.0:1788361767.552966:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137c91f80 x1875230407104640/t0(4294968811) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788361767.552975:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f1e400d1-472b-42d1-b5e7-e80dc701272a+42:2408:x1875230407104640:12345-192.168.204.35@tcp:4:dd.0 Request processed in 73us (288us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788361767.552985:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 678 00010000:00080000:1.0:1788361767.552988:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968811, next_transno: 4294968811 00000100:00000040:2.0:1788361767.552990:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.552994:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968811) 00010000:00080000:1.0:1788361767.553006:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407104640 t4294968811 from 192.168.204.35@tcp req@ffff99d137c91f80 x1875230407104640/t0(4294968811) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.553024:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c91f80 x1875230407104640/t0(4294968811) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.553108:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.553137:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.553377:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 38 00000020:00000040:1.0:1788361767.553380:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=43 00010000:00000040:1.0:1788361767.553747:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968811, xid 1875230407104640 00000100:00000040:1.0:1788361767.553758:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.553764:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.553847:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.553857:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.553865:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.553877:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 42 00010000:00080000:1.0:1788361767.553882:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968812 00010000:00080000:1.0:1788361767.553886:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968812 00000100:00000040:3.0:1788361767.555216:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054bb80 x1875230407104896 msgsize 1512 00000100:00100000:3.0:1788361767.555238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.555350:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407104896 00000100:00100000:1.0:1788361767.555357:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407104896 00000020:00000040:1.0:1788361767.555360:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.555364:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=43 00000100:00000040:1.0:1788361767.555390:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788361767.555429:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 679 00000100:00000040:1.0:1788361767.555433:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:1.0:1788361767.555439:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054bb80 x1875230407104896/t0(4294968812) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.555452:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:2408:x1875230407104896:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:1.0:1788361767.555461:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054bb80 x1875230407104896/t0(4294968812) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788361767.555469:0:8445:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968812, current: 4294968812, replaying 00010000:00000040:1.0:1788361767.555471:0:8445:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:1.0:1788361767.555484:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054bb80 x1875230407104896/t0(4294968812) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361767.555492:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e400d1-472b-42d1-b5e7-e80dc701272a+43:2408:x1875230407104896:12345-192.168.204.35@tcp:4:dd.0 Request processed in 42us (275us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.555499:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 679 00000100:00000040:1.0:1788361767.555502:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:0.0:1788361767.555510:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968812, next_transno: 4294968812 00010000:00080000:0.0:1788361767.555516:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968812) 00010000:00080000:0.0:1788361767.555525:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407104896 t4294968812 from 192.168.204.35@tcp req@ffff99d11054bb80 x1875230407104896/t0(4294968812) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.555546:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054bb80 x1875230407104896/t0(4294968812) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788361767.555631:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788361767.555656:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:0.0:1788361767.555881:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 39 00000020:00000040:0.0:1788361767.555885:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=44 00010000:00000040:0.0:1788361767.556071:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968812, xid 1875230407104896 00000100:00000040:0.0:1788361767.556081:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:0.0:1788361767.556086:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:0.0:1788361767.556129:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:0.0:1788361767.556138:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788361767.556144:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:0.0:1788361767.556152:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 43 00010000:00080000:0.0:1788361767.556156:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968813 00010000:00080000:0.0:1788361767.556160:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968813 00000100:00000040:3.0:1788361767.557144:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054b100 x1875230407105152 msgsize 1512 00000100:00100000:3.0:1788361767.557210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.557275:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407105152 00000100:00100000:0.0:1788361767.557282:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407105152 00000020:00000040:0.0:1788361767.557284:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.557288:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=44 00000100:00000040:0.0:1788361767.557303:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788361767.557338:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 680 00000100:00000040:0.0:1788361767.557340:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:0.0:1788361767.557345:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054b100 x1875230407105152/t0(4294968813) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.557355:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:2408:x1875230407105152:12345-192.168.204.35@tcp:4:dd.0 00000020:00000040:0.0:1788361767.557362:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054b100 x1875230407105152/t0(4294968813) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788361767.557375:0:24837:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968813, current: 4294968813, replaying 00010000:00000040:0.0:1788361767.557378:0:24837:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:0.0:1788361767.557392:0:24837:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054b100 x1875230407105152/t0(4294968813) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361767.557401:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+44:2408:x1875230407105152:12345-192.168.204.35@tcp:4:dd.0 Request processed in 48us (257us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.557410:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 680 00010000:00080000:1.0:1788361767.557413:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968813, next_transno: 4294968813 00000100:00000040:0.0:1788361767.557414:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00010000:00080000:1.0:1788361767.557419:0:96787:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968813) 00010000:00080000:1.0:1788361767.557429:0:96787:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875230407105152 t4294968813 from 192.168.204.35@tcp req@ffff99d11054b100 x1875230407105152/t0(4294968813) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.557446:0:96787:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054b100 x1875230407105152/t0(4294968813) o4->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 1512/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788361767.557510:0:96787:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788361767.557533:0:96787:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 387 MB/s 00000001:00000040:1.0:1788361767.557730:0:96787:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99d136e1b800 : new cb_count 40 00000020:00000040:1.0:1788361767.557739:0:96787:0:(genops.c:889:class_export_get()) GET export ffff99d136e1b800 refcount=45 00010000:00000040:1.0:1788361767.557990:0:96787:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968773, transno 4294968813, xid 1875230407105152 00000100:00000040:1.0:1788361767.557998:0:96787:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d002f2b600 refcount 11 to 192.168.204.35@tcp 00000100:00000040:1.0:1788361767.558003:0:96787:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.35@tcp 00000100:00000040:1.0:1788361767.558049:0:96787:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d002f2b600 refcount 10 to 192.168.204.35@tcp 00010000:00080000:1.0:1788361767.558058:0:96787:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788361767.558063:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:1.0:1788361767.558071:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 44 00010000:00080000:1.0:1788361767.558074:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968814 00010000:00080000:1.0:1788361767.558078:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968814 00000100:00000040:1.0:1788361767.560199:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff99d137c92680 x1875230407107072 msgsize 328 00000100:00100000:1.0:1788361767.560212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.560353:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107072 00000100:00100000:0.0:1788361767.560363:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107072 00000020:00000040:0.0:1788361767.560366:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.560371:0:26167:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=45 00000100:00100000:0.0:1788361767.560422:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5014 00000100:00000040:0.0:1788361767.560427:0:26167:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 1 00000100:00000040:3.0:1788361767.560429:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054a680 x1875230407107200 msgsize 328 00000100:00100000:3.0:1788361767.560435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00000040:0.0:1788361767.560436:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d137c92680 x1875230407107072/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.560458:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d137c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+45:2408:x1875230407107072:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1788361767.560468:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107200 00000100:00100000:1.0:1788361767.560474:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107200 00000020:00000040:0.0:1788361767.560476:0:26167:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d137c92680 x1875230407107072/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361767.560478:0:26159:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:1.0:1788361767.560483:0:26159:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=46 00010000:00000040:0.0:1788361767.560492:0:26167:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 2 00010000:00080000:0.0:1788361767.560499:0:26167:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d137c92680 x1875230407107072/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.560524:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5015 00000100:00000040:0.0:1788361767.560529:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d137c92680 x1875230407107072/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.560530:0:26159:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 3 00000100:00000040:1.0:1788361767.560539:0:26159:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054a680 x1875230407107200/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.560562:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+46:2408:x1875230407107200:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788361767.560568:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d137c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f1e400d1-472b-42d1-b5e7-e80dc701272a+46:2408:x1875230407107072:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 117us (365us total) trans 0 rc 0/-999 00000020:00000040:1.0:1788361767.560576:0:26159:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054a680 x1875230407107200/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.560581:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5014 00010000:00000040:1.0:1788361767.560600:0:26159:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 4 00000100:00000040:0.0:1788361767.560604:0:26167:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 3 00010000:00080000:1.0:1788361767.560608:0:26159:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d11054a680 x1875230407107200/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.560619:0:26159:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054a680 x1875230407107200/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.560631:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+46:2408:x1875230407107200:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 73us (201us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.560636:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5015 00000100:00000040:1.0:1788361767.560638:0:26159:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 2 00000100:00000040:3.0:1788361767.560671:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d110548e00 x1875230407107328 msgsize 328 00000100:00100000:3.0:1788361767.560679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00080000:2.0:1788361767.560695:0:96787:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968814 00010000:00080000:2.0:1788361767.560701:0:96787:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00000040:2.0:1788361767.560709:0:96787:0:(ldlm_lib.c:2881:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:2.0:1788361767.560712:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00000040:3.0:1788361767.560715:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d110549180 x1875230407107456 msgsize 328 00010000:00080000:2.0:1788361767.560715:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00000100:00100000:3.0:1788361767.560727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361767.560727:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107328 00010000:00080000:2.0:1788361767.560728:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d137c92680 x1875230407107072/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.560735:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107328 00000020:00000040:0.0:1788361767.560739:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00010000:02000000:2.0:1788361767.560744:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00000040:3.0:1788361767.560750:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d11054aa00 x1875230407107584 msgsize 328 00000020:00000040:0.0:1788361767.560752:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=47 00000100:00100000:3.0:1788361767.560759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.560774:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107456 00000100:00100000:1.0:1788361767.560783:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107456 00000020:00000040:1.0:1788361767.560786:0:26160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000100:00000040:3.0:1788361767.560788:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d1364fc000 x1875230407107712 msgsize 328 00000100:00100000:0.0:1788361767.560788:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107584 00000020:00000040:1.0:1788361767.560789:0:26160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=48 00000100:00100000:0.0:1788361767.560794:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107584 00000020:00000040:0.0:1788361767.560799:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000100:00100000:3.0:1788361767.560803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000020:00000040:0.0:1788361767.560803:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=49 00000100:00100000:1.0:1788361767.560858:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107712 00000100:00100000:1.0:1788361767.560862:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107712 00000100:00100000:0.0:1788361767.560865:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5016 00000020:00000040:1.0:1788361767.560867:0:26160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000100:00000040:0.0:1788361767.560871:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 3 00000020:00000040:1.0:1788361767.560872:0:26160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=50 00000100:00000040:3.0:1788361767.560875:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d1364ff480 x1875230407107840 msgsize 328 00000100:00000040:0.0:1788361767.560881:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110548e00 x1875230407107328/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.560897:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2408:x1875230407107328:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1788361767.560906:0:26161:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110548e00 x1875230407107328/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1788361767.560914:0:26161:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 4 00000100:00100000:1.0:1788361767.560918:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5017 00010000:00080000:0.0:1788361767.560922:0:26161:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d110548e00 x1875230407107328/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.560924:0:26160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 5 00000100:00000040:1.0:1788361767.560934:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d110549180 x1875230407107456/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.560939:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110548e00 x1875230407107328/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.560955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361767.560959:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d110549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2408:x1875230407107456:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788361767.560965:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2408:x1875230407107328:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 68us (289us total) trans 0 rc 0/-999 00000020:00000040:1.0:1788361767.560973:0:26160:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d110549180 x1875230407107456/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788361767.560985:0:26160:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 6 00000100:00100000:0.0:1788361767.560986:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5016 00010000:00080000:1.0:1788361767.560991:0:26160:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d110549180 x1875230407107456/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788361767.560992:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99d1364fdc00 x1875230407107968 msgsize 328 00000100:00000040:0.0:1788361767.560992:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 5 00000100:00100000:3.0:1788361767.561005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00000040:1.0:1788361767.561007:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d110549180 x1875230407107456/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.561007:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107840 00000100:00100000:0.0:1788361767.561013:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107840 00000100:00100000:1.0:1788361767.561018:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d110549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+50:2408:x1875230407107456:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 63us (299us total) trans 0 rc 0/-999 00000020:00000040:0.0:1788361767.561018:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:0.0:1788361767.561022:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=51 00000100:00100000:1.0:1788361767.561032:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5017 00000100:00100000:3.0:1788361767.561034:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407107968 00000100:00000040:1.0:1788361767.561035:0:26160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 4 00000100:00100000:3.0:1788361767.561041:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407107968 00000020:00000040:3.0:1788361767.561045:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe50a8 00000020:00000040:3.0:1788361767.561049:0:26169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d136e1b800 refcount=52 00000100:00100000:1.0:1788361767.561056:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5018 00000100:00000040:1.0:1788361767.561076:0:26160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 5 00000100:00100000:0.0:1788361767.561082:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5019 00000100:00000040:1.0:1788361767.561085:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d11054aa00 x1875230407107584/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.561087:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 6 00000100:00000040:0.0:1788361767.561098:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1364fc000 x1875230407107712/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.561108:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5020 00000100:00100000:1.0:1788361767.561115:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d11054aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107584:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000100:00000040:3.0:1788361767.561116:0:26169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 7 00000100:00100000:0.0:1788361767.561116:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107712:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000100:00000040:3.0:1788361767.561127:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1364ff480 x1875230407107840/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788361767.561128:0:26160:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d11054aa00 x1875230407107584/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361767.561132:0:26161:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1364fc000 x1875230407107712/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788361767.561159:0:26160:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 8 00010000:00000040:0.0:1788361767.561162:0:26161:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 9 00010000:00080000:1.0:1788361767.561168:0:26160:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d11054aa00 x1875230407107584/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.561170:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107840:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788361767.561183:0:26161:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d1364fc000 x1875230407107712/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788361767.561190:0:26169:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1364ff480 x1875230407107840/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.561190:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d11054aa00 x1875230407107584/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.561200:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1364fc000 x1875230407107712/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788361767.561220:0:26169:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 10 00000100:00100000:0.0:1788361767.561225:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107712:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 111us (432us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.561237:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5019 00010000:00080000:3.0:1788361767.561238:0:26169:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d1364ff480 x1875230407107840/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.561241:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 9 00000100:00100000:0.0:1788361767.561253:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5021 00000100:00000040:3.0:1788361767.561255:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1364ff480 x1875230407107840/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.561257:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 10 00000100:00100000:3.0:1788361767.561269:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107840:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 105us (391us total) trans 0 rc 0/-999 00000100:00000040:0.0:1788361767.561271:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1364fdc00 x1875230407107968/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361767.561286:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5020 00000100:00000040:3.0:1788361767.561291:0:26169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 9 00000100:00100000:0.0:1788361767.561294:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107968:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1788361767.561304:0:26161:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99d1364fdc00 x1875230407107968/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1788361767.561311:0:26161:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99d136e1b800 : new rpc_count 10 00010000:00080000:0.0:1788361767.561316:0:26161:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d1364fdc00 x1875230407107968/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.561324:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1364fdc00 x1875230407107968/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.561331:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d11054aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107584:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 224us (573us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788361767.561341:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f1e400d1-472b-42d1-b5e7-e80dc701272a+52:2408:x1875230407107968:12345-192.168.204.35@tcp:101:ldlm_lock_repla.0 Request processed in 49us (344us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788361767.561347:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5018 00000100:00000040:1.0:1788361767.561352:0:26160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 9 00000100:00100000:0.0:1788361767.561356:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5021 00000100:00000040:0.0:1788361767.561360:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d136e1b800 : new rpc_count 8 00010000:00000040:2.0:1788361767.566265:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 7 00000020:00000040:2.0:1788361767.566299:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 51 00010000:00080000:2.0:1788361767.566307:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566332:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566355:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d11054a680 x1875230407107200/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566368:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566371:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 6 00000020:00000040:2.0:1788361767.566382:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 50 00010000:00080000:2.0:1788361767.566385:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566387:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566391:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d110548e00 x1875230407107328/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566429:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566431:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 5 00000020:00000040:2.0:1788361767.566437:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 49 00010000:00080000:2.0:1788361767.566439:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566441:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566447:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d110549180 x1875230407107456/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566454:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566456:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 4 00000020:00000040:2.0:1788361767.566461:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 48 00010000:00080000:2.0:1788361767.566462:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566463:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566468:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d11054aa00 x1875230407107584/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566474:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566476:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 3 00000020:00000040:2.0:1788361767.566480:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 47 00010000:00080000:2.0:1788361767.566482:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566483:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566487:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d1364fc000 x1875230407107712/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566493:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566494:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 2 00000020:00000040:2.0:1788361767.566499:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 46 00010000:00080000:2.0:1788361767.566501:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566503:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566508:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d1364ff480 x1875230407107840/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566524:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566526:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 1 00000020:00000040:2.0:1788361767.566531:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 45 00010000:00080000:2.0:1788361767.566533:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788361767.566534:0:96787:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788361767.566537:0:96787:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.35@tcp: req@ffff99d1364fdc00 x1875230407107968/t0(0) o101->f1e400d1-472b-42d1-b5e7-e80dc701272a@192.168.204.35@tcp:73/0 lens 328/0 e 0 to 0 dl 1788361778 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788361767.566541:0:96787:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788361767.566542:0:96787:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99d136e1b800 : new rpc_count 0 00000020:00000040:2.0:1788361767.566550:0:96787:0:(genops.c:900:class_export_put()) PUTting export ffff99d136e1b800 : new refcount 44 00010000:00080000:2.0:1788361767.566558:0:96787:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000020:00000040:3.0:1788361767.767563:0:94218:0:(genops.c:1231:class_import_get()) import ffff99d12c4e1000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788361767.767615:0:94218:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a0249605] to pc [ptlrpcd_00_02+2] req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.767668:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.767682:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429924480:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1788361767.767712:0:3652:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361783 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.767720:0:3652:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361767.767768:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e9f80 x1875230429924480 msgsize 224 00000100:00100000:0.0:1788361767.767774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361767.767800:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361783 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.767848:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924480 00000100:00000040:0.0:1788361767.767856:0:3652:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1176 usecs (2 jiffies) 00000100:00100000:1.0:1788361767.767858:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924480 00000020:00000040:1.0:1788361767.767863:0:8449:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe415f 00000020:00000040:1.0:1788361767.767867:0:8449:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d002ffa000 refcount=5 00000100:00000040:1.0:1788361767.767892:0:8449:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788361767.767934:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4242 00000100:00000040:1.0:1788361767.767945:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d002ffa000 : new rpc_count 1 00000100:00000040:1.0:1788361767.767952:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e9f80 x1875230429924480/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788361778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.767966:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429924480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788361767.767998:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00010000:00000040:1.0:1788361767.768009:0:8449:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875230429924480 00000100:00000040:1.0:1788361767.768018:0:8449:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 66 to 0@lo 00000100:00000040:1.0:1788361767.768022:0:8449:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788361767.768044:0:8449:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361783 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788361767.768066:0:8449:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 65 to 0@lo 00000100:00000040:1.0:1788361767.768070:0:8449:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9f80 x1875230429924480/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:73/0 lens 224/368 e 0 to 0 dl 1788361778 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361767.768077:0:3652:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00100000:1.0:1788361767.768082:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429924480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00000040:0.0:1788361767.768087:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361767.768096:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4242 00000100:00000040:1.0:1788361767.768102:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d002ffa000 : new rpc_count 0 00000004:00000040:0.0:1788361767.768106:0:3652:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352854 avail=317151 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000020:00000040:1.0:1788361767.768114:0:8449:0:(genops.c:900:class_export_put()) PUTting export ffff99d002ffa000 : new refcount 4 00000100:00000040:0.0:1788361767.768115:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361783 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361767.768125:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d1364fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429924480:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1788361767.768131:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d1364fd180 x1875230429924480/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361783 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361767.768141:0:3652:0:(genops.c:1244:class_import_put()) import ffff99d12c4e1000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:1.0:1788361768.021934:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1788361768.277884:0:94222:0:(genops.c:1231:class_import_get()) import ffff99d117299000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788361768.277927:0:94222:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002a9ca275] to pc [ptlrpcd_00_03+3] req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361768.277973:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1788361768.277992:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361768.278007:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429924608:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788361768.278038:0:3652:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361784 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788361768.278050:0:3652:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788361768.278087:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff99d1185e9180 x1875230429924608 msgsize 224 00000100:00100000:0.0:1788361768.278092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788361768.278120:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361784 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.278124:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924608 00000100:00100000:2.0:1788361768.278132:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924608 00000020:00000040:2.0:1788361768.278136:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4189 00000100:00000040:0.0:1788361768.278137:0:3652:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 4070 usecs (5 jiffies) 00000020:00000040:2.0:1788361768.278140:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d00541d000 refcount=5 00000020:00000040:2.0:1788361768.278154:0:8441:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00080000:0.0:1788361768.279779:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788361768.279796:0:6519:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99d137c03380) now 10 - evictor 00000100:00000040:2.0:1788361768.279811:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1788361768.279864:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00000040:2.0:1788361768.279869:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d00541d000 : new rpc_count 1 00000100:00000040:2.0:1788361768.279876:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d1185e9180 x1875230429924608/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:74/0 lens 224/0 e 0 to 0 dl 1788361779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.279892:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429924608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361768.279924:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000040:2.0:1788361768.279943:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1875230429924608 00000100:00000040:2.0:1788361768.279961:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 66 to 0@lo 00000100:00000040:2.0:1788361768.279966:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361768.279999:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361768.280024:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 65 to 0@lo 00000100:00000040:2.0:1788361768.280029:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d1185e9180 x1875230429924608/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:74/0 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.280038:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875230429924608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361768.280045:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00000040:2.0:1788361768.280048:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d00541d000 : new rpc_count 0 00000020:00000040:2.0:1788361768.280057:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99d00541d000 : new refcount 4 00000100:00000040:0.0:1788361768.280061:0:3652:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:0.0:1788361768.280068:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361768.280072:0:75531:0:(genops.c:1231:class_import_get()) import ffff99d106904000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000004:00000040:0.0:1788361768.280079:0:3652:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1788361768.280082:0:3652:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261733 state=0: rc = 0 00000100:00000040:0.0:1788361768.280091:0:3652:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361768.280098:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875230429924608:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788361768.280105:0:3652:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef1880 x1875230429924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788361768.280116:0:3652:0:(genops.c:1244:class_import_put()) import ffff99d117299000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788361768.280354:0:75531:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000093d26178] to pc [ptlrpcd_00_00+0] req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.280393:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:2.0:1788361768.280403:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.280414:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429924736:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788361768.280437:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361784 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361768.280445:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361768.280463:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff99d136ef3b80 x1875230429924736 msgsize 224 00000100:00100000:2.0:1788361768.280468:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788361768.280485:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361784 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361768.280496:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2648640 usecs (2649 jiffies) 00000100:00100000:2.0:1788361768.280523:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924736 00000100:00100000:2.0:1788361768.280529:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924736 00000020:00000040:2.0:1788361768.280531:0:23939:0:(genops.c:825:class_conn2export()) looking for export cookie 0x1b69fa8920fe4119 00000020:00000040:2.0:1788361768.280535:0:23939:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99d116c07800 refcount=7 00000100:00000040:2.0:1788361768.280547:0:23939:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788361768.280588:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243 00000100:00000040:2.0:1788361768.280591:0:23939:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99d116c07800 : new rpc_count 1 00000100:00000040:2.0:1788361768.280596:0:23939:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99d136ef3b80 x1875230429924736/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:74/0 lens 224/0 e 0 to 0 dl 1788361779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.280607:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429924736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788361768.280630:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00010000:00000040:2.0:1788361768.280640:0:23939:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875230429924736 00000100:00000040:2.0:1788361768.280645:0:23939:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99d104d3b280 refcount 66 to 0@lo 00000100:00000040:2.0:1788361768.280649:0:23939:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788361768.280667:0:23939:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788361768.280685:0:23939:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99d104d3b280 refcount 65 to 0@lo 00000100:00000040:2.0:1788361768.280689:0:23939:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef3b80 x1875230429924736/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:74/0 lens 224/368 e 0 to 0 dl 1788361779 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.280698:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d136ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429924736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361768.280704:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243 00000100:00000040:2.0:1788361768.280706:0:23939:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99d116c07800 : new rpc_count 0 00000020:00000040:2.0:1788361768.280712:0:23939:0:(genops.c:900:class_export_put()) PUTting export ffff99d116c07800 : new refcount 6 00000100:00000040:2.0:1788361768.280734:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:2.0:1788361768.280738:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788361768.280747:0:3651:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352762 avail=317059 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023568 state=0: rc = 0 00000100:00000040:2.0:1788361768.280760:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361768.280768:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429924736:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788361768.280775:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99d136ef2d80 x1875230429924736/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788361784 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788361768.280783:0:3651:0:(genops.c:1244:class_import_put()) import ffff99d106904000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000001:02000400:2.0:1788361768.708474:0:97128:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361769.046016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788361769.231496:0:97180:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788361769.231733:0:97180:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788361769.729315:0:97230:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788361769.730262:0:97230:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788361770.070057:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361771.094572:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361771.350956:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361771.350963:0:48377:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:1.0:1788361771.350983:0:48377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361771.350986:0:48377:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788361771.351024:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429925248:0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.351040:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429924992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.351109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351187:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429925760:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351244:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788361771.351251:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429924864:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351284:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351327:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429925376:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351355:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351379:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429925888:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351446:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429925120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361771.351529:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924992 00000100:00100000:3.0:1788361771.351537:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924992 00000100:00100000:3.0:1788361771.351594:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925888 00000100:00100000:3.0:1788361771.351597:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925888 00000100:00080000:2.0:1788361771.351604:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361771.351641:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429925632:0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.351657:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429925504:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351681:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361771.351689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361771.351705:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429926144:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351757:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925248 00000100:00100000:0.0:1788361771.351761:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925248 00000100:00100000:0.0:1788361771.351789:0:23938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925632 00000100:00100000:0.0:1788361771.351791:0:23938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925632 00000100:00100000:0.0:1788361771.351813:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4244 00000100:00100000:0.0:1788361771.351845:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429925248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361771.351882:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925120 00000100:00100000:3.0:1788361771.351888:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925120 00000100:00100000:2.0:1788361771.351896:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1788361771.351908:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429925248:12345-0@lo:400:kworker.0 Request processed in 85us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.351910:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429924992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351922:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4244 00000100:00100000:3.0:1788361771.351929:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1788361771.351938:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429925888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.351946:0:23938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4245 00000100:00100000:2.0:1788361771.351962:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429924992:12345-0@lo:400:kworker.0 Request processed in 57us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.351971:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1788361771.351986:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875230429925888:12345-0@lo:400:kworker.0 Request processed in 48us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.351992:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1788361771.352000:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429925120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.352044:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429925120:12345-0@lo:400:kworker.0 Request processed in 44us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361771.352047:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d137c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429926016:0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.352079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361771.352110:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429924992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.352136:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925504 00000100:00100000:1.0:1788361771.352140:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925504 00000100:00100000:3.0:1788361771.352194:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1788361771.352202:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1788361771.352209:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926016 00000100:00100000:3.0:1788361771.352215:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926016 00000100:00080000:2.0:1788361771.352233:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361771.352238:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788361771.352244:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1788361771.352258:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429926016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361771.352298:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429926016:12345-0@lo:400:kworker.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361771.352307:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1788361771.352310:0:23938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429925632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.352350:0:23938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d004a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429925632:12345-0@lo:400:kworker.0 Request processed in 396us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361771.352357:0:23938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4245 00000100:00100000:0.0:1788361771.352380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361771.352547:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925760 00000100:00100000:3.0:1788361771.352551:0:94209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429924864 00000100:00100000:2.0:1788361771.352553:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925760 00000100:00100000:3.0:1788361771.352558:0:94209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429924864 00000100:00100000:3.0:1788361771.352594:0:94209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788361771.352603:0:94209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429924864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.352612:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429925376 00000100:00100000:2.0:1788361771.352617:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429925376 00000100:00100000:1.0:1788361771.352640:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926144 00000100:00100000:1.0:1788361771.352646:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926144 00000100:00100000:2.0:1788361771.352649:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1788361771.352659:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429925760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.352680:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1788361771.352690:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429925504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.352700:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875230429925760:12345-0@lo:400:kworker.0 Request processed in 42us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.352707:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1788361771.352724:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:2.0:1788361771.352735:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1185eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429925376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361771.352735:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429925504:12345-0@lo:400:kworker.0 Request processed in 44us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361771.352794:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429925120:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353569:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1185eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875230429925376:12345-0@lo:400:kworker.0 Request processed in 42us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.353578:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1788361771.353609:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1788361771.353616:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1788361771.353623:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429926144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353654:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429926144:12345-0@lo:400:kworker.0 Request processed in 33us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.353658:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00080000:2.0:1788361771.353673:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788361771.353676:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361771.353710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3650:1875230429924864:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353721:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429925376:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353730:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875230429925888:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353741:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429925248:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353749:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875230429925760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353974:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429925504:0@lo:400:kworker.0 00000100:00100000:2.0:1788361771.353992:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429926016:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.354307:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429925632:0@lo:400:kworker.0 00000100:00100000:0.0:1788361771.354328:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d137c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429926144:0@lo:400:kworker.0 00000100:00100000:3.0:1788361771.354589:0:94209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3650:x1875230429924864:12345-0@lo:400:kworker.0 Request processed in 199us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361771.354598:0:94209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788361771.862231:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361771.862495:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429926272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788361771.862575:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361771.862710:0:10106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926272 00000100:00100000:2.0:1788361771.862720:0:10106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926272 00000100:00100000:2.0:1788361771.862817:0:10106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:2.0:1788361771.862929:0:10106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429926272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788361771.862970:0:10106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788361771.863022:0:10106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429926272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361771.863030:0:10106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1788361771.863120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429926272:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1788361771.864708:0:96772:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968813 is committed 00010000:00010000:1.0:1788361772.118245:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361772.377134:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361772.377142:0:85876:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1788361772.377166:0:85876:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361772.377169:0:85876:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1788361772.377214:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429926400:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377303:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377471:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429926912:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377544:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875230429927424:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377619:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788361772.377628:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429926784:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377661:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377698:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429927296:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377728:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377773:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429926528:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377877:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429927040:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.377893:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429926656:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.377903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377924:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429927552:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.377936:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.377959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.377964:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429927168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.377994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.378016:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429927680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.378046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.378063:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926400 00000100:00100000:2.0:1788361772.378071:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926400 00000100:00100000:1.0:1788361772.378085:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927424 00000100:00100000:1.0:1788361772.378090:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927424 00000100:00100000:2.0:1788361772.378121:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788361772.378127:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926528 00000100:00100000:1.0:1788361772.378132:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926528 00000100:00100000:2.0:1788361772.378133:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429926400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378188:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c8a6f36d-efb9-41cf-af98-5917323f2b0d+24:3651:x1875230429926400:12345-0@lo:400:kworker.0 Request processed in 58us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.378197:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788361772.378201:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926912 00000100:00100000:0.0:1788361772.378206:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926912 00000100:00100000:2.0:1788361772.378236:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927040 00000100:00100000:0.0:1788361772.378240:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927296 00000100:00100000:2.0:1788361772.378241:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927040 00000100:00100000:0.0:1788361772.378245:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927296 00000100:00100000:2.0:1788361772.378264:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926656 00000100:00100000:2.0:1788361772.378270:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926656 00000100:00100000:0.0:1788361772.378287:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1788361772.378290:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927552 00000100:00100000:2.0:1788361772.378294:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927552 00000100:00100000:0.0:1788361772.378298:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429926912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.378339:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1875230429926912:12345-0@lo:400:kworker.0 Request processed in 44us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361772.378346:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:0.0:1788361772.378362:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1788361772.378370:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429927296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378383:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927680 00000100:00100000:2.0:1788361772.378388:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927680 00000100:00100000:0.0:1788361772.378403:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429927296:12345-0@lo:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.378409:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1788361772.378416:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1788361772.378421:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875230429927424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378457:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875230429927424:12345-0@lo:400:kworker.0 Request processed in 41us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.378473:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1788361772.378487:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1788361772.378509:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429927040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378544:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875230429927040:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.378551:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1788361772.378602:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1788361772.378610:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429926656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.378651:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875230429926656:12345-0@lo:400:kworker.0 Request processed in 42us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.378658:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1788361772.378672:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1788361772.378680:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429927552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378687:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788361772.378697:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429927680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.378712:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875230429927552:12345-0@lo:400:kworker.0 Request processed in 33us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.378719:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1788361772.378735:0:66128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1788361772.378742:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875230429927680:12345-0@lo:400:kworker.0 Request processed in 46us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.378745:0:66128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429926528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378754:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788361772.378779:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429926784 00000100:00100000:2.0:1788361772.378784:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429926784 00000100:00100000:1.0:1788361772.378784:0:66128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875230429926528:12345-0@lo:400:kworker.0 Request processed in 42us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.378793:0:66128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1788361772.378818:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927168 00000100:00100000:2.0:1788361772.378842:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927168 00000100:00100000:1.0:1788361772.378844:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4246 00000100:00100000:1.0:1788361772.378856:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429926784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.378869:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4247 00000100:00100000:2.0:1788361772.378880:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d10695d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429927168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.378896:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875230429926784:12345-0@lo:400:kworker.0 Request processed in 43us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.378903:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4246 00000100:00100000:2.0:1788361772.378920:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d10695d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429927168:12345-0@lo:400:kworker.0 Request processed in 42us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.378928:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4247 00000100:00100000:1.0:1788361772.378949:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875230429926656:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.378963:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429927168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.378980:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875230429927680:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379052:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875230429926528:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379070:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875230429927040:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379083:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875230429927552:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379123:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429926784:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379143:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429927296:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379152:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8a6f36d-efb9-41cf-af98-5917323f2b0d:3651:1875230429926400:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379162:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d136ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875230429926912:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.379171:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875230429927424:0@lo:400:kworker.0 00000100:00100000:3.0:1788361772.426099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361772.426469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361772.426516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361772.426546:0:66901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108224 00000100:00100000:3.0:1788361772.426550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788361772.426557:0:66901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108224 00000100:00100000:1.0:1788361772.426573:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108480 00000100:00100000:1.0:1788361772.426580:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108480 00000100:00100000:3.0:1788361772.426581:0:66128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108352 00000100:00100000:3.0:1788361772.426586:0:66128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108352 00000100:00100000:1.0:1788361772.426639:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1960 00000100:00100000:1.0:1788361772.426650:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407108480:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361772.426658:0:94207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108096 00000100:00100000:2.0:1788361772.426663:0:94207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108096 00000100:00100000:2.0:1788361772.426708:0:94207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 200 00000100:00100000:2.0:1788361772.426717:0:94207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407108096:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361772.426752:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407108480:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 103us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.426763:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1960 00000100:00100000:2.0:1788361772.426800:0:94207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d12cfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3956ab41-635b-456b-967f-6c1073c5d2df+10:2412:x1875230407108096:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 84us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.426807:0:94207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 200 00000100:00100000:0.0:1788361772.427282:0:66901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 998 00000100:00100000:0.0:1788361772.427293:0:66901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407108224:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788361772.427333:0:66901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407108224:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 44us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361772.427340:0:66901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 998 00000100:00100000:2.0:1788361772.427485:0:80345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 999 00000100:00100000:2.0:1788361772.427503:0:80345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2412:x1875230407108352:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361772.427536:0:80345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2412:x1875230407108352:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 30us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.427543:0:80345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 999 00000100:00080000:1.0:1788361772.427708:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361772.427713:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788361772.427716:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1788361772.527704:0:97422:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:3.0:1788361772.886032:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361772.886057:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429927808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788361772.886138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.886334:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927808 00000100:00100000:1.0:1788361772.886354:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927808 00000100:00100000:1.0:1788361772.886416:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4248 00000100:00100000:1.0:1788361772.886426:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429927808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788361772.886463:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445289984 avail 1299050496 00000100:00100000:1.0:1788361772.886521:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875230429927808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.886529:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4248 00000100:00100000:3.0:1788361772.886577:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d14109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875230429927808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788361773.142000:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361773.398055:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361773.398080:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429927936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788361773.398157:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361773.398194:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361773.398204:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99d134a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429928064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361773.398248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361773.398284:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429928064 00000100:00100000:0.0:1788361773.398291:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429928064 00000100:00100000:2.0:1788361773.398292:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230429927936 00000100:00100000:2.0:1788361773.398298:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230429927936 00000100:00100000:0.0:1788361773.398342:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:2.0:1788361773.398348:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4249 00000100:00100000:0.0:1788361773.398354:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429928064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361773.398360:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d134a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429927936:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1788361773.398389:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000004:00000024:2.0:1788361773.398398:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00080000:1.0:1788361773.398439:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361773.398439:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d141098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875230429928064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361773.398455:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:2.0:1788361773.398462:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d134a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875230429927936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361773.398480:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4249 00000100:00100000:1.0:1788361773.398520:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875230429928064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361773.398537:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99d134a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875230429927936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788361773.449462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361773.449517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361773.449560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788361773.449598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788361773.449679:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108992 00000100:00100000:1.0:1788361773.449689:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108992 00000100:00100000:1.0:1788361773.449749:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1961 00000100:00100000:1.0:1788361773.449759:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407108992:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361773.449850:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e400d1-472b-42d1-b5e7-e80dc701272a+7:2411:x1875230407108992:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361773.449867:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1961 00000100:00100000:2.0:1788361773.450342:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108736 00000100:00100000:2.0:1788361773.450348:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108736 00000100:00100000:2.0:1788361773.450391:0:67579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108864 00000100:00100000:2.0:1788361773.450394:0:67579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108864 00000100:00100000:2.0:1788361773.450430:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1000 00000100:00100000:2.0:1788361773.450438:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407108736:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361773.450485:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+51:2411:x1875230407108736:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 48us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361773.450493:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1000 00000100:00100000:2.0:1788361773.450508:0:67579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1001 00000100:00100000:2.0:1788361773.450516:0:67579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407108864:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788361773.450542:0:67579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d1364fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f1e400d1-472b-42d1-b5e7-e80dc701272a+11:2411:x1875230407108864:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361773.450545:0:94211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230407108608 00000100:00100000:2.0:1788361773.450552:0:67579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1001 00000100:00100000:1.0:1788361773.450552:0:94211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230407108608 00000100:00100000:1.0:1788361773.450591:0:94211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:1.0:1788361773.450600:0:94211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:2411:x1875230407108608:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788361773.450630:0:94211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99d14097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3956ab41-635b-456b-967f-6c1073c5d2df+10:2411:x1875230407108608:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 32us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361773.450638:0:94211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 201 00000001:02000400:0.0:1788361773.549319:0:97471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:2.0:1788361774.166000:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361774.668184:0:97519:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00010000:00010000:3.0:1788361775.190104:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 59993 lines, 59993 kept, 0 dropped, 0 bad.